Path: csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!newsfeed.xs4all.nl!newsfeed2.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.007 X-Spam-Evidence: '*H*': 0.99; '*S*': 0.00; 'received:80.91': 0.09; 'received:80.91.229': 0.09; 'received:gmane.org': 0.09; 'received:list': 0.09; 'to)': 0.09; 'python': 0.11; 'wrote': 0.14; 'limiting': 0.16; 'message-id:@post.gmane.org': 0.16; 'received:80.91.229.3': 0.16; 'received:plane.gmane.org': 0.16; 'skip:u 50': 0.16; 'url=""': 0.16; '(you': 0.16; 'thanks,': 0.17; 'import': 0.22; 'header:User-Agent:1': 0.23; 'header:X-Complaints- To:1': 0.27; 'external': 0.29; 'specified': 0.30; 'code': 0.31; 'depth': 0.31; 'skip:m 30': 0.32; 'subject:from': 0.34; 'skip:u 20': 0.35; 'charset:us-ascii': 0.36; 'hi,': 0.36; 'searching': 0.37; 'to:addr:python-list': 0.38; 'to:addr:python.org': 0.39; 'received:org': 0.40; 'how': 0.40; 'skip:u 10': 0.60; 'here': 0.66; 'webpage': 0.68; 'limit': 0.70; '3.4': 0.84 X-Injected-Via-Gmane: http://gmane.org/ To: python-list@python.org From: Shiva Subject: downloading from links within a webpage Date: Tue, 14 Oct 2014 14:42:21 +0000 (UTC) Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Gmane-NNTP-Posting-Host: sea.gmane.org User-Agent: Loom/3.14 (http://gmane.org/) X-Loom-IP: 95.146.91.89 (Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Firefox/31.0) X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Newsgroups: comp.lang.python Message-ID: Lines: 28 NNTP-Posting-Host: 2001:888:2000:d::a6 X-Trace: 1413297763 news.xs4all.nl 2940 [2001:888:2000:d::a6]:51996 X-Complaints-To: abuse@xs4all.nl Xref: csiph.com comp.lang.python:79101 Hi, Here is a small code that I wrote that downloads images from a webpage url specified (you can limit to how many downloads you want). However, I am looking at adding functionality and searching external links from this page and downloading the same number of images from that page as well.(And limiting the depth it can go to) Any ideas? (I am using Python 3.4 & I am a beginner) import urllib.request import re url="http://www.abc.com" pagehtml = urllib.request.urlopen(url) myfile = pagehtml.read() matches=re.findall(r'http://\S+jpg|jpeg',str(myfile)) for urltodownload in matches[0:50]: imagename=urltodownload[-12:] urllib.request.urlretrieve(urltodownload,imagename) print('Done!') Thanks, Shiva