downloading from links within a webpage

Path	csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!newsfeed.xs4all.nl!newsfeed2.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path	<python-python-list@m.gmane.org>
X-Original-To	python-list@python.org
Delivered-To	python-list@mail.python.org
X-Spam-Status	OK 0.007
X-Spam-Evidence	'H': 0.99; 'S': 0.00; 'received:80.91': 0.09; 'received:80.91.229': 0.09; 'received:gmane.org': 0.09; 'received:list': 0.09; 'to)': 0.09; 'python': 0.11; 'wrote': 0.14; 'limiting': 0.16; 'message-id:@post.gmane.org': 0.16; 'received:80.91.229.3': 0.16; 'received:plane.gmane.org': 0.16; 'skip:u 50': 0.16; 'url=""': 0.16; '(you': 0.16; 'thanks,': 0.17; 'import': 0.22; 'header:User-Agent:1': 0.23; 'header:X-Complaints- To:1': 0.27; 'external': 0.29; 'specified': 0.30; 'code': 0.31; 'depth': 0.31; 'skip:m 30': 0.32; 'subject:from': 0.34; 'skip:u 20': 0.35; 'charset:us-ascii': 0.36; 'hi,': 0.36; 'searching': 0.37; 'to:addr:python-list': 0.38; 'to:addr:python.org': 0.39; 'received:org': 0.40; 'how': 0.40; 'skip:u 10': 0.60; 'here': 0.66; 'webpage': 0.68; 'limit': 0.70; '3.4': 0.84
X-Injected-Via-Gmane	http://gmane.org/
To	python-list@python.org
From	Shiva <shivaji_tn@yahoo.com>
Subject	downloading from links within a webpage
Date	Tue, 14 Oct 2014 14:42:21 +0000 (UTC)
Mime-Version	1.0
Content-Type	text/plain; charset=us-ascii
Content-Transfer-Encoding	7bit
X-Gmane-NNTP-Posting-Host	sea.gmane.org
User-Agent	Loom/3.14 (http://gmane.org/)
X-Loom-IP	95.146.91.89 (Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Firefox/31.0)
X-BeenThere	python-list@python.org
X-Mailman-Version	2.1.15
Precedence	list
List-Id	General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe	<https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-list/>
List-Post	<mailto:python-list@python.org>
List-Help	<mailto:python-list-request@python.org?subject=help>
List-Subscribe	<https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups	comp.lang.python
Message-ID	<mailman.14853.1413297763.18130.python-list@python.org> (permalink)
Lines	28
NNTP-Posting-Host	2001:888:2000:d::a6
X-Trace	1413297763 news.xs4all.nl 2940 [2001:888:2000:d::a6]:51996
X-Complaints-To	abuse@xs4all.nl
Xref	csiph.com comp.lang.python:79101

Show key headers only | View raw

Hi,

Here is a small code that I wrote that downloads images from a webpage url
specified (you can limit to how many downloads you want). However, I am
looking at adding functionality and searching external links from this page
and downloading the same number of images from that page as well.(And
limiting the depth it can go to)

Any ideas?  (I am using Python 3.4 & I am a beginner)

import urllib.request
import re
url="http://www.abc.com"

pagehtml = urllib.request.urlopen(url)
myfile = pagehtml.read()
matches=re.findall(r'http://\S+jpg|jpeg',str(myfile))


for urltodownload in matches[0:50]:
  imagename=urltodownload[-12:]
  urllib.request.urlretrieve(urltodownload,imagename)

print('Done!')
 
Thanks,
Shiva

Back to comp.lang.python | Previous | Next — Next in thread | Find similar | Unroll thread

Thread

downloading from links within a webpage Shiva <shivaji_tn@yahoo.com> - 2014-10-14 14:42 +0000
  Re: downloading from links within a webpage Rustom Mody <rustompmody@gmail.com> - 2014-10-14 08:31 -0700

csiph-web