Re: downloading from links within a webpage

Path	csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!newsfeed.datemas.de!weretis.net!feeder4.news.weretis.net!feeds.phibee-telecom.net!newsfeed.xs4all.nl!newsfeed1a.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path	<rosuav@gmail.com>
X-Original-To	python-list@python.org
Delivered-To	python-list@mail.python.org
X-Spam-Status	OK 0.030
X-Spam-Evidence	'H': 0.94; 'S': 0.00; 'to)': 0.09; 'cc:addr :python-list': 0.11; 'python': 0.11; 'wrote': 0.14; 'from:addr:rosuav': 0.16; 'from:name:chris angelico': 0.16; 'idea:': 0.16; 'limiting': 0.16; '(you': 0.16; 'wrote:': 0.18; 'wed,': 0.18; 'cc:addr:python.org': 0.22; 'cc:2**0': 0.24; '15,': 0.26; 'header:In-Reply-To:1': 0.27; 'external': 0.29; 'am,': 0.29; 'specified': 0.30; 'message-id:@mail.gmail.com': 0.30; 'code': 0.31; 'depth': 0.31; 'subject:from': 0.34; 'received:google.com': 0.35; 'searching': 0.37; 'does': 0.39; 'how': 0.40; 'first': 0.61; 'here': 0.66; 'webpage': 0.68; 'limit': 0.70; '3.4': 0.84; 'to:none': 0.92
DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:cc :content-type; bh=317l8Jlup6HtO1Yu6Td1nPEDXMkhujno+qIkKA1Fz40=; b=A1zus/uRGyB23JJRiKRbiP54pP/IiCMeIft4AX51FaE1NJv3TRcv6IkrqD/CtVL/m3 dEypfHq2ZfNMJZWKJk4SoR9AXwlgjUAKY5Te/4X26syBHXqqrtieIcBr32WE7rH9bW/K lzrGC4n7eGz80ixr206NaToqPZF492D5doDIf6Ii3ptIsEBn79RjLR0fTfl4qhAAEMbe PQsWtl2jVeQJGHkb5U0w4wKB+MKRlXutFWIff2gluYXT2gaW1SzzjpTpLcIqhBwWU4Vr fsCRPLVfaWaaRLHcbBgCEgL6NvCiEzxlCO5rYkFmLYttbpJtJDW0VYOzuCugcBvez5Tp hHgQ==
MIME-Version	1.0
X-Received	by 10.50.110.4 with SMTP id hw4mr7417309igb.14.1413298448010; Tue, 14 Oct 2014 07:54:08 -0700 (PDT)
In-Reply-To	<loom.20141014T163517-784@post.gmane.org>
References	<loom.20141014T163517-784@post.gmane.org>
Date	Wed, 15 Oct 2014 01:54:07 +1100
Subject	Re: downloading from links within a webpage
From	Chris Angelico <rosuav@gmail.com>
Cc	"python-list@python.org" <python-list@python.org>
Content-Type	text/plain; charset=UTF-8
X-BeenThere	python-list@python.org
X-Mailman-Version	2.1.15
Precedence	list
List-Id	General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe	<https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-list/>
List-Post	<mailto:python-list@python.org>
List-Help	<mailto:python-list-request@python.org?subject=help>
List-Subscribe	<https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups	comp.lang.python
Message-ID	<mailman.14854.1413298451.18130.python-list@python.org> (permalink)
Lines	13
NNTP-Posting-Host	2001:888:2000:d::a6
X-Trace	1413298451 news.xs4all.nl 2894 [2001:888:2000:d::a6]:55034
X-Complaints-To	abuse@xs4all.nl
Xref	csiph.com comp.lang.python:79102

Show key headers only | View raw

On Wed, Oct 15, 2014 at 1:42 AM, Shiva
<shivaji_tn@yahoo.com.dmarc.invalid> wrote:
> Here is a small code that I wrote that downloads images from a webpage url
> specified (you can limit to how many downloads you want). However, I am
> looking at adding functionality and searching external links from this page
> and downloading the same number of images from that page as well.(And
> limiting the depth it can go to)
>
> Any ideas?  (I am using Python 3.4 & I am a beginner)

First idea: Use wget, it does all this for you :)

ChrisA

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread

Thread

Re: downloading from links within a webpage Chris Angelico <rosuav@gmail.com> - 2014-10-15 01:54 +1100

csiph-web