Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #79103

Re: downloading from links within a webpage

References <loom.20141014T163517-784@post.gmane.org> <CAPTjJmpcu5zi1+r9nVHEWot0j7Xqxyms8_2_RRrKN=Hnu-7bHg@mail.gmail.com>
Date 2014-10-14 10:57 -0400
Subject Re: downloading from links within a webpage
From Joel Goldstick <joel.goldstick@gmail.com>
Newsgroups comp.lang.python
Message-ID <mailman.14855.1413298650.18130.python-list@python.org> (permalink)

Show all headers | View raw


On Tue, Oct 14, 2014 at 10:54 AM, Chris Angelico <rosuav@gmail.com> wrote:
> On Wed, Oct 15, 2014 at 1:42 AM, Shiva
> <shivaji_tn@yahoo.com.dmarc.invalid> wrote:
>> Here is a small code that I wrote that downloads images from a webpage url
>> specified (you can limit to how many downloads you want). However, I am
>> looking at adding functionality and searching external links from this page
>> and downloading the same number of images from that page as well.(And
>> limiting the depth it can go to)
>>
>> Any ideas?  (I am using Python 3.4 & I am a beginner)
>
> First idea: Use wget, it does all this for you :)

You might look at Requests and BeautifulSoup python modules.  Requests
is easier for many things than urllib.  BS is an HTML parser that may
be easier, and more powerful than what you can do with regex
>
> ChrisA
> --
> https://mail.python.org/mailman/listinfo/python-list



-- 
Joel Goldstick
http://joelgoldstick.com

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread


Thread

Re: downloading from links within a webpage Joel Goldstick <joel.goldstick@gmail.com> - 2014-10-14 10:57 -0400

csiph-web