Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.lang.python > #80190
| References | <5d9b7957-ee57-4cc4-b4eb-7a933bad1a5e@googlegroups.com> |
|---|---|
| Date | 2014-11-05 01:59 +1100 |
| Subject | Re: simple download manager |
| From | Chris Angelico <rosuav@gmail.com> |
| Newsgroups | comp.lang.python |
| Message-ID | <mailman.15449.1415113202.18130.python-list@python.org> (permalink) |
On Wed, Nov 5, 2014 at 1:53 AM, Kiuhnm <gandalf23@mail.com> wrote: > I wish to automate the downloading from a particular site which has some ADs and which requires to click on a lot of buttons before the download starts. > > What library should I use to handle HTTP? > Also, I need to support big files (> 1 GB) so the library should hand the data to me chunk by chunk. You may be violating the site's terms of service, so be aware of what you're doing. This could be a really simple job (just figure out what the last HTTP query is, and replicate that), or it could be insanely complicated (crypto, JavaScript, and/or timestamped URLs could easily be involved). To start off, I would recommend not writing a single like of Python code, but just pulling up Mozilla Firefox with Firebug, or Google Chrome with in-built inspection tools, or some equivalent, and watching the exact queries that go through. Once you figure out what queries are happening, you can figure out how to do them in Python. ChrisA
Back to comp.lang.python | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread
simple download manager Kiuhnm <gandalf23@mail.com> - 2014-11-04 06:53 -0800
Re: simple download manager Chris Angelico <rosuav@gmail.com> - 2014-11-05 01:59 +1100
Re: simple download manager Kiuhnm <gandalf23@mail.com> - 2014-11-04 07:10 -0800
Re: simple download manager Kiuhnm <gandalf23@mail.com> - 2014-11-04 16:38 -0800
csiph-web