Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #80192

Re: simple download manager

Newsgroups comp.lang.python
Date 2014-11-04 07:10 -0800
References <5d9b7957-ee57-4cc4-b4eb-7a933bad1a5e@googlegroups.com> <mailman.15449.1415113202.18130.python-list@python.org>
Message-ID <def69eb0-be79-45ad-8e09-622337275b02@googlegroups.com> (permalink)
Subject Re: simple download manager
From Kiuhnm <gandalf23@mail.com>

Show all headers | View raw


On Tuesday, November 4, 2014 4:00:51 PM UTC+1, Chris Angelico wrote:
> On Wed, Nov 5, 2014 at 1:53 AM, Kiuhnm <gandalf23@mail.com> wrote:
> > I wish to automate the downloading from a particular site which has some ADs and which requires to click on a lot of buttons before the download starts.
> >
> > What library should I use to handle HTTP?
> > Also, I need to support big files (> 1 GB) so the library should hand the data to me chunk by chunk.
> 
> You may be violating the site's terms of service, so be aware of what
> you're doing.
> 
> This could be a really simple job (just figure out what the last HTTP
> query is, and replicate that), or it could be insanely complicated
> (crypto, JavaScript, and/or timestamped URLs could easily be
> involved). To start off, I would recommend not writing a single like
> of Python code, but just pulling up Mozilla Firefox with Firebug, or
> Google Chrome with in-built inspection tools, or some equivalent, and
> watching the exact queries that go through. Once you figure out what
> queries are happening, you can figure out how to do them in Python.
> 
> ChrisA

It'll be tricky. I'm sure of that, but if the browser can do it, so can I :)
Fortunately, there are no captchas.

Back to comp.lang.python | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread


Thread

simple download manager Kiuhnm <gandalf23@mail.com> - 2014-11-04 06:53 -0800
  Re: simple download manager Chris Angelico <rosuav@gmail.com> - 2014-11-05 01:59 +1100
    Re: simple download manager Kiuhnm <gandalf23@mail.com> - 2014-11-04 07:10 -0800
      Re: simple download manager Kiuhnm <gandalf23@mail.com> - 2014-11-04 16:38 -0800

csiph-web