Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #20727

Re: asynchronous downloading

References <33089103.45.1329980290357.JavaMail.geo-discussion-forums@pbne2> <4F462108.2000400@skippinet.com.au>
From Richard Baron Penman <richardbp@gmail.com>
Date 2012-02-24 00:50 +1100
Subject Re: asynchronous downloading
Newsgroups comp.lang.python
Message-ID <mailman.74.1330005055.3037.python-list@python.org> (permalink)

Show all headers | View raw

>> I want to download content asynchronously. This would be
>> straightforward to do threaded or across processes, but difficult
>> asynchronously so people seem to rely on external libraries (twisted
>> / gevent / eventlet).
>
>
> Exactly - the fact it's difficult is why those tools compete.

It is difficult in Python because the async libraries do not offer
much. Straightforward in some other languages.

Do you know why there is little support for asynchronous execution in
the standard libraries?
For large scale downloading I found thread pools do not scale well.

Richard

Back to comp.lang.python | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

asynchronous downloading Plumo <richardbp@gmail.com> - 2012-02-22 22:58 -0800
  Re: asynchronous downloading Justin Ezequiel <justin.mailinglists@gmail.com> - 2012-02-22 23:25 -0800
  Re: asynchronous downloading Mark Hammond <mhammond@skippinet.com.au> - 2012-02-23 22:20 +1100
  Re: asynchronous downloading Paul Rubin <no.email@nospam.invalid> - 2012-02-23 03:46 -0800
    Re: asynchronous downloading Plumo <richardbp@gmail.com> - 2012-02-23 16:28 -0800
  Re: asynchronous downloading Richard Baron Penman <richardbp@gmail.com> - 2012-02-24 00:50 +1100
  Re: asynchronous downloading Giampaolo Rodolà <g.rodola@gmail.com> - 2012-02-23 18:31 +0100
    Re: asynchronous downloading Plumo <richardbp@gmail.com> - 2012-02-23 17:10 -0800
    Re: asynchronous downloading Plumo <richardbp@gmail.com> - 2012-02-23 17:10 -0800
      Re: asynchronous downloading Fayaz Yusuf Khan <fayaz.yusuf.khan@gmail.com> - 2012-02-23 18:31 -0800
      Re: asynchronous downloading Giampaolo Rodolà <g.rodola@gmail.com> - 2012-02-24 10:03 +0100
      Re: asynchronous downloading Richard Baron Penman <richardbp@gmail.com> - 2012-02-26 08:44 +1100

csiph-web