Groups > comp.lang.python > #20737

Re: asynchronous downloading

Path	csiph.com!x330-a1.tempe.blueboxinc.net!usenet.pasdenom.info!weretis.net!feeder1.news.weretis.net!feeder.erje.net!newsfeed.xs4all.nl!newsfeed5.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path	<g.rodola@gmail.com>
X-Original-To	python-list@python.org
Delivered-To	python-list@mail.python.org
X-Spam-Status	OK 0.021
X-Spam-Evidence	'H': 0.96; 'S': 0.00; 'url:sourceforge': 0.02; 'plenty': 0.03; 'url:github': 0.09; 'asyncore': 0.16; 'url:documentation': 0.16; 'cc:addr:python-list': 0.16; 'looked': 0.16; 'this:': 0.16; 'stick': 0.18; 'cc:no real name:20': 0.21; 'received:209.85.210.174': 0.21; 'received:mail- iy0-f174.google.com': 0.21; 'header:In-Reply-To:1': 0.22; 'though.': 0.23; 'libraries': 0.24; 'developing': 0.25; 'cc:20': 0.26; 'url:mailman': 0.27; 'url:code': 0.28; 'message- id:@mail.gmail.com': 0.29; 'cc:addr:python.org': 0.29; 'seem': 0.29; 'asynchronous': 0.30; 'url:projects': 0.30; '---': 0.31; 'skip:( 20': 0.31; 'url:listinfo': 0.32; 'modules': 0.32; 'stopped': 0.32; 'there': 0.33; 'richard': 0.34; 'from:charset:iso-8859-1': 0.35; 'external': 0.35; 'url:python': 0.35; 'http': 0.37; 'but': 0.37; 'received:google.com': 0.37; 'received:209.85': 0.38; 'third': 0.38; 'url:org': 0.39; 'difficult': 0.39; "i'd": 0.39; 'received:209': 0.39; 'client': 0.40; 'one,': 0.40; 'header:Received:6': 0.61; 'simple': 0.61; 'url:p': 0.62; 'interest': 0.64; 'processes,': 0.67; 'febbraio': 0.84; 'amongst': 0.91
Received-SPF	pass (google.com: domain of g.rodola@gmail.com designates 10.43.45.10 as permitted sender) client-ip=10.43.45.10;
Authentication-Results	mr.google.com; spf=pass (google.com: domain of g.rodola@gmail.com designates 10.43.45.10 as permitted sender) smtp.mail=g.rodola@gmail.com; dkim=pass header.i=g.rodola@gmail.com
DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=U6vX9Pd2hmzUMLDRtLZNGH+t/216D6j3iX8hNnmOOWo=; b=OC7moE0DU4vVn7IqIuH05LbuNnjh1jiTCpgsz2L7tIUCSd9VCcZaEwaZlolrUC5Rbc nqn9Q74cXbu+WEP4BxL5XBXSfn1h/dgqn2642PB2eb0c4EkYhRF3uNK/wjMV1ioryXMD KwyhciG6ez3GCVObl4POIdZ3FcDI4GbbSEmbw=
MIME-Version	1.0
In-Reply-To	<33089103.45.1329980290357.JavaMail.geo-discussion-forums@pbne2>
References	<33089103.45.1329980290357.JavaMail.geo-discussion-forums@pbne2>
Date	Thu, 23 Feb 2012 18:31:54 +0100
Subject	Re: asynchronous downloading
From	Giampaolo Rodolà <g.rodola@gmail.com>
To	Plumo <richardbp@gmail.com>
Content-Type	text/plain; charset=ISO-8859-1
Cc	python-list@python.org
X-BeenThere	python-list@python.org
X-Mailman-Version	2.1.12
Precedence	list
List-Id	General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe	<http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-list>
List-Post	<mailto:python-list@python.org>
List-Help	<mailto:python-list-request@python.org?subject=help>
List-Subscribe	<http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups	comp.lang.python
Message-ID	<mailman.81.1330018318.3037.python-list@python.org> (permalink)
Lines	28
NNTP-Posting-Host	2001:888:2000:d::a6
X-Trace	1330018318 news.xs4all.nl 6874 [2001:888:2000:d::a6]:46043
X-Complaints-To	abuse@xs4all.nl
Xref	x330-a1.tempe.blueboxinc.net comp.lang.python:20737

Show key headers only | View raw

Il 23 febbraio 2012 07:58, Plumo <richardbp@gmail.com> ha scritto:
> I want to download content asynchronously. This would be straightforward to do threaded or across processes, but difficult asynchronously so people seem to rely on external libraries (twisted / gevent / eventlet).
>
> (I would use gevent under different circumstances, but currently need to stick to standard libraries.)
>
> I looked around and found there is little interest in developing a proper HTTP client on asyncore. The best I found stopped development a decade ago: http://sourceforge.net/projects/asynchttp/
>
> What do you recommend?
> And why is there poor support for asynchronous execution?
>
> Richard
> --
> http://mail.python.org/mailman/listinfo/python-list

If you want to stick with asyncore try to take a look at this:
https://gist.github.com/1519999

> And why is there poor support for asynchronous execution?

I'd say that's true for stdlib only (asyncore/asynchat).
There are plenty of choices amongst third party modules though.
To say one, I particularly like tornado which is simple and powerful:
http://www.tornadoweb.org/documentation/httpclient.html

--- Giampaolo
http://code.google.com/p/pyftpdlib/
http://code.google.com/p/psutil/
http://code.google.com/p/pysendfile/

Thread

asynchronous downloading Plumo <richardbp@gmail.com> - 2012-02-22 22:58 -0800
  Re: asynchronous downloading Justin Ezequiel <justin.mailinglists@gmail.com> - 2012-02-22 23:25 -0800
  Re: asynchronous downloading Mark Hammond <mhammond@skippinet.com.au> - 2012-02-23 22:20 +1100
  Re: asynchronous downloading Paul Rubin <no.email@nospam.invalid> - 2012-02-23 03:46 -0800
    Re: asynchronous downloading Plumo <richardbp@gmail.com> - 2012-02-23 16:28 -0800
  Re: asynchronous downloading Richard Baron Penman <richardbp@gmail.com> - 2012-02-24 00:50 +1100
  Re: asynchronous downloading Giampaolo Rodolà <g.rodola@gmail.com> - 2012-02-23 18:31 +0100
    Re: asynchronous downloading Plumo <richardbp@gmail.com> - 2012-02-23 17:10 -0800
    Re: asynchronous downloading Plumo <richardbp@gmail.com> - 2012-02-23 17:10 -0800
      Re: asynchronous downloading Fayaz Yusuf Khan <fayaz.yusuf.khan@gmail.com> - 2012-02-23 18:31 -0800
      Re: asynchronous downloading Giampaolo Rodolà <g.rodola@gmail.com> - 2012-02-24 10:03 +0100
      Re: asynchronous downloading Richard Baron Penman <richardbp@gmail.com> - 2012-02-26 08:44 +1100

csiph-web