Path: csiph.com!x330-a1.tempe.blueboxinc.net!usenet.pasdenom.info!gegeweb.org!de-l.enfer-du-nord.net!feeder1.enfer-du-nord.net!feeder.news-service.com!newsfeed.xs4all.nl!newsfeed5.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; b=KrycY0l1ZK7czfZtadsMW3fYh476KGPszVW7MeOrfjoGOq+fwA5U3CsLKP0vmVfx6X kqo83Ss9KIYlx78BCquh9wuT0ExoI0zZ14KAmFs7cmW1+FwD9CHtGmvvWPTYRF1WPwa7 extbcL3Jmjcfqj01v5e4BDzY7umLepJlwNiRw=
Date: Wed, 15 Jun 2011 22:28:22 -0400
From: Emanuel dos Reis Rodrigues <emanueldosreis@gmail.com>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.1.16) Gecko/20110307 Icedove/3.0.11
MIME-Version: 1.0
To: Python <python-list@python.org>
Subject: pycurl and MAX_RECV_SPEED_LARGE
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Precedence: list
Newsgroups: comp.lang.python
Message-ID: <mailman.11.1308190969.1164.python-list@python.org>
Lines: 83
NNTP-Posting-Host: 82.94.164.166
Xref: x330-a1.tempe.blueboxinc.net comp.lang.python:7722

Hello Folks,


I have a problem with pycurl. I need to do a download with a lower rate, 
+ or - 1 Kb / 128bytes.

I use the  MAX_RECV_SPEED_LARGE setting with 128 as value.

My problem is:  The download take a long time to be finished.

File:  test.jpg 92 KB, with 128 rate,  take 2.38 Minutes.

The strange behavior is that:   The connection keep ESTABLISHED only 1/5 
from all time ( 2.38 minutes )


Analyzing with wireshark, I see that: After pass 1/5 of all time, do not 
change packages anymore until reach 2.38 minutes, and client send a RST ACK.

Have a high delay between the transfer and the finished connection.


I need to solution that I can download with a lower rate, include using 
Multi-Threading with many simultaneous downloads.



Follow my test code:


import pycurl
import random
import os



def download1(t_url):
         headers = [
                    'Accept: 
text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8',
                    'Accept-Language: en-us,pt-br;q=0.8,pt;q=0.5,en;q=0.3',
                    'Accept-Encoding: gzip,deflate',
                    'Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7',
                    'Cache-control: no-cache',
                    'Pragma: no-cache',
                    'Connection: Keep-Alive',
                    'Keep-Alive: 300']

         c = pycurl.Curl()
         f = "/tmp/teste.tmp"
         c.setopt(c.URL, t_url)
        c.setopt(c.FAILONERROR, 1)
#       c.setopt(c.VERBOSE, 1)
         c.setopt(c.MAX_RECV_SPEED_LARGE, 128)
#        c.setopt(c.TIMEOUT, timeout)
         c.setopt(c.NOSIGNAL, 1)
         c.setopt(pycurl.HTTPHEADER, headers)
         c.setopt(c.CONNECTTIMEOUT,10)
         c.setopt(c.WRITEDATA, file(f,"w"))
         c.setopt(c.USERAGENT,"XADASSDASDASD")
         try:
                 c.perform()
         except pycurl.error:
                 print "Connection Problem"
                 c.close()
                 return 2
         else:
                 print "Download Complete"
                 print f
                 c.close()
                 return 0

download1("http://192.168.111.128/teste.jpg")


Thank You.

Emanuel