Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #51698

RE: pcurl and network connection's problem

Path csiph.com!usenet.pasdenom.info!news.albasani.net!newsreader4.netcologne.de!news.netcologne.de!xlned.com!feeder5.xlned.com!newsfeed.xs4all.nl!newsfeed4.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path <ramit.prasad@jpmorgan.com>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.001
X-Spam-Evidence '*H*': 1.00; '*S*': 0.00; '(especially': 0.07; 'completeness': 0.07; 'see:': 0.07; 'anticipate': 0.09; 'received:155': 0.09; 'python': 0.11; 'abort': 0.16; 'aborted': 0.16; 'disclaimers': 0.16; 'disclaimers,': 0.16; 'downloaded.': 0.16; 'from:addr:jpmorgan.com': 0.16; 'received:155.180': 0.16; 'received:155.180.234': 0.16; 'received:159': 0.16; 'received:159.53': 0.16; 'received:159.53.110': 0.16; 'received:159.53.110.174': 0.16; 'received:169.70': 0.16; 'received:169.70.184': 0.16; 'received:bankone.net': 0.16; 'received:exchad.jpmchase.net': 0.16; 'received:jpmchase.com': 0.16; 'received:jpmchase.net': 0.16; 'received:sj2.jpmchase.com': 0.16; 'received:svr.bankone.net': 0.16; 'securities,': 0.16; 'status)': 0.16; 'timeout': 0.16; 'url:disclosures': 0.16; 'url:jpmorgan': 0.16; 'wrote:': 0.18; 'minutes.': 0.22; 'to:name :python-list@python.org': 0.22; 'affects': 0.24; 'skip:l 30': 0.24; 'subject:problem': 0.24; 'header:Received:8': 0.24; 'downloaded': 0.26; 'header:In-Reply-To:1': 0.27; 'to:2**1': 0.27; 'received:169.254': 0.32; 'option': 0.32; 'run': 0.32; 'problem': 0.35; "can't": 0.35; 'connection': 0.35; 'created': 0.35; 'something': 0.35; 'but': 0.35; 'accuracy': 0.36; 'set.': 0.36; 'doing': 0.36; 'charset:us-ascii': 0.36; 'should': 0.36; 'received:169': 0.37; 'being': 0.38; 'minimum': 0.38; 'problems': 0.38; 'to:addr:python-list': 0.38; 'does': 0.39; 'to:addr:python.org': 0.39; 'how': 0.40; 'solve': 0.60; 'information,': 0.61; 'times': 0.62; 'purchase': 0.65; 'to:addr:gmail.com': 0.65; '2-3': 0.68; 'subject': 0.69; 'legal': 0.71; 'sale': 0.75; 'transfer': 0.82; 'download?': 0.84; 'received:169.254.8': 0.84
X-DKIM OpenDKIM Filter v2.1.3 sj2.jpmchase.com r6VJX7B8026475
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=jpmorgan.com; s=smtpout; t=1375299187; bh=J9ls5Sqsj8fEAF06+eT9u+KZqrFXa6ZW3h0+o5ZCJo0=; h=From:To:Subject:Date:Message-ID:References:In-Reply-To: Content-Type:content-transfer-encoding:MIME-Version; b=KQwck5ZSvVO9e73WBU+J7ZSWaCPNhFcxZEegH5kPADuiGCeFdNfBdPX4thfpYshYq vAZ15VkxERXR9GqMTVzPNaJm9tPD0MXr5qrHFdZMrg2XBBMuoU4nfQJOqoJOt72UFr v29nQJwLJEbDcmGVGgbcTx6dE09wjUtBSAr4tVb0=
X-AuditID a959dca9-b7f588e000002568-9b-51f9667146e4
From "Prasad, Ramit" <ramit.prasad@jpmorgan.com.dmarc.invalid>
To sam319 <samaneh.yahyapour@gmail.com>, "python-list@python.org" <python-list@python.org>
Subject RE: pcurl and network connection's problem
Thread-Topic pcurl and network connection's problem
Thread-Index AQHOjiJMdWX2/YaYcUSacZ9jaA2oUpl/KTUQ
Date Wed, 31 Jul 2013 19:32:46 +0000
References <2271ec9a-ec36-485b-9776-3c7157cedae1@googlegroups.com>
In-Reply-To <2271ec9a-ec36-485b-9776-3c7157cedae1@googlegroups.com>
Accept-Language en-US
Content-Language en-US
X-MS-Has-Attach
X-MS-TNEF-Correlator
x-originating-ip [10.67.79.47]
Content-Type text/plain; charset="us-ascii"
content-transfer-encoding quoted-printable
MIME-Version 1.0
X-DLP-FWD Yes
X-Brightmail-Tracker H4sIAAAAAAAAA+NgFmpjk+LIzCtJLcpLzFFi42JZGSgRrFuY9jPQ4M42Q4sjrddYLZb//svi wOSxc9Zddo8X89+wBTBFNTDaJObl5ZcklqQqpKQWJ9squWQWJ+ckZuamFinoKngV5OYXpSfm 6SXn5yopZKbYKpkoKRTkJCan5qbmldgqJRYUpOalKNlxKWAAG6CyzDyF1Lzk/JTMvHRbJc9g f10LC1NLXUMlu5CMzGKF1NzEzByFhI3sGWd+HGIp2MpZceThNsYGxuPsXYycHBICJhIfT+xg g7DFJC7cWw9kc3EICRxmlJh35RaUc5BRYn5/OxOcs/rJdWaQFiGBTYwSC1b7g9hsAoYSx88+ ARsrIhArsf/KRjBbWMBY4tuj30A2B1DcROLrxVKIEiOJn1PbGUFsFgFViVd/ToCN5BUIkTi8 bjErxHhniTvNU8HGcAq4SFybsgrMZgS69PupNUwgNrOAuMStJ/OZID4QkFiy5zwzhC0q8fLx P1YIW17ixZSXbBD1OhILdn+CsrUlli18DbVXUOLkzCcsIGcKCahJ7FtvC2JKCPBJbG+rnsAo OQvJsllIBs1CMmgWkkELGFlWMUoW56ZnmeoVlxXplRbrZRXkJmckFqfq5aWWbGIEJZ/IOyt3 MP5rtD3EKMDBqMTD++HK90Ah1sSy4srcQ4wSHMxKIrzsQUcChXhTEiurUovy44tKc1KLDzFW AcNsIrOUaHI+MDHmlcQbGptZGJiaGhpYGBqZUEVYSZzXbe2zQCGBdGCqzU5NLUgtglnOxMEp 1cBof3zNs9mLz3/t+t4YvtlhgWLKNL9JM3t+7jXjOJN67cNGboYzix6u1mtbX1y2dDO3jbLD 2i0qLnf9zytf3827wm/1pxn30nuW7PqU63jVZuNdI2uNX+w/OJb9q474nX/ZxjvGMa/2ec3O aDF5kS9pcxRXL9s4KzrudDDDK/a5STG/Ld9Jrnk+V4mlOCPRUIu5qDgRANTFf5+ZAwAA
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.15
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list/>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups comp.lang.python
Message-ID <mailman.53.1375299192.1251.python-list@python.org> (permalink)
Lines 40
NNTP-Posting-Host 2001:888:2000:d::a6
X-Trace 1375299192 news.xs4all.nl 15979 [2001:888:2000:d::a6]:41052
X-Complaints-To abuse@xs4all.nl
Xref csiph.com comp.lang.python:51698

Show key headers only | View raw


sam319 wrote:
> I am having problems with pycurl in my threads , when i run it , it does correctly but some times the
> connection has been established but nothing will be downloaded and the threads stay alive without
> doing any thing (especially when the network's speed is slow and has aborted status) .
> 
> i can't use TIMEOUT  because i don't have the max time for downloading
> 
> how can i solve this problem in python

So you want to wait hours/days/years for a failed download? You should always set a 
timeout that is sane. If you anticipate network slowness, then set your timeout to 
something larger like 2-3 minutes. IIRC, the timeout only affects connection
establishment so that will not help out your use case but I want to emphasize
that you always want a timeout to be set. 

Pycurl has an option for LOW_SPEED_LIMIT/LOW_SPEED_TIME which should allow you to set 
a minimum transfer speed which will abort the transfer. This should solve your problem
where the connection is created but nothing is being downloaded.

See: http://stackoverflow.com/questions/4960021/handle-pycurl-hang-on-twitter-streaming-api


Ramit



This email is confidential and subject to important disclaimers and conditions including on offers for the purchase or sale of securities, accuracy and completeness of information, viruses, confidentiality, legal privilege, and legal entity disclaimers, available at http://www.jpmorgan.com/pages/disclosures/email.  

Back to comp.lang.python | Previous | NextPrevious in thread | Find similar | Unroll thread


Thread

pcurl and network connection's problem sam319 <samaneh.yahyapour@gmail.com> - 2013-07-31 12:12 -0700
  RE: pcurl and network connection's problem "Prasad, Ramit" <ramit.prasad@jpmorgan.com.dmarc.invalid> - 2013-07-31 19:32 +0000

csiph-web