Path: csiph.com!usenet.pasdenom.info!news.albasani.net!newsreader4.netcologne.de!news.netcologne.de!xlned.com!feeder5.xlned.com!newsfeed.xs4all.nl!newsfeed4.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.001 X-Spam-Evidence: '*H*': 1.00; '*S*': 0.00; '(especially': 0.07; 'completeness': 0.07; 'see:': 0.07; 'anticipate': 0.09; 'received:155': 0.09; 'python': 0.11; 'abort': 0.16; 'aborted': 0.16; 'disclaimers': 0.16; 'disclaimers,': 0.16; 'downloaded.': 0.16; 'from:addr:jpmorgan.com': 0.16; 'received:155.180': 0.16; 'received:155.180.234': 0.16; 'received:159': 0.16; 'received:159.53': 0.16; 'received:159.53.110': 0.16; 'received:159.53.110.174': 0.16; 'received:169.70': 0.16; 'received:169.70.184': 0.16; 'received:bankone.net': 0.16; 'received:exchad.jpmchase.net': 0.16; 'received:jpmchase.com': 0.16; 'received:jpmchase.net': 0.16; 'received:sj2.jpmchase.com': 0.16; 'received:svr.bankone.net': 0.16; 'securities,': 0.16; 'status)': 0.16; 'timeout': 0.16; 'url:disclosures': 0.16; 'url:jpmorgan': 0.16; 'wrote:': 0.18; 'minutes.': 0.22; 'to:name :python-list@python.org': 0.22; 'affects': 0.24; 'skip:l 30': 0.24; 'subject:problem': 0.24; 'header:Received:8': 0.24; 'downloaded': 0.26; 'header:In-Reply-To:1': 0.27; 'to:2**1': 0.27; 'received:169.254': 0.32; 'option': 0.32; 'run': 0.32; 'problem': 0.35; "can't": 0.35; 'connection': 0.35; 'created': 0.35; 'something': 0.35; 'but': 0.35; 'accuracy': 0.36; 'set.': 0.36; 'doing': 0.36; 'charset:us-ascii': 0.36; 'should': 0.36; 'received:169': 0.37; 'being': 0.38; 'minimum': 0.38; 'problems': 0.38; 'to:addr:python-list': 0.38; 'does': 0.39; 'to:addr:python.org': 0.39; 'how': 0.40; 'solve': 0.60; 'information,': 0.61; 'times': 0.62; 'purchase': 0.65; 'to:addr:gmail.com': 0.65; '2-3': 0.68; 'subject': 0.69; 'legal': 0.71; 'sale': 0.75; 'transfer': 0.82; 'download?': 0.84; 'received:169.254.8': 0.84 X-DKIM: OpenDKIM Filter v2.1.3 sj2.jpmchase.com r6VJX7B8026475 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jpmorgan.com; s=smtpout; t=1375299187; bh=J9ls5Sqsj8fEAF06+eT9u+KZqrFXa6ZW3h0+o5ZCJo0=; h=From:To:Subject:Date:Message-ID:References:In-Reply-To: Content-Type:content-transfer-encoding:MIME-Version; b=KQwck5ZSvVO9e73WBU+J7ZSWaCPNhFcxZEegH5kPADuiGCeFdNfBdPX4thfpYshYq vAZ15VkxERXR9GqMTVzPNaJm9tPD0MXr5qrHFdZMrg2XBBMuoU4nfQJOqoJOt72UFr v29nQJwLJEbDcmGVGgbcTx6dE09wjUtBSAr4tVb0= X-AuditID: a959dca9-b7f588e000002568-9b-51f9667146e4 From: "Prasad, Ramit" To: sam319 , "python-list@python.org" Subject: RE: pcurl and network connection's problem Thread-Topic: pcurl and network connection's problem Thread-Index: AQHOjiJMdWX2/YaYcUSacZ9jaA2oUpl/KTUQ Date: Wed, 31 Jul 2013 19:32:46 +0000 References: <2271ec9a-ec36-485b-9776-3c7157cedae1@googlegroups.com> In-Reply-To: <2271ec9a-ec36-485b-9776-3c7157cedae1@googlegroups.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.67.79.47] Content-Type: text/plain; charset="us-ascii" content-transfer-encoding: quoted-printable MIME-Version: 1.0 X-DLP-FWD: Yes X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFmpjk+LIzCtJLcpLzFFi42JZGSgRrFuY9jPQ4M42Q4sjrddYLZb//svi wOSxc9Zddo8X89+wBTBFNTDaJObl5ZcklqQqpKQWJ9squWQWJ+ckZuamFinoKngV5OYXpSfm 6SXn5yopZKbYKpkoKRTkJCan5qbmldgqJRYUpOalKNlxKWAAG6CyzDyF1Lzk/JTMvHRbJc9g f10LC1NLXUMlu5CMzGKF1NzEzByFhI3sGWd+HGIp2MpZceThNsYGxuPsXYycHBICJhIfT+xg g7DFJC7cWw9kc3EICRxmlJh35RaUc5BRYn5/OxOcs/rJdWaQFiGBTYwSC1b7g9hsAoYSx88+ ARsrIhArsf/KRjBbWMBY4tuj30A2B1DcROLrxVKIEiOJn1PbGUFsFgFViVd/ToCN5BUIkTi8 bjErxHhniTvNU8HGcAq4SFybsgrMZgS69PupNUwgNrOAuMStJ/OZID4QkFiy5zwzhC0q8fLx P1YIW17ixZSXbBD1OhILdn+CsrUlli18DbVXUOLkzCcsIGcKCahJ7FtvC2JKCPBJbG+rnsAo OQvJsllIBs1CMmgWkkELGFlWMUoW56ZnmeoVlxXplRbrZRXkJmckFqfq5aWWbGIEJZ/IOyt3 MP5rtD3EKMDBqMTD++HK90Ah1sSy4srcQ4wSHMxKIrzsQUcChXhTEiurUovy44tKc1KLDzFW AcNsIrOUaHI+MDHmlcQbGptZGJiaGhpYGBqZUEVYSZzXbe2zQCGBdGCqzU5NLUgtglnOxMEp 1cBof3zNs9mLz3/t+t4YvtlhgWLKNL9JM3t+7jXjOJN67cNGboYzix6u1mtbX1y2dDO3jbLD 2i0qLnf9zytf3827wm/1pxn30nuW7PqU63jVZuNdI2uNX+w/OJb9q474nX/ZxjvGMa/2ec3O aDF5kS9pcxRXL9s4KzrudDDDK/a5STG/Ld9Jrnk+V4mlOCPRUIu5qDgRANTFf5+ZAwAA X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Newsgroups: comp.lang.python Message-ID: Lines: 40 NNTP-Posting-Host: 2001:888:2000:d::a6 X-Trace: 1375299192 news.xs4all.nl 15979 [2001:888:2000:d::a6]:41052 X-Complaints-To: abuse@xs4all.nl Xref: csiph.com comp.lang.python:51698 sam319 wrote: > I am having problems with pycurl in my threads , when i run it , it does c= orrectly but some times the > connection has been established but nothing will be downloaded and the thr= eads stay alive without > doing any thing (especially when the network's speed is slow and has abort= ed status) . > > i can't use TIMEOUT because i don't have the max time for downloading > > how can i solve this problem in python So you want to wait hours/days/years for a failed download? You should alway= s set a timeout that is sane. If you anticipate network slowness, then set your time= out to something larger like 2-3 minutes. IIRC, the timeout only affects connection establishment so that will not help out your use case but I want to emphasiz= e that you always want a timeout to be set. Pycurl has an option for LOW_SPEED_LIMIT/LOW_SPEED_TIME which should allow y= ou to set a minimum transfer speed which will abort the transfer. This should solve yo= ur problem where the connection is created but nothing is being downloaded. See: http://stackoverflow.com/questions/4960021/handle-pycurl-hang-on-twitte= r-streaming-api Ramit This email is confidential and subject to important disclaimers and conditio= ns including on offers for the purchase or sale of securities, accuracy and= completeness of information, viruses, confidentiality, legal privilege, and= legal entity disclaimers, available at http://www.jpmorgan.com/pages/disclo= sures/email.