Path: csiph.com!fu-berlin.de!uni-berlin.de!not-for-mail From: Tim Chase Newsgroups: comp.lang.python Subject: Re: Fastest way to retrieve and write html contents to file Date: Mon, 2 May 2016 07:38:21 -0500 Lines: 18 Message-ID: References: <20160502073821.4fe1a305@bigbox.christie.dr> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Trace: news.uni-berlin.de H7rB/6vbPKCNKHhTqy0MeQf60Rbdq8PzAguXQnemt5BA== Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.005 X-Spam-Evidence: '*H*': 0.99; '*S*': 0.00; 'subject:file': 0.07; 'compression': 0.09; 'threads,': 0.09; 'python.': 0.11; 'headers': 0.15; '-tkc': 0.16; 'dfs': 0.16; 'from:addr:python.list': 0.16; 'from:addr:tim.thechases.com': 0.16; 'from:name:tim chase': 0.16; 'loops': 0.16; 'received:io': 0.16; 'received:psf.io': 0.16; 'wrote:': 0.16; 'debugging': 0.18; 'try:': 0.18; 'header:In-Reply- To:1': 0.24; 'compare': 0.27; 'stands': 0.33; 'to:addr:python- list': 0.36; 'subject:: ': 0.37; 'received:10': 0.37; 'charset:us- ascii': 0.37; 'things': 0.38; 'anything': 0.38; 'to:addr:python.org': 0.40; 'received:23': 0.84; 'sibling': 0.84; 'subject:write': 0.84 X-Sender-Id: wwwh|x-authuser|tim@thechases.com X-Sender-Id: wwwh|x-authuser|tim@thechases.com X-MC-Relay: Neutral X-MailChannels-SenderId: wwwh|x-authuser|tim@thechases.com X-MailChannels-Auth-Id: wwwh X-MC-Loop-Signature: 1462192926478:814966313 X-MC-Ingress-Time: 1462192926477 In-Reply-To: X-Mailer: Claws Mail 3.11.1 (GTK+ 2.24.25; x86_64-pc-linux-gnu) X-AuthUser: tim@thechases.com X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-Mailman-Original-Message-ID: <20160502073821.4fe1a305@bigbox.christie.dr> X-Mailman-Original-References: Xref: csiph.com comp.lang.python:108006 On 2016-05-02 00:06, DFS wrote: > Then I tested them in loops - the VBScript is MUCH faster: 0.44 for > 10 iterations, vs 0.88 for python. In addition to the other debugging recommendations in sibling threads, a couple other things to try: 1) use a local debugging proxy so that you can compare the headers to see if anything stands out 2) in light of #1, can you confirm/deny whether one is using gzip compression and the other isn't? -tkc