Path: csiph.com!fu-berlin.de!uni-berlin.de!not-for-mail
From: Michael Torrie <torriem@gmail.com>
Newsgroups: comp.lang.python
Subject: Re: Fastest way to retrieve and write html contents to file
Date: Mon, 2 May 2016 22:06:48 -0600
Lines: 15
Message-ID: <mailman.335.1462248430.32212.python-list@python.org>
References: <ng6jie$1ap$1@dont-email.me> <85vb2xgj2i.fsf@benfinney.id.au> <mailman.298.1462164614.32212.python-list@python.org> <ng6mn7$8nv$1@dont-email.me> <1462166136.1167243.595273897.291B0865@webmail.messagingengine.com> <mailman.303.1462166138.32212.python-list@python.org> <ng6q67$gnm$1@dont-email.me> <1462170452.1180117.595306673.68B64F02@webmail.messagingengine.com> <mailman.308.1462170455.32212.python-list@python.org> <ng6vsl$1jc$1@dont-email.me> <572823D8.6050204@gmail.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: 7bit
X-Trace: news.uni-berlin.de B9I2uFNo1n8refN9OJ0lDwZ9Sc7ZqbJLVJa34OwXsmjw==
Return-Path: <torriem+gmail@torriefamily.org>
X-Original-To: python-list@python.org
Delivered-To: python-list@mail.python.org
X-Spam-Status: OK 0.024
X-Spam-Evidence: '*H*': 0.95; '*S*': 0.00; 'matches': 0.07; 'subject:file': 0.07; 'runtime': 0.09; 'python': 0.10; 'file,': 0.15; 'languages,': 0.15; 'dfs': 0.16; 'from:addr:torriem': 0.16; 'from:name:michael torrie': 0.16; 'meaningful,': 0.16; 'operation.': 0.16; 'received:io': 0.16; 'received:psf.io': 0.16; 'wrote:': 0.16; 'example.': 0.18; 'file.': 0.22; 'trying': 0.22; 'am,': 0.23; 'examples': 0.24; 'header:In-Reply-To:1': 0.24; 'header:User-Agent:1': 0.26; 'connection': 0.30; 'compiled': 0.32; 'run': 0.33; 'downloading': 0.33; 'message-id:@gmail.com': 0.34; 'languages': 0.34; 'something': 0.35; 'should': 0.36; 'there': 0.36; 'faster': 0.36; 'to:addr:python-list': 0.36; 'subject:: ': 0.37; 'received:org': 0.37; 'data': 0.39; 'enough': 0.39; 'received:192': 0.39; 'to:addr:python.org': 0.40; 'your': 0.60; "you'll": 0.61; 'charset:windows-1252': 0.62; 'other.': 0.64; 'internet': 0.70; 'building,': 0.72; 'beats': 0.84; 'benchmark': 0.84; 'subject:write': 0.84; 'average.': 0.91
X-Virus-Scanned: amavisd-new at torriefamily.org
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.7.2
In-Reply-To: <ng6vsl$1jc$1@dont-email.me>
X-BeenThere: python-list@python.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe: <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive: <http://mail.python.org/pipermail/python-list/>
List-Post: <mailto:python-list@python.org>
List-Help: <mailto:python-list-request@python.org?subject=help>
List-Subscribe: <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
X-Mailman-Original-Message-ID: <572823D8.6050204@gmail.com>
X-Mailman-Original-References: <ng6jie$1ap$1@dont-email.me> <85vb2xgj2i.fsf@benfinney.id.au> <mailman.298.1462164614.32212.python-list@python.org> <ng6mn7$8nv$1@dont-email.me> <1462166136.1167243.595273897.291B0865@webmail.messagingengine.com> <mailman.303.1462166138.32212.python-list@python.org> <ng6q67$gnm$1@dont-email.me> <1462170452.1180117.595306673.68B64F02@webmail.messagingengine.com> <mailman.308.1462170455.32212.python-list@python.org> <ng6vsl$1jc$1@dont-email.me>
Xref: csiph.com comp.lang.python:108047

On 05/02/2016 01:37 AM, DFS wrote:
> So python matches or beats VBScript at this much larger file.  Kewl.

If you download something large enough to be meaningful, you'll find the
runtime speeds should all converge to something showing your internet
connection speed.  Try downloading a 4 GB file, for example.  You're
trying to benchmark an io-bound operation.  After you move past the very
small and meaningless examples that simply benchmark the overhead of the
connection building, you'll find that all languages, even compiled
languages like C, should run at the same speed on average.  Neither VBS
nor Python will be faster than each other.

Now if you want to talk about processing the data once you have it,
there we can talk about speeds and optimization.