Path: csiph.com!fu-berlin.de!uni-berlin.de!not-for-mail
From: Stephen Hansen <me+python@ixokai.io>
Newsgroups: comp.lang.python
Subject: Re: Fastest way to retrieve and write html contents to file
Date: Sun, 01 May 2016 22:17:41 -0700
Lines: 16
Message-ID: <mailman.304.1462166263.32212.python-list@python.org>
References: <ng6jie$1ap$1@dont-email.me> <1462163671.1159335.595256017.204863FE@webmail.messagingengine.com> <CAPTjJmqSyaXXbUjUv3wsR1gR72gKumCcm55gOxQyfc37ppLopQ@mail.gmail.com> <mailman.297.1462164034.32212.python-list@python.org> <ng6m4q$743$1@dont-email.me> <1462165232.1164853.595266801.5DB17C45@webmail.messagingengine.com> <mailman.300.1462165235.32212.python-list@python.org> <ng6mu7$97m$1@dont-email.me> <1462166261.1167799.595274273.1190901B@webmail.messagingengine.com>
Mime-Version: 1.0
Content-Type: text/plain
Content-Transfer-Encoding: 7bit
X-Trace: news.uni-berlin.de FH5olZvbcx61S9Br3lTHGwRHgcMAASW9bzEPddfvuzHw==
Return-Path: <me+python@ixokai.io>
X-Original-To: python-list@python.org
Delivered-To: python-list@mail.python.org
X-Spam-Status: OK 0.002
X-Spam-Evidence: '*H*': 1.00; '*S*': 0.00; 'that?': 0.05; 'subject:file': 0.07; 'page?': 0.09; 'received:internal': 0.09; 'second.': 0.09; 'file,': 0.15; 'big,': 0.16; 'dfs': 0.16; 'measured': 0.16; 'message-id:@webmail.messagingengine.com': 0.16; 'received:10.202': 0.16; 'received:10.202.2': 0.16; 'received:66.111': 0.16; 'received:66.111.4': 0.16; 'received:io': 0.16; 'received:messagingengine.com': 0.16; 'received:psf.io': 0.16; 'wrote:': 0.16; 'issue.': 0.20; "aren't": 0.22; 'constant': 0.22; 'stephen': 0.22; 'bigger': 0.23; "haven't": 0.24; 'header :In-Reply-To:1': 0.24; 'relational': 0.29; 'testing.': 0.29; 'that.': 0.30; 'so,': 0.35; 'to:addr:python-list': 0.36; 'pm,': 0.36; 'subject:: ': 0.37; 'received:10': 0.37; 'two': 0.37; 'turn': 0.37; 'difference': 0.38; 'received:66': 0.38; 'sure': 0.39; 'to:addr:python.org': 0.40; 'header:Message-Id:1': 0.61; 'soon': 0.65; 'differences': 0.66; 'webpage': 0.66; 'meg': 0.84; 'subject:write': 0.84
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=ixokai.io; h= content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-sasl-enc :x-sasl-enc; s=mesmtp; bh=I4l/LH53o7VDZXtlXHNTFO2PSYQ=; b=qiKIGV Wn4oVUg+F1xfgUrRltztJh/7n0/LzwbW6sx6rUlBodq8w3H941x8gxIKtBitDx7p 4xBZihS3J6JHoZjKeMhoNBbI8kQVwJV+nncWY2+9j979iFPwOxNX4P74LBTGM25u xdcHR344QCasP13vkkscndDP1b51oFouHNc40=
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-sasl-enc:x-sasl-enc; s=smtpout; bh=I4l/LH53o7VDZXt lXHNTFO2PSYQ=; b=s2Px/Q+jkT/6gASFr1eCruBjElD6/myoEV6MC+b7Apk5gSm qc6llIciiXl035Ftlz7ppyCRT+F9uMw1VhHHLpj8+KTrkkIv+nBrYlkpi/+Uedq8 jHePVs8qpvQElYrWXRREMCaIBDXoaZ/GezjA6zTZXZepdJQwFblDUYR12UY4=
X-Sasl-Enc: bZvBDFDdfR7oICpSZ6pZgKUd/GJdv3Puldb9UiJIW3Ql 1462166261
X-Mailer: MessagingEngine.com Webmail Interface - ajax-491eb5a4
In-Reply-To: <ng6mu7$97m$1@dont-email.me>
X-BeenThere: python-list@python.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe: <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive: <http://mail.python.org/pipermail/python-list/>
List-Post: <mailto:python-list@python.org>
List-Help: <mailto:python-list-request@python.org?subject=help>
List-Subscribe: <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
X-Mailman-Original-Message-ID: <1462166261.1167799.595274273.1190901B@webmail.messagingengine.com>
X-Mailman-Original-References: <ng6jie$1ap$1@dont-email.me> <1462163671.1159335.595256017.204863FE@webmail.messagingengine.com> <CAPTjJmqSyaXXbUjUv3wsR1gR72gKumCcm55gOxQyfc37ppLopQ@mail.gmail.com> <mailman.297.1462164034.32212.python-list@python.org> <ng6m4q$743$1@dont-email.me> <1462165232.1164853.595266801.5DB17C45@webmail.messagingengine.com> <mailman.300.1462165235.32212.python-list@python.org> <ng6mu7$97m$1@dont-email.me>
Xref: csiph.com comp.lang.python:107982

On Sun, May 1, 2016, at 10:04 PM, DFS wrote:
> And two small numbers turn into bigger numbers when the webpage is big, 
> and soon the download time differences are measured in minutes, not half 
> a second.

Are you sure of that? Have you determined that the time is not a
constant overhead verses that the time is directly relational to the
size of the page? If so, how have you determined that?

You aren't showing how you're testing. 0.4s difference is meaningless to
me, if its a constant overhead. If its twice as slow for a 1 meg file,
then you might have an issue. Maybe. You haven't shown that.

-- 
Stephen Hansen
  m e @ i x o k a i . i o