Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #107982

Re: Fastest way to retrieve and write html contents to file

Path csiph.com!fu-berlin.de!uni-berlin.de!not-for-mail
From Stephen Hansen <me+python@ixokai.io>
Newsgroups comp.lang.python
Subject Re: Fastest way to retrieve and write html contents to file
Date Sun, 01 May 2016 22:17:41 -0700
Lines 16
Message-ID <mailman.304.1462166263.32212.python-list@python.org> (permalink)
References <ng6jie$1ap$1@dont-email.me> <1462163671.1159335.595256017.204863FE@webmail.messagingengine.com> <CAPTjJmqSyaXXbUjUv3wsR1gR72gKumCcm55gOxQyfc37ppLopQ@mail.gmail.com> <mailman.297.1462164034.32212.python-list@python.org> <ng6m4q$743$1@dont-email.me> <1462165232.1164853.595266801.5DB17C45@webmail.messagingengine.com> <mailman.300.1462165235.32212.python-list@python.org> <ng6mu7$97m$1@dont-email.me> <1462166261.1167799.595274273.1190901B@webmail.messagingengine.com>
Mime-Version 1.0
Content-Type text/plain
Content-Transfer-Encoding 7bit
X-Trace news.uni-berlin.de FH5olZvbcx61S9Br3lTHGwRHgcMAASW9bzEPddfvuzHw==
Return-Path <me+python@ixokai.io>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.002
X-Spam-Evidence '*H*': 1.00; '*S*': 0.00; 'that?': 0.05; 'subject:file': 0.07; 'page?': 0.09; 'received:internal': 0.09; 'second.': 0.09; 'file,': 0.15; 'big,': 0.16; 'dfs': 0.16; 'measured': 0.16; 'message-id:@webmail.messagingengine.com': 0.16; 'received:10.202': 0.16; 'received:10.202.2': 0.16; 'received:66.111': 0.16; 'received:66.111.4': 0.16; 'received:io': 0.16; 'received:messagingengine.com': 0.16; 'received:psf.io': 0.16; 'wrote:': 0.16; 'issue.': 0.20; "aren't": 0.22; 'constant': 0.22; 'stephen': 0.22; 'bigger': 0.23; "haven't": 0.24; 'header :In-Reply-To:1': 0.24; 'relational': 0.29; 'testing.': 0.29; 'that.': 0.30; 'so,': 0.35; 'to:addr:python-list': 0.36; 'pm,': 0.36; 'subject:: ': 0.37; 'received:10': 0.37; 'two': 0.37; 'turn': 0.37; 'difference': 0.38; 'received:66': 0.38; 'sure': 0.39; 'to:addr:python.org': 0.40; 'header:Message-Id:1': 0.61; 'soon': 0.65; 'differences': 0.66; 'webpage': 0.66; 'meg': 0.84; 'subject:write': 0.84
DKIM-Signature v=1; a=rsa-sha1; c=relaxed/relaxed; d=ixokai.io; h= content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-sasl-enc :x-sasl-enc; s=mesmtp; bh=I4l/LH53o7VDZXtlXHNTFO2PSYQ=; b=qiKIGV Wn4oVUg+F1xfgUrRltztJh/7n0/LzwbW6sx6rUlBodq8w3H941x8gxIKtBitDx7p 4xBZihS3J6JHoZjKeMhoNBbI8kQVwJV+nncWY2+9j979iFPwOxNX4P74LBTGM25u xdcHR344QCasP13vkkscndDP1b51oFouHNc40=
DKIM-Signature v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-sasl-enc:x-sasl-enc; s=smtpout; bh=I4l/LH53o7VDZXt lXHNTFO2PSYQ=; b=s2Px/Q+jkT/6gASFr1eCruBjElD6/myoEV6MC+b7Apk5gSm qc6llIciiXl035Ftlz7ppyCRT+F9uMw1VhHHLpj8+KTrkkIv+nBrYlkpi/+Uedq8 jHePVs8qpvQElYrWXRREMCaIBDXoaZ/GezjA6zTZXZepdJQwFblDUYR12UY4=
X-Sasl-Enc bZvBDFDdfR7oICpSZ6pZgKUd/GJdv3Puldb9UiJIW3Ql 1462166261
X-Mailer MessagingEngine.com Webmail Interface - ajax-491eb5a4
In-Reply-To <ng6mu7$97m$1@dont-email.me>
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.22
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list/>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
X-Mailman-Original-Message-ID <1462166261.1167799.595274273.1190901B@webmail.messagingengine.com>
X-Mailman-Original-References <ng6jie$1ap$1@dont-email.me> <1462163671.1159335.595256017.204863FE@webmail.messagingengine.com> <CAPTjJmqSyaXXbUjUv3wsR1gR72gKumCcm55gOxQyfc37ppLopQ@mail.gmail.com> <mailman.297.1462164034.32212.python-list@python.org> <ng6m4q$743$1@dont-email.me> <1462165232.1164853.595266801.5DB17C45@webmail.messagingengine.com> <mailman.300.1462165235.32212.python-list@python.org> <ng6mu7$97m$1@dont-email.me>
Xref csiph.com comp.lang.python:107982

Show key headers only | View raw


On Sun, May 1, 2016, at 10:04 PM, DFS wrote:
> And two small numbers turn into bigger numbers when the webpage is big, 
> and soon the download time differences are measured in minutes, not half 
> a second.

Are you sure of that? Have you determined that the time is not a
constant overhead verses that the time is directly relational to the
size of the page? If so, how have you determined that?

You aren't showing how you're testing. 0.4s difference is meaningless to
me, if its a constant overhead. If its twice as slow for a 1 meg file,
then you might have an issue. Maybe. You haven't shown that.

-- 
Stephen Hansen
  m e @ i x o k a i . i o

Back to comp.lang.python | Previous | NextPrevious in thread | Next in thread | Find similar | Unroll thread


Thread

Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 00:06 -0400
  Re: Fastest way to retrieve and write html contents to file Stephen Hansen <me+python@ixokai.io> - 2016-05-01 21:34 -0700
  Re: Fastest way to retrieve and write html contents to file Chris Angelico <rosuav@gmail.com> - 2016-05-02 14:40 +1000
    Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 00:50 -0400
      Re: Fastest way to retrieve and write html contents to file Stephen Hansen <me+python@ixokai.io> - 2016-05-01 22:00 -0700
        Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 01:04 -0400
          Re: Fastest way to retrieve and write html contents to file Chris Angelico <rosuav@gmail.com> - 2016-05-02 15:12 +1000
          Re: Fastest way to retrieve and write html contents to file Stephen Hansen <me+python@ixokai.io> - 2016-05-01 22:17 -0700
          Re: Fastest way to retrieve and write html contents to file Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2016-05-02 15:57 +1000
  Re: Fastest way to retrieve and write html contents to file Ben Finney <ben+python@benfinney.id.au> - 2016-05-02 14:49 +1000
    Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 01:00 -0400
      Re: Fastest way to retrieve and write html contents to file Stephen Hansen <me+python@ixokai.io> - 2016-05-01 22:15 -0700
        Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 01:59 -0400
          Re: Fastest way to retrieve and write html contents to file Stephen Hansen <me+python@ixokai.io> - 2016-05-01 23:27 -0700
            Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 03:37 -0400
              Re: Fastest way to retrieve and write html contents to file Stephen Hansen <me+python@ixokai.io> - 2016-05-02 00:58 -0700
              Re: Fastest way to retrieve and write html contents to file Michael Torrie <torriem@gmail.com> - 2016-05-02 22:06 -0600
                Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-03 00:24 -0400
                Re: Fastest way to retrieve and write html contents to file Tim Chase <python.list@tim.thechases.com> - 2016-05-03 10:28 -0500
                Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-03 13:00 -0400
                Re: Fastest way to retrieve and write html contents to file Tim Chase <python.list@tim.thechases.com> - 2016-05-03 13:41 -0500
                Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-04 02:10 -0400
      Re: Fastest way to retrieve and write html contents to file Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2016-05-02 16:05 +1000
        Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 02:47 -0400
          Re: Fastest way to retrieve and write html contents to file Chris Angelico <rosuav@gmail.com> - 2016-05-02 17:19 +1000
            Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 21:51 -0400
              Re: Fastest way to retrieve and write html contents to file Chris Angelico <rosuav@gmail.com> - 2016-05-03 12:00 +1000
                Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 22:01 -0400
          Re: Fastest way to retrieve and write html contents to file Peter Otten <__peter__@web.de> - 2016-05-02 10:42 +0200
            Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 21:52 -0400
  Re: Fastest way to retrieve and write html contents to file Chris Angelico <rosuav@gmail.com> - 2016-05-02 14:53 +1000
  Re: Fastest way to retrieve and write html contents to file Tim Chase <python.list@tim.thechases.com> - 2016-05-02 07:38 -0500

csiph-web