Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #107980

Re: Fastest way to retrieve and write html contents to file

Path csiph.com!fu-berlin.de!uni-berlin.de!not-for-mail
From Chris Angelico <rosuav@gmail.com>
Newsgroups comp.lang.python
Subject Re: Fastest way to retrieve and write html contents to file
Date Mon, 2 May 2016 15:12:22 +1000
Lines 15
Message-ID <mailman.302.1462165945.32212.python-list@python.org> (permalink)
References <ng6jie$1ap$1@dont-email.me> <1462163671.1159335.595256017.204863FE@webmail.messagingengine.com> <CAPTjJmqSyaXXbUjUv3wsR1gR72gKumCcm55gOxQyfc37ppLopQ@mail.gmail.com> <mailman.297.1462164034.32212.python-list@python.org> <ng6m4q$743$1@dont-email.me> <1462165232.1164853.595266801.5DB17C45@webmail.messagingengine.com> <mailman.300.1462165235.32212.python-list@python.org> <ng6mu7$97m$1@dont-email.me> <CAPTjJmqZ2OY0nUJ-jBiWRrmQhBKWj+2+Y3EsJRDGgNubH-3X8w@mail.gmail.com>
Mime-Version 1.0
Content-Type text/plain; charset=UTF-8
X-Trace news.uni-berlin.de tirE2kO+utV2B7OJZkxZXQlCzCpBVTxT6XFfM1iWRO2w==
Return-Path <rosuav@gmail.com>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.020
X-Spam-Evidence '*H*': 0.96; '*S*': 0.00; 'received:209.85.223': 0.03; 'subject:file': 0.07; 'cc:addr:python-list': 0.09; 'second.': 0.09; '2016': 0.16; 'big,': 0.16; 'dfs': 0.16; 'from:addr:rosuav': 0.16; 'from:name:chris angelico': 0.16; 'measured': 0.16; 'received:io': 0.16; 'received:psf.io': 0.16; 'wrote:': 0.16; 'cc:2**0': 0.20; 'cc:addr:python.org': 0.20; 'bigger': 0.23; 'second': 0.24; 'header:In-Reply-To:1': 0.24; 'mon,': 0.24; 'pages,': 0.27; 'message-id:@mail.gmail.com': 0.27; 'measure': 0.29; 'received:google.com': 0.35; 'so,': 0.35; 'received:209.85': 0.36; 'pm,': 0.36; 'subject:: ': 0.37; 'really': 0.37; 'two': 0.37; 'turn': 0.37; 'difference': 0.38; 'received:209': 0.38; 'times': 0.63; 'soon': 0.65; 'differences': 0.66; 'webpage': 0.66; 'chrisa': 0.84; 'difference.': 0.84; 'subject:write': 0.84; 'to:none': 0.91; 'ratio': 0.91
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:cc; bh=qzf1T7666zpaQLG2JG6r3QE9yS49ACPGwKec+wezlDY=; b=Vsqptz19/yOTYrqOZc1uABkqp0G1LEQYr+++sbFTuArMcdt2nC36nXYlIH7WUNDwv0 jSDbjiFufaP450vJqrmAsfY/EdMQ+473glTNxfZ8h0FN70JdJQI3+0eWT+1Yq1LHxf70 6MKenlxXIqhtx6oXHobu9Qpv+7CScMlfmA6fGTxSxUZiHO39QNZnBjmhKtwBei/teLdt LxMiPNBNIv2k3dNuaxYYUiuazIH6rK7JQ39JKZSYydZZdF2IFShQzZuaHSR1mlIZYMIv X7//Us1Tq2IiLIr0taaCyz+f9yAeI2GFID+9X1D+TJ6Pv0Ps64n4D+1k85zgcvj/4T9/ SRJw==
X-Google-DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:cc; bh=qzf1T7666zpaQLG2JG6r3QE9yS49ACPGwKec+wezlDY=; b=gNpmJyr/7FJrZQS2HfD681AYeOVx0wgS2bZ1w4Qy57fc14TCWFQSxlvxsIlHB3OuI4 aHuNP0hGs1Qd7gJbGq2/33zG6PkVOFJzuLT4DfBZs32B+OhI8PHDWiZRFlOcnKVEIY4M El270bu9QVLF6gBmVO6v1NpOSjJXeubox6mrdNSBBqHw1g5qfrfMTP+SUpV7qE8MWX+z 6Y0NlL4d9V+4u8N1TBJQJXwQfS2jbH89/qirCqMW4GEW/ISEA10kF8YcrgY77rM0MiNF PkIAyRN7xrFuggzoUf3j4RAWHbute6IROKZ1xSrwV9YWjvIVxpcoQv+v1byQXfMcczpv dftw==
X-Gm-Message-State AOPr4FUG5Mezy7KsVdmskhVqyPLsf8pqwZEQ/u0kAwUdAQ3TttsyAAck7AcyrWRXwFbCdR8lUnc5R4UovLRvhw==
X-Received by 10.107.137.166 with SMTP id t38mr37915083ioi.31.1462165942699; Sun, 01 May 2016 22:12:22 -0700 (PDT)
In-Reply-To <ng6mu7$97m$1@dont-email.me>
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.22
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list/>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
X-Mailman-Original-Message-ID <CAPTjJmqZ2OY0nUJ-jBiWRrmQhBKWj+2+Y3EsJRDGgNubH-3X8w@mail.gmail.com>
X-Mailman-Original-References <ng6jie$1ap$1@dont-email.me> <1462163671.1159335.595256017.204863FE@webmail.messagingengine.com> <CAPTjJmqSyaXXbUjUv3wsR1gR72gKumCcm55gOxQyfc37ppLopQ@mail.gmail.com> <mailman.297.1462164034.32212.python-list@python.org> <ng6m4q$743$1@dont-email.me> <1462165232.1164853.595266801.5DB17C45@webmail.messagingengine.com> <mailman.300.1462165235.32212.python-list@python.org> <ng6mu7$97m$1@dont-email.me>
Xref csiph.com comp.lang.python:107980

Show key headers only | View raw

On Mon, May 2, 2016 at 3:04 PM, DFS <nospam@dfs.com> wrote:
> And two small numbers turn into bigger numbers when the webpage is big, and
> soon the download time differences are measured in minutes, not half a
> second.
>
> So, any ideas?

So, measure with bigger web pages, and find out whether it's really a
2:1 ratio or a half-second difference. When download times are
measured in minutes, a half second difference is insignificant.

Extrapolating is dangerous.
https://xkcd.com/605/

ChrisA

Back to comp.lang.python | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 00:06 -0400
  Re: Fastest way to retrieve and write html contents to file Stephen Hansen <me+python@ixokai.io> - 2016-05-01 21:34 -0700
  Re: Fastest way to retrieve and write html contents to file Chris Angelico <rosuav@gmail.com> - 2016-05-02 14:40 +1000
    Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 00:50 -0400
      Re: Fastest way to retrieve and write html contents to file Stephen Hansen <me+python@ixokai.io> - 2016-05-01 22:00 -0700
        Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 01:04 -0400
          Re: Fastest way to retrieve and write html contents to file Chris Angelico <rosuav@gmail.com> - 2016-05-02 15:12 +1000
          Re: Fastest way to retrieve and write html contents to file Stephen Hansen <me+python@ixokai.io> - 2016-05-01 22:17 -0700
          Re: Fastest way to retrieve and write html contents to file Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2016-05-02 15:57 +1000
  Re: Fastest way to retrieve and write html contents to file Ben Finney <ben+python@benfinney.id.au> - 2016-05-02 14:49 +1000
    Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 01:00 -0400
      Re: Fastest way to retrieve and write html contents to file Stephen Hansen <me+python@ixokai.io> - 2016-05-01 22:15 -0700
        Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 01:59 -0400
          Re: Fastest way to retrieve and write html contents to file Stephen Hansen <me+python@ixokai.io> - 2016-05-01 23:27 -0700
            Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 03:37 -0400
              Re: Fastest way to retrieve and write html contents to file Stephen Hansen <me+python@ixokai.io> - 2016-05-02 00:58 -0700
              Re: Fastest way to retrieve and write html contents to file Michael Torrie <torriem@gmail.com> - 2016-05-02 22:06 -0600
                Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-03 00:24 -0400
                Re: Fastest way to retrieve and write html contents to file Tim Chase <python.list@tim.thechases.com> - 2016-05-03 10:28 -0500
                Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-03 13:00 -0400
                Re: Fastest way to retrieve and write html contents to file Tim Chase <python.list@tim.thechases.com> - 2016-05-03 13:41 -0500
                Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-04 02:10 -0400
      Re: Fastest way to retrieve and write html contents to file Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2016-05-02 16:05 +1000
        Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 02:47 -0400
          Re: Fastest way to retrieve and write html contents to file Chris Angelico <rosuav@gmail.com> - 2016-05-02 17:19 +1000
            Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 21:51 -0400
              Re: Fastest way to retrieve and write html contents to file Chris Angelico <rosuav@gmail.com> - 2016-05-03 12:00 +1000
                Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 22:01 -0400
          Re: Fastest way to retrieve and write html contents to file Peter Otten <__peter__@web.de> - 2016-05-02 10:42 +0200
            Re: Fastest way to retrieve and write html contents to file DFS <nospam@dfs.com> - 2016-05-02 21:52 -0400
  Re: Fastest way to retrieve and write html contents to file Chris Angelico <rosuav@gmail.com> - 2016-05-02 14:53 +1000
  Re: Fastest way to retrieve and write html contents to file Tim Chase <python.list@tim.thechases.com> - 2016-05-02 07:38 -0500

csiph-web