Groups > comp.lang.python > #32060

Re: Fast forward-backward (write-read)

From	Dennis Lee Bieber <wlfraed@ix.netcom.com>
Subject	Re: Fast forward-backward (write-read)
Date	2012-10-24 14:36 -0400
Organization	> Bestiaria Support Staff <
References	(3 earlier) <CA+vVgJUNOZD3vBVFDXvXzdXb=c5THQG+B5dSOp_uF1nqDHhPug@mail.gmail.com> <CA+vVgJV2A7oJQCRGFypqsfYXHNVxSuhWJUhCF+FM4NWnXanGcA@mail.gmail.com> <k679kb$rs1$1@ger.gmane.org> <mailman.2717.1351056298.27098.python-list@python.org> <5087a12e$0$29882$c3e8da3$5496439d@news.astraweb.com>
Newsgroups	comp.lang.python
Message-ID	<mailman.2790.1351103785.27098.python-list@python.org> (permalink)

Show all headers | View raw

On 24 Oct 2012 08:05:02 GMT, Steven D'Aprano
<steve+comp.lang.python@pearwood.info> declaimed the following in
gmane.comp.python.general:

> 
> Yes, but the bottleneck is still that the list comprehension will run to 
> completion, trying to process the entire 100+ GB file in one go.
>
	Concede, but 100GB once has to still be better than 100GB twice <G>
[or, as an algorithm used for smaller data sets, the non-readlines
version may fit in memory when the other fails]

-- 
	Wulfraed                 Dennis Lee Bieber         AF6VN
        wlfraed@ix.netcom.com    HTTP://wlfraed.home.netcom.com/

Back to comp.lang.python | Previous | Next — Previous in thread | Find similar | Unroll thread

Thread

Re: Fast forward-backward (write-read) Dennis Lee Bieber <wlfraed@ix.netcom.com> - 2012-10-24 01:23 -0400
  Re: Fast forward-backward (write-read) Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2012-10-24 08:05 +0000
    Re: Fast forward-backward (write-read) Dennis Lee Bieber <wlfraed@ix.netcom.com> - 2012-10-24 14:36 -0400

csiph-web