Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #13180

Re: working with a large file

From Stefan Behnel <stefan_ml@behnel.de>
Subject Re: working with a large file
Date 2011-09-12 16:10 +0200
References <CAOF-KfhdAx=HppPy5SFrWRrgsaYxWAkO0YH=WjpBSY3_wBAXqw@mail.gmail.com>
Newsgroups comp.lang.python
Message-ID <mailman.1035.1315836659.27778.python-list@python.org> (permalink)

Show all headers | View raw


Rita, 12.09.2011 12:34:
> I have a large file, 18gb uncompressed, and I would like to know what is the
> preferred method to read this file for random access. I have several
> processes reading the file which different calculate arguments. My server
> has 64gb of memory. Not sure what is the preferred way to do this?

It depends on the content (and likely also the operating system), but you 
might want to take a look at the mmap module.

Stefan

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread


Thread

Re: working with a large file Stefan Behnel <stefan_ml@behnel.de> - 2011-09-12 16:10 +0200

csiph-web