Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #13180 > unrolled thread

Re: working with a large file

Started byStefan Behnel <stefan_ml@behnel.de>
First post2011-09-12 16:10 +0200
Last post2011-09-12 16:10 +0200
Articles 1 — 1 participant

Back to article view | Back to comp.lang.python

This discussion starts older than the indexed window; earlier articles aren't shown. The article labeled Started by below is the oldest one visible, not the original post.


Contents

  Re: working with a large file Stefan Behnel <stefan_ml@behnel.de> - 2011-09-12 16:10 +0200

#13180 — Re: working with a large file

FromStefan Behnel <stefan_ml@behnel.de>
Date2011-09-12 16:10 +0200
SubjectRe: working with a large file
Message-ID<mailman.1035.1315836659.27778.python-list@python.org>
Rita, 12.09.2011 12:34:
> I have a large file, 18gb uncompressed, and I would like to know what is the
> preferred method to read this file for random access. I have several
> processes reading the file which different calculate arguments. My server
> has 64gb of memory. Not sure what is the preferred way to do this?

It depends on the content (and likely also the operating system), but you 
might want to take a look at the mmap module.

Stefan

[toc] | [standalone]


Back to top | Article view | comp.lang.python


csiph-web