Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #31761

Re: Python does not take up available physical memory

Show all headers | View raw

On Sat, Oct 20, 2012 at 4:08 AM, Pradipto Banerjee
<pradipto.banerjee@adainvestments.com> wrote:
> I am trying to read a file into memory. The size of the file is around 1 GB.
> I have a 3GB memory PC and the Windows Task Manager shows  2.3 GB available
> physical memory when I was trying to read the file. I tried to read the file
> as follows:
>
>
>
>>>> fdata = open(filename, ‘r’).read()

Is this Python 2 or Python 3? Just throwing a random possibility out
there, could it be that reading it in and converting it to Unicode
text requires more memory than you have?

My recommendation: Unless you actually need to search the whole file
as a single string, iterate over the file instead:

for line in open(filename):
    # do something with line

Your loop will execute once for each line in the file.

ChrisA

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread

Thread

Re: Python does not take up available physical memory Chris Angelico <rosuav@gmail.com> - 2012-10-20 06:18 +1100

csiph-web