Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.soft-sys.math.mathematica > #10300

Memory Blowup Issues

From "Kevin J. McCann" <kjm@KevinMcCann.com>
Newsgroups comp.soft-sys.math.mathematica
Subject Memory Blowup Issues
Date 2012-06-01 09:20 +0000
Organization Steven M. Christensen and Associates, Inc and MathTensor, Inc.
Message-ID <jqa1h7$bj7$1@smc.vnet.net> (permalink)

Show all headers | View raw


I am dealing with some good sized data sets from satellite data. These 
data are stored in hdf format. The problem is that I process a sequence 
of these data sets by Importing and then processing; however, it seems 
that the memory usage grows with each Import, even if I Remove the data.

Here is a somewhat simplified example:

MemoryInUse[] (* some data already read in *)
2781549920

Data=Import[fileName,"Data"]; (* import a new data set *)
MemoryInUse[]
3302168936

Data=Import[fileName,"Data"];(* import  it again *)
MemoryInUse[]
3822781920

Remove[Data] (* this has no effect on the memory usage *)
MemoryInUse[]
3822787840

As you can see, I will shortly run out of memory. Any ideas?

Thanks,

Kevin

Back to comp.soft-sys.math.mathematica | Previous | Next — Next in thread | Find similar | Unroll thread


Thread

Memory Blowup Issues "Kevin J. McCann" <kjm@KevinMcCann.com> - 2012-06-01 09:20 +0000
  Re: Memory Blowup Issues David Reiss <dbreiss@gmail.com> - 2012-06-02 09:46 +0000
  Re: Memory Blowup Issues Szabolcs <szhorvat@gmail.com> - 2012-06-02 09:48 +0000

csiph-web