Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.soft-sys.math.mathematica > #6237

Re: Where are all my "memories" gone?

From Patrick Scheibe <pscheibe@trm.uni-leipzig.de>
Newsgroups comp.soft-sys.math.mathematica
Subject Re: Where are all my "memories" gone?
Date 2011-11-07 10:55 +0000
Organization Steven M. Christensen and Associates, Inc and MathTensor, Inc.
Message-ID <j98dfn$3q5$1@smc.vnet.net> (permalink)
References <201111021121.GAA03545@smc.vnet.net>

Show all headers | View raw


Hi,

I sent the issue to the support. In the meantime, maybe someone with
Linux could try the toy-example below.
I was able to build a really small sample which reproduces the behaviour
here. I create a multi-tiff and reimport it:

img = ColorConvert[ExampleData[{"TestImage", "Lena"}], "Grayscale"];
Export["tmp/lena_multi.tif", Table[img, {512}], "TIFF"];
m1 = MemoryInUse[];
img3d = Import["tmp/lena_multi.tif", "Data"];
m2 = MemoryInUse[];

Now I have here, inside Mathematica

In[7]:= {(m2 - m1)*2^-20., ByteCount[img3d]*2^-20.}

Out[7]= {512.6, 512.}

while my System-Monitor is saying, that the MathKernel uses over 1.1GB
while Mathematica is assuming that it currently uses only

In[7]:= MemoryInUse[]*2^-20.

Out[7]= 534.48

MB of my memory.

Cheers
Patrick



On Wed, 2011-11-02 at 07:59 -0500, Oliver Ruebenkoenig wrote:
> On Wed, 2 Nov 2011, Patrick Scheibe wrote:
> 
> > Hi,
> >
> > I have a bit of a delicate problem here. On a fresh kernel this
> >
> > data = Table[RandomInteger[{0, 255}], {i, 100*2^20}];
> > ByteCount[data]/2.^20
> >
> > results in exactly 400MB. My resource-manager of the operating system
> > confirms it by telling me the MathKernel occupies 422MB of memory.
> >
> > In real life, I'm working with tif-images stacks. I only import the
> > underlying data and not the images itself.
> >
> > path = "/long/path/to/aLargeImage.tif";
> > data = Import[path, "Data"];
> > ByteCount[data]/2.^30
> >
> > tells me 3.88GB which seems reasonable since the tif is about 2.0GB on
> > the drive. What does *not* look reasonable is, that Mathematica occupies
> > now 9.7GB of my memory and it doesn't seem to know:
> >
> > In[4]:= {MemoryInUse[], MemoryInUse[$FrontEnd]}/2.^30
> >
> > Out[4]= {3.9044, 0.0000874288}
> >
> > Can anyone give any useful information?
> >
> > Cheers
> > Patrick
> >
> > My OS is:
> > Linux-x86-64
> > Ubuntu 10.04
> >
> >
> 
> Hallo Patrick,
> 
> we were not able to reproduce this on a Mac - perhaps it is best you send 
> this to support@wolfram.com.
> 
> Perhaps this is a memory leak in Import - but this speculation and one 
> would have to look at the specific example.
> 
> The support can then also tell you where to out the 2GB picture.
> 
> Oliver
> 


Back to comp.soft-sys.math.mathematica | Previous | Next — Next in thread | Find similar | Unroll thread


Thread

Re: Where are all my "memories" gone? Patrick Scheibe <pscheibe@trm.uni-leipzig.de> - 2011-11-07 10:55 +0000
  Re: Where are all my "memories" gone? Sebastian Hofer <sebhofer@gmail.com> - 2011-11-09 11:43 +0000

csiph-web