Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.soft-sys.math.mathematica > #4392

Re: more efficient method of importing and plotting large (> 100mb) files.

From David Annetts <david.annetts@iinet.net.au>
Newsgroups comp.soft-sys.math.mathematica
Subject Re: more efficient method of importing and plotting large (> 100mb) files.
Date 2011-08-14 12:19 +0000
Organization Steven M. Christensen and Associates, Inc and MathTensor, Inc.
Message-ID <j28eh2$3e1$1@smc.vnet.net> (permalink)

Show all headers | View raw


Hi Andrew,

There are a few approaches ...

One is to use ReadList rather than Import, then assign variables of 
interest & remove the rest.

Another, is to read data from a database, so that you only read what you 
need.

Your mileage may vary.  As a guide, for my line based data with (say) 40 
lines, 2000 (ish) stations per line, and 40 variables out of 200 of 
interest, the later approach works better than the former for a ~150 MB file

D.

On 13/08/2011 18:50, Andrew wrote:
> I have a number of large data files that I want to import and plot,
> however mathematica seems to have a serious issue with these.  Is it
> possible to get mathematica to not plot every point with listplot?  If
> so, how do I speed up the importing and ploting of these files?
>
> Thanks!
>
> -Andrew
>

Back to comp.soft-sys.math.mathematica | Previous | Next | Find similar | Unroll thread


Thread

Re: more efficient method of importing and plotting large (> 100mb) files. David Annetts <david.annetts@iinet.net.au> - 2011-08-14 12:19 +0000

csiph-web