Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.soft-sys.math.mathematica > #4392 > unrolled thread

Re: more efficient method of importing and plotting large (> 100mb) files.

Started byDavid Annetts <david.annetts@iinet.net.au>
First post2011-08-14 12:19 +0000
Last post2011-08-14 12:19 +0000
Articles 1 — 1 participant

Back to article view | Back to comp.soft-sys.math.mathematica


Contents

  Re: more efficient method of importing and plotting large (> 100mb) files. David Annetts <david.annetts@iinet.net.au> - 2011-08-14 12:19 +0000

#4392 — Re: more efficient method of importing and plotting large (> 100mb) files.

FromDavid Annetts <david.annetts@iinet.net.au>
Date2011-08-14 12:19 +0000
SubjectRe: more efficient method of importing and plotting large (> 100mb) files.
Message-ID<j28eh2$3e1$1@smc.vnet.net>
Hi Andrew,

There are a few approaches ...

One is to use ReadList rather than Import, then assign variables of 
interest & remove the rest.

Another, is to read data from a database, so that you only read what you 
need.

Your mileage may vary.  As a guide, for my line based data with (say) 40 
lines, 2000 (ish) stations per line, and 40 variables out of 200 of 
interest, the later approach works better than the former for a ~150 MB file

D.

On 13/08/2011 18:50, Andrew wrote:
> I have a number of large data files that I want to import and plot,
> however mathematica seems to have a serious issue with these.  Is it
> possible to get mathematica to not plot every point with listplot?  If
> so, how do I speed up the importing and ploting of these files?
>
> Thanks!
>
> -Andrew
>

[toc] | [standalone]


Back to top | Article view | comp.soft-sys.math.mathematica


csiph-web