Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.graphics.apps.gnuplot > #3885

Re: Plotting EXTREMELY large data set

Show all headers | View raw

Disappointing to see people attack the OP.  The point of a plot is to visualize data, the guy has 30GB.  Maybe he wants candle-sticks, maybe he wants a scatter plot with translucent dots.  It's not inconceivable for a plot program to handle consolidation.

Lame comment about the eye resolution... although the high resolution area of the eye is small... the eye moves.  Like a scanner.

On Friday, September 26, 2003 at 3:22:30 AM UTC-6, Hans-Bernhard Broeker wrote:
> MidniteArrow <private@knology.net> wrote:
> 
> > While It is true that a lot of these data points are redundant
> > because of display technology limitations,
> 
> This goes deeper than display technology.  Human vision has a finite
> resolution, too.
> 
> > process the data and only show what is not redundant, but the
> > customer does not want that.  
> 
> Then, with all due respect, your customer doesn't know what they're
> talking about.  You *will* always have some kind of preprocessing and
> effective removal of redundant data, simply because there's no
> 30-Gigapixel display technology on the market, and even if there was,
> it'd be useless, because humans don't have 30-Gigapixel eyes.  
> 
> The only choice you get to make is *when* and *how* this reduction
> happens.  
> 
> > rather get a clear answer on if GNUPlot can support this. 
> 
> Well, you can try.  But there's more bad news waiting for you: gnuplot
> doesn't handle binary datafiles for 2D plots, yet.  And it will try to
> *store* all the data it reads from the file, for at least a short
> while.  Which means there's good odds it'll just run out of memory, if
> you don't cull redundant data before passing it to gnuplot.
> 
> Putting this all together: you could do it, but you would have to do
> at least some kind of pre-filtering before you pass the data to
> gnuplot.
> 
> 
> -- 
> Hans-Bernhard Broeker (broeker@physik.rwth-aachen.de)
> Even if all the snow were burnt, ashes would remain.

Back to comp.graphics.apps.gnuplot | Previous | Next — Next in thread | Find similar

Thread

Re: Plotting EXTREMELY large data set michaelstangeland@gmail.com - 2018-02-22 14:21 -0800
  Re: Plotting EXTREMELY large data set Hans-Bernhard Bröker <HBBroeker@t-online.de> - 2018-02-23 01:59 +0100
    Re: Plotting EXTREMELY large data set Gavin Buxton <gavinbuxton@gmail.com> - 2018-02-23 05:55 -0800
      Re: Plotting EXTREMELY large data set Ethan A Merritt <EAMerritt@gmail.com> - 2018-02-23 11:24 -0800
        Re: Plotting EXTREMELY large data set Gavin Buxton <gavinbuxton@gmail.com> - 2018-02-24 11:00 -0800

csiph-web