Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.compression > #1300

Re: Words as well as characters as encoding units

Show all headers | View raw

> The question is what might be in a file that one wants to compress,
> and that might not be in a language. For example, one might be
> working with GPS systems, and have files full of latitude and
> longitude values. You can consider those "words", but might not
> have any correlation.

A format-type correlation is often enough for exploitation. The file "geo" of 
the Canterbury Corpus is the shining example, it's an array of floats, 
compressing it as bit-planes (knowing how the values correlate) yields a few 
tenths of percent of compression gain - because all the floats are in a specific 
correlating range AFAIR 0.0 to 1.0.

There are no uncorrelated data-sets besides total random data. Sometimes there 
may not be strong enough a correlation, and then any high-order compressors 
compress bad/worst, but exploiting correlations is their business, not plain 
static stationary order-0.

Ciao
   Niels

Back to comp.compression | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Words as well as characters as encoding units Mok-Kong Shen <mok-kong.shen@t-online.de> - 2012-05-05 10:26 +0200
  Re: Words as well as characters as encoding units James Dow Allen <jdallen2000@yahoo.com> - 2012-05-05 02:41 -0700
    Re: Words as well as characters as encoding units Mok-Kong Shen <mok-kong.shen@t-online.de> - 2012-05-05 15:06 +0200
      Re: Words as well as characters as encoding units Thomas Richter <thor@math.tu-berlin.de> - 2012-05-05 17:05 +0200
        Re: Words as well as characters as encoding units Mok-Kong Shen <mok-kong.shen@t-online.de> - 2012-05-05 19:42 +0200
          Re: Words as well as characters as encoding units glen herrmannsfeldt <gah@ugcs.caltech.edu> - 2012-05-05 18:33 +0000
            Re: Words as well as characters as encoding units Mok-Kong Shen <mok-kong.shen@t-online.de> - 2012-05-05 21:22 +0200
              Re: Words as well as characters as encoding units Thomas Richter <thor@math.tu-berlin.de> - 2012-05-05 21:31 +0200
                Re: Words as well as characters as encoding units Mok-Kong Shen <mok-kong.shen@t-online.de> - 2012-05-05 22:19 +0200
              Re: Words as well as characters as encoding units glen herrmannsfeldt <gah@ugcs.caltech.edu> - 2012-05-05 20:17 +0000
                Re: Words as well as characters as encoding units Mok-Kong Shen <mok-kong.shen@t-online.de> - 2012-05-05 22:36 +0200
                Re: Words as well as characters as encoding units glen herrmannsfeldt <gah@ugcs.caltech.edu> - 2012-05-05 21:29 +0000
                Re: Words as well as characters as encoding units Mok-Kong Shen <mok-kong.shen@t-online.de> - 2012-05-05 23:52 +0200
                Re: Words as well as characters as encoding units Niels Fröhling <spamtrap@adsignum.com> - 2012-05-08 00:42 -0600
                Re: Words as well as characters as encoding units glen herrmannsfeldt <gah@ugcs.caltech.edu> - 2012-05-08 08:19 +0000
                Re: Words as well as characters as encoding units Niels Fröhling <spamtrap@adsignum.com> - 2012-05-09 15:14 -0600
                Re: Words as well as characters as encoding units James Dow Allen <jdallen2000@yahoo.com> - 2012-05-09 22:17 -0700

csiph-web