Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.compression > #1152

Re: Entropy Definition : Request for Comments

From lawcounsels@gmail.com
Newsgroups comp.compression
Subject Re: Entropy Definition : Request for Comments
Date 2012-03-14 01:43 -0700
Organization http://groups.google.com
Message-ID <15058176.7153.1331714613969.JavaMail.geo-discussion-forums@vbkc1> (permalink)
References (1 earlier) <jjn34b$nth$1@news.belwue.de> <83e630a6-055d-4b19-a254-e68b27bc687d@hv2g2000vbb.googlegroups.com> <jjo3ff$o79$1@news.belwue.de> <6b44786e-f24a-4d7a-a997-0fc1fd5b540f@v2g2000vbx.googlegroups.com> <jjo7oe$2lf$1@news.belwue.de>

Show all headers | View raw

On Tuesday, March 13, 2012 7:38:53 PM UTC, Thomas Richter wrote:
> On 13.03.2012 19:56, LawCounsels wrote:
> > On Mar 13, 6:25 pm, Thomas Richter<t...@math.tu-berlin.de>  wrote:
> >> On 13.03.2012 18:03, LawCounsels wrote:
> >>
> >>
> >>
> >>
> >>
> >>> On Mar 13, 9:13 am, Thomas Richter<t...@math.tu-berlin.de>    wrote:
> >>>> On 13.03.2012 09:40, LawCounsels wrote:
> >>
> >> You can compute the
> >> entropy of a dice-model for which you defined(!) (yes really!) the
> >> probabilities, but you *cannot* compute the entropy of "the green dice
> >> on my desk I rolled 100 times and wrote down the number of pips". The
> >> latter makes no sense.
> >>
> >
> > yes ... needs only now precise restate as model ( not source ) ....
> > the comments then holds true :
> >
> > A useful Entropy Definition for variable length N bits produced by
> > Model for which the probabilities of length N symbols produced&
> > immediate STOP was defined  :
> >
> > SUMS [  entropy of N bits * % probability of  source producing N
> > bits ]  where N = 1 to arbitrary large # of bits produced by Model
> 
> Once again: A source does not have a length. A source creates an 
> *infinite* stream of symbols.

yes ... its now corrected says Model

Back to comp.compression | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Entropy Definition : Request for Comments LawCounsels <LawCounsels@aol.com> - 2012-03-13 01:40 -0700
  Re: Entropy Definition : Request for Comments Thomas Richter <thor@math.tu-berlin.de> - 2012-03-13 10:13 +0100
    Re: Entropy Definition : Request for Comments LawCounsels <lawcounsels@gmail.com> - 2012-03-13 10:03 -0700
      Re: Entropy Definition : Request for Comments Thomas Richter <thor@math.tu-berlin.de> - 2012-03-13 19:25 +0100
        Re: Entropy Definition : Request for Comments LawCounsels <lawcounsels@gmail.com> - 2012-03-13 11:56 -0700
          Re: Entropy Definition : Request for Comments Thomas Richter <thor@math.tu-berlin.de> - 2012-03-13 20:38 +0100
            Re: Entropy Definition : Request for Comments lawcounsels@gmail.com - 2012-03-14 01:43 -0700
              Re: Entropy Definition : Request for Comments lawcounsels@gmail.com - 2012-03-14 01:46 -0700
                Re: Entropy Definition : Request for Comments Thomas Richter <thor@math.tu-berlin.de> - 2012-03-14 12:09 +0100
                Re: Entropy Definition : Request for Comments LawCounsels <LawCounsels@aol.com> - 2012-03-14 08:52 -0700
                Re: Entropy Definition : Request for Comments lawcounsels@gmail.com - 2012-03-14 11:34 -0700
                Re: Entropy Definition : Request for Comments Thomas Richter <thor@math.tu-berlin.de> - 2012-03-14 22:16 +0100
                Re: Entropy Definition : Request for Comments lawcounsels@gmail.com - 2012-03-14 23:29 -0700
                Re: Entropy Definition : Request for Comments Thomas Richter <thor@math.tu-berlin.de> - 2012-03-15 12:10 +0100
                Re: Entropy Definition : Request for Comments lawcounsels@gmail.com - 2012-03-15 06:23 -0700
                Re: Entropy Definition : Request for Comments Thomas Richter <thor@math.tu-berlin.de> - 2012-03-15 16:45 +0100
                Re: Entropy Definition : Request for Comments LawCounsels <LawCounsels@aol.com> - 2012-03-20 18:08 -0700
                Re: Entropy Definition : Request for Comments Thomas Richter <thor@math.tu-berlin.de> - 2012-03-14 22:10 +0100
  Re: Entropy Definition : Request for Comments jacko <jackokring@gmail.com> - 2012-03-15 16:27 -0700
  Re: Entropy Definition : Request for Comments jacko <jackokring@gmail.com> - 2012-03-15 16:40 -0700
    Re: Entropy Definition : Request for Comments jacko <jackokring@gmail.com> - 2012-03-15 17:14 -0700
      Re: Entropy Definition : Request for Comments jacko <jackokring@gmail.com> - 2012-03-15 17:24 -0700
        Re: Entropy Definition : Request for Comments LawCounsels@aol.com - 2012-03-31 10:30 -0700

csiph-web