Path: csiph.com!newsfeed.hal-mli.net!feeder3.hal-mli.net!newsfeed.hal-mli.net!feeder1.hal-mli.net!npeer03.iad.highwinds-media.com!news.highwinds-media.com!feed-me.highwinds-media.com!postnews.google.com!glegroupsg2000goo.googlegroups.com!not-for-mail From: jacko Newsgroups: comp.compression Subject: Re: Entropy Definition : Request for Comments Date: Thu, 15 Mar 2012 16:27:52 -0700 (PDT) Organization: http://groups.google.com Lines: 3 Message-ID: <1445089.193.1331854072729.JavaMail.geo-discussion-forums@vbbed8> References: <65477e30-7acd-4b01-acb0-81562834eff1@w5g2000yqi.googlegroups.com> NNTP-Posting-Host: 92.40.254.185 Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 X-Trace: posting.google.com 1331855833 16070 127.0.0.1 (15 Mar 2012 23:57:13 GMT) X-Complaints-To: groups-abuse@google.com NNTP-Posting-Date: Thu, 15 Mar 2012 23:57:13 +0000 (UTC) In-Reply-To: <65477e30-7acd-4b01-acb0-81562834eff1@w5g2000yqi.googlegroups.com> Complaints-To: groups-abuse@google.com Injection-Info: glegroupsg2000goo.googlegroups.com; posting-host=92.40.254.185; posting-account=kZanLQoAAABvNhBbAlX1SsCxeprjdiHJ User-Agent: G2/1.0 X-Received-Bytes: 1408 Xref: csiph.com comp.compression:1163 I suppose some of the other thread is trying to teach the difference between a infinite central limit distribution and the distribution formed by finite sampling from it. In this sense the expectation of different quantities could be different. The entropy (or expected self information) E(I) may vary depending on the distribution statistics.