Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #85743

Re: python implementation of a new integer encoding algorithm.

Path csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!news.mixmin.net!hq-usenetpeers.eweka.nl!hq-usenetpeers.eweka.nl!bcyclone05.am1.xlned.com!bcyclone05.am1.xlned.com!newsfeed.xs4all.nl!newsfeed4.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path <davea@davea.name>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.047
X-Spam-Evidence '*H*': 0.91; '*S*': 0.00; 'encoding': 0.05; '(especially': 0.07; 'encoded': 0.07; 'occasionally': 0.09; "people's": 0.09; '(before': 0.16; 'assumptions': 0.16; 'bits.': 0.16; 'coding?': 0.16; 'infinity,': 0.16; 'losing': 0.16; 'sure.': 0.16; 'terminator': 0.16; 'troll': 0.16; 'subject:python': 0.16; 'wrote:': 0.18; 'looked': 0.18; 'wed,': 0.18; 'later': 0.20; 'fit': 0.20; 'feb': 0.22; 'coding': 0.22; 'header:User-Agent:1': 0.23; 'integer': 0.24; 'typical': 0.24; 'header:In-Reply-To:1': 0.27; 'point': 0.28; 'chris': 0.29; 'am,': 0.29; 'character': 0.29; "doesn't": 0.30; 'involving': 0.30; 'context.': 0.31; 'enabled': 0.31; 'subject:skip:i 10': 0.31; 'though.': 0.31; 'probably': 0.32; 'know.': 0.32; "i'd": 0.34; 'possible.': 0.35; 'but': 0.35; 'there': 0.35; 'really': 0.36; 'in.': 0.36; 'next': 0.36; "didn't": 0.36; 'possible': 0.36; 'changing': 0.37; 'example,': 0.37; 'subject:new': 0.38; 'to:addr:python-list': 0.38; 'anything': 0.39; 'expect': 0.39; 'sure': 0.39; 'to:addr:python.org': 0.39; 'enough': 0.39; 'how': 0.40; 'read': 0.60; 'dave': 0.60; 'removing': 0.60; 'most': 0.60; 'hotel': 0.61; 'first': 0.61; 'such': 0.63; 'different': 0.65; 'charset:windows-1252': 0.65; 'believe': 0.68; 'received:74.208': 0.68; 'saw': 0.77; 'article': 0.77; '2015': 0.84; 'blow': 0.84; 'journal': 0.84; 'provable': 0.84; '1500': 0.91; 'angel': 0.91; 'notion': 0.91
Date Tue, 17 Feb 2015 10:18:33 -0500
From Dave Angel <davea@davea.name>
User-Agent Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0
MIME-Version 1.0
To python-list@python.org
Subject Re: python implementation of a new integer encoding algorithm.
References <e45a71b2-7ec0-4c7d-88ae-c48aebe154b7@googlegroups.com> <54E34C68.6040700@davea.name> <CAPTjJmpF2OkaK3LKS1Uf=Rsc-XEczb=pkuUoyWLvLfQpvJHKSA@mail.gmail.com> <54E35519.7060607@davea.name> <CAPTjJmqEbG84if_gt-Zs0HYSbuLkyp0F_fv04g9eGxuUmf6NHw@mail.gmail.com>
In-Reply-To <CAPTjJmqEbG84if_gt-Zs0HYSbuLkyp0F_fv04g9eGxuUmf6NHw@mail.gmail.com>
Content-Type text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding 7bit
X-Provags-ID V02:K0:ZTbDJQ1GDyVEcWQ4YN9F9JG/LOGMz3aFcV+1Ww5k5tJ rRrzepjYpf9r95jR5+CcjxY26ZVRA0m12wqwn/u0nW1TxZB7P0 Lmcsi9phrsUN1gSNy+zXhXWAvP6L19IJUwLL1lRo24be+0ZaNG zr/vnvMJb28C5Mkgebsb+XtlswPVLT7zzKXC8OBK0E4EuLreEx fyN7JAl83wkaiA1O+3XO/mx5YwPbJyMTnAAOjWCiEOmLOAZCIA tSgTtwo1H8sfQKmnmuctCwUz97kHuUD/ibiXF1N1xv2ihIq8hu ymv+JboAAEYsQvYhlYy9CuVBWM3dtMtmpmx2Ik/F2L/TKg+zA= =
X-UI-Out-Filterresults notjunk:1;
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.15
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list/>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups comp.lang.python
Message-ID <mailman.18788.1424186328.18130.python-list@python.org> (permalink)
Lines 40
NNTP-Posting-Host 2001:888:2000:d::a6
X-Trace 1424186328 news.xs4all.nl 2923 [2001:888:2000:d::a6]:54209
X-Complaints-To abuse@xs4all.nl
X-Received-Body-CRC 2075953465
X-Received-Bytes 5654
Xref csiph.com comp.lang.python:85743

Show key headers only | View raw

On 02/17/2015 09:58 AM, Chris Angelico wrote:
> On Wed, Feb 18, 2015 at 1:50 AM, Dave Angel <davea@davea.name> wrote:
>> But the first thing I'd expect to see would be a target estimate of the
>> anticipated distribution of number values/magnitudes.  For example, if a
>> typical integer is 1500 bits, plus/minus 200 bits, I'd probably try encoding
>> in base 65535, and have a terminator character of 0xffff.
>
> Sure. Not sure how you'd cope with an interior FFFF in the stream
> without drastically losing efficiency, though.

That's why it was base 65535, not 65536.

>
>> An interesting point of history.  At the time of Huffman's paper, it was
>> provable that it was the best possible lossless compression.  But there were
>> some unwritten assumptions, such as that each character would be encoded
>> with a whole number of bits.  Changing that assumption makes arithmetic
>> coding possible.  Next assumption was that probabilities of each character
>> didn't depend on context.  Changing that assumption enables LZ.  And so on.
>
> Didn't LZ predate arithmetic coding?

I really don't know.  I looked up Huffman's article (before Internet, I 
found it in a library) from the 1952 IRE journal (I believe that's where 
it was).  I probably read it about 1980.

But arithmetic coding and LZ both came later to me, and that's the order 
I saw them in.

> But yes, removing those
> assumptions has enabled some pretty amazing alternatives. Just
> describing arithmetic coding to them is enough to blow most people's
> minds. (Especially my sister. She hates infinity, mainly - I think -
> because it doesn't fit inside her brain. I troll her occasionally with
> Hilbert's Hotel or anything involving the notion of different sizes of
> infinity.)


-- 
DaveA

Back to comp.lang.python | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

python implementation of a new integer encoding algorithm. janhein.vanderburg@gmail.com - 2015-02-17 03:22 -0800
  Re: python implementation of a new integer encoding algorithm. Chris Angelico <rosuav@gmail.com> - 2015-02-18 00:16 +1100
    Re: python implementation of a new integer encoding algorithm. janhein.vanderburg@gmail.com - 2015-02-18 00:55 -0800
      Re: python implementation of a new integer encoding algorithm. Chris Angelico <rosuav@gmail.com> - 2015-02-18 20:36 +1100
        Re: python implementation of a new integer encoding algorithm. janhein.vanderburg@gmail.com - 2015-02-18 11:29 -0800
      Re: python implementation of a new integer encoding algorithm. Laura Creighton <lac@openend.se> - 2015-02-18 11:32 +0100
        Re: python implementation of a new integer encoding algorithm. janhein.vanderburg@gmail.com - 2015-02-18 11:48 -0800
      People hated it for the same reasons I found them cool (was: python implementation of a new integer encoding algorithm.) Ben Finney <ben+python@benfinney.id.au> - 2015-02-18 21:57 +1100
  Re: python implementation of a new integer encoding algorithm. Dave Angel <davea@davea.name> - 2015-02-17 09:12 -0500
    Re: python implementation of a new integer encoding algorithm. janhein.vanderburg@gmail.com - 2015-02-18 00:59 -0800
      Re: python implementation of a new integer encoding algorithm. Dave Angel <davea@davea.name> - 2015-02-18 11:46 -0500
        Re: python implementation of a new integer encoding algorithm. Grant Edwards <invalid@invalid.invalid> - 2015-02-18 17:30 +0000
          Re: python implementation of a new integer encoding algorithm. Mark Lawrence <breamoreboy@yahoo.co.uk> - 2015-02-18 18:12 +0000
        Re: python implementation of a new integer encoding algorithm. janhein.vanderburg@gmail.com - 2015-02-18 11:55 -0800
          Re: python implementation of a new integer encoding algorithm. Marko Rauhamaa <marko@pacujo.net> - 2015-02-18 23:54 +0200
            Re: python implementation of a new integer encoding algorithm. Marko Rauhamaa <marko@pacujo.net> - 2015-02-19 00:08 +0200
            Re: python implementation of a new integer encoding algorithm. Grant Edwards <invalid@invalid.invalid> - 2015-02-18 22:58 +0000
          Re: python implementation of a new integer encoding algorithm. Dave Angel <davea@davea.name> - 2015-02-18 17:19 -0500
            Re: python implementation of a new integer encoding algorithm. janhein.vanderburg@gmail.com - 2015-02-19 07:45 -0800
              Re: python implementation of a new integer encoding algorithm. Ian Kelly <ian.g.kelly@gmail.com> - 2015-02-19 11:04 -0700
              Re: python implementation of a new integer encoding algorithm. Ian Kelly <ian.g.kelly@gmail.com> - 2015-02-19 11:16 -0700
              Re: python implementation of a new integer encoding algorithm. Dave Angel <davea@davea.name> - 2015-02-19 13:24 -0500
              Re: python implementation of a new integer encoding algorithm. Chris Angelico <rosuav@gmail.com> - 2015-02-20 05:34 +1100
              Re: python implementation of a new integer encoding algorithm. Ian Kelly <ian.g.kelly@gmail.com> - 2015-02-19 11:32 -0700
              Re: python implementation of a new integer encoding algorithm. Dave Angel <davea@davea.name> - 2015-02-19 13:41 -0500
              Re: python implementation of a new integer encoding algorithm. Dave Angel <davea@davea.name> - 2015-02-19 13:46 -0500
              Re: python implementation of a new integer encoding algorithm. Chris Angelico <rosuav@gmail.com> - 2015-02-20 05:49 +1100
      Re: python implementation of a new integer encoding algorithm. Mark Lawrence <breamoreboy@yahoo.co.uk> - 2015-02-18 17:00 +0000
  Re: python implementation of a new integer encoding algorithm. Chris Angelico <rosuav@gmail.com> - 2015-02-18 01:34 +1100
    Re: python implementation of a new integer encoding algorithm. janhein.vanderburg@gmail.com - 2015-02-18 01:04 -0800
      Re: python implementation of a new integer encoding algorithm. Dave Angel <davea@davea.name> - 2015-02-18 08:54 -0500
        Re: python implementation of a new integer encoding algorithm. janhein.vanderburg@gmail.com - 2015-02-18 11:52 -0800
      Re: python implementation of a new integer encoding algorithm. Chris Angelico <rosuav@gmail.com> - 2015-02-19 01:16 +1100
  Re: python implementation of a new integer encoding algorithm. Dave Angel <davea@davea.name> - 2015-02-17 09:50 -0500
  Re: python implementation of a new integer encoding algorithm. Chris Angelico <rosuav@gmail.com> - 2015-02-18 01:58 +1100
  Re: python implementation of a new integer encoding algorithm. Dave Angel <davea@davea.name> - 2015-02-17 10:18 -0500
  Re: python implementation of a new integer encoding algorithm. Chris Angelico <rosuav@gmail.com> - 2015-02-18 02:25 +1100
  Re: python implementation of a new integer encoding algorithm. Paul Rubin <no.email@nospam.invalid> - 2015-02-17 08:43 -0800
    Re: python implementation of a new integer encoding algorithm. janhein.vanderburg@gmail.com - 2015-02-18 01:06 -0800
  Re: python implementation of a new integer encoding algorithm. Mario Figueiredo <marfig@gmail.com> - 2015-02-19 08:44 +0100
    Re: python implementation of a new integer encoding algorithm. Mark Lawrence <breamoreboy@yahoo.co.uk> - 2015-02-19 08:06 +0000
      Re: python implementation of a new integer encoding algorithm. Marko Rauhamaa <marko@pacujo.net> - 2015-02-19 10:36 +0200
        Re: python implementation of a new integer encoding algorithm. Mark Lawrence <breamoreboy@yahoo.co.uk> - 2015-02-19 09:33 +0000
        Re: python implementation of a new integer encoding algorithm. Terry Reedy <tjreedy@udel.edu> - 2015-02-19 14:50 -0500
          Re: python implementation of a new integer encoding algorithm. Marko Rauhamaa <marko@pacujo.net> - 2015-02-19 21:55 +0200
    Re: python implementation of a new integer encoding algorithm. Chris Angelico <rosuav@gmail.com> - 2015-02-19 19:36 +1100
    Re: python implementation of a new integer encoding algorithm. Mario Figueiredo <marfig@gmail.com> - 2015-02-19 10:42 +0100
    Re: python implementation of a new integer encoding algorithm. Mark Lawrence <breamoreboy@yahoo.co.uk> - 2015-02-19 10:28 +0000
    Re: python implementation of a new integer encoding algorithm. Mario Figueiredo <marfig@gmail.com> - 2015-02-19 14:27 +0100
  Re: python implementation of a new integer encoding algorithm. Jonas Wielicki <jonas@wielicki.name> - 2015-02-19 09:38 +0100
    Re: python implementation of a new integer encoding algorithm. janhein.vanderburg@gmail.com - 2015-02-19 07:58 -0800
  Re: python implementation of a new integer encoding algorithm. Denis McMahon <denismfmcmahon@gmail.com> - 2015-02-20 02:46 +0000
    Re: python implementation of a new integer encoding algorithm. wxjmfauth@gmail.com - 2015-02-20 00:58 -0800

csiph-web