Path: csiph.com!fu-berlin.de!uni-berlin.de!not-for-mail
From: Tim Delaney <timothy.c.delaney@gmail.com>
Newsgroups: comp.lang.python
Subject: Re: [OT] Compression of random binary data
Date: Thu, 14 Jul 2016 08:39:47 +1000
Lines: 25
Message-ID: <mailman.50.1468449591.21009.python-list@python.org>
References: <d6053eeb-bb1b-49d7-95e2-9f15028746e5@googlegroups.com> <5783e7a6$0$1608$c3e8da3$5496439d@news.astraweb.com> <2a412b20-925c-4778-a71d-fad6266feab8@googlegroups.com> <578508ad$0$1614$c3e8da3$5496439d@news.astraweb.com> <bf5286ef-b091-4f3f-ace3-13a7002dbec3@googlegroups.com> <5785a790$0$1619$c3e8da3$5496439d@news.astraweb.com> <960e3589-00c9-4f71-97b1-2ffed104436f@googlegroups.com> <0502ae4a-e368-4552-4941-81c4584b57dc@gmail.com> <mailman.44.1468436625.21009.python-list@python.org> <87a8hlz5yj.fsf@elektro.pacujo.net> <CAN8CLg=GcYzHn5ieaF-Zp2QVRkgscC4xHPMBHPDt6H8zZDbc6A@mail.gmail.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=UTF-8
X-Trace: news.uni-berlin.de s7wzxCLqXTNUgVGmQzM1EgTZoLljvGopU3jRsmtVxFow==
Return-Path: <timothy.c.delaney@gmail.com>
X-Original-To: python-list@python.org
Delivered-To: python-list@mail.python.org
X-Spam-Status: OK 0.022
X-Spam-Evidence: '*H*': 0.96; '*S*': 0.00; 'subject:: [': 0.03; '(especially': 0.07; 'chunks': 0.09; '&gt;.': 0.16; '2016': 0.16; 'compress': 0.16; 'received:io': 0.16; 'received:psf.io': 0.16; 'subject:random': 0.16; 'thread.': 0.16; 'wrote:': 0.16; 'bytes': 0.18; '&gt;': 0.18; 'subject:] ': 0.19; 'library': 0.20; 'saying': 0.22; 'sets': 0.23; 'tim': 0.24; 'header:In-Reply-To:1': 0.24; 'example': 0.26; 'message-id:@mail.gmail.com': 0.27; 'random': 0.29; 'to:name:python-list': 0.30; 'michael': 0.33; 'choosing': 0.33; 'received:google.com': 0.35; 'text': 0.35; 'but': 0.36; 'there': 0.36; 'url:org': 0.36; 'possible': 0.36; 'data.': 0.36; 'to:addr:python-list': 0.36; 'being': 0.37; 'method': 0.37; "won't": 0.38; 'mean': 0.38; 'means': 0.39; 'data': 0.39; 'does': 0.39; 'to:addr:python.org': 0.40; 'some': 0.40; 'your': 0.60; 'claim': 0.61; 'matter': 0.63; 'genuine': 0.63; 'more': 0.63; 'sample': 0.63; 'fact,': 0.67; 'delaney': 0.84; "night's": 0.84
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=W92nyG0v2GKDrQH9Q7gO0rW4DMYpbC28ZhoMNI/SBFU=; b=jRcPZl39sdIp7nJ/ljSAR8Pgzj0qw0C/jky9iiGiUlFuUGpxUyF67wBmulc/UqAL+b LPVYnDkEma/NIZMTc2nQhvYLQlljQqGdWq1iKjCuzNfDR6i+9S0VKoOGwCOI60EOvmcc YA81G8HMq+i1DMLr+MTNmCNRPps5oWx4qskjmw2TXRIieIgVD5JEpVH/Umgq+RmspP3u 4E6OysF6u1oEO5I5OzTwJhJVD4rXec2v8NkHvkuOPC9Y6JC0pLCegtQP3sW1mIR7Cnmc H41Mxa/QGbEUTX9ntpuxZCICqKkKxqFqAqbkVcESXV5noHhH0UrjruI9NGHUa/DiNbS2 b80Q==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=W92nyG0v2GKDrQH9Q7gO0rW4DMYpbC28ZhoMNI/SBFU=; b=nBy+9RG2AZi2sBX7IVK4On+UlJQ+TLZdTMFVvTrk/3FMbbf4/TzQBP0niXz5qeNwtz CqUx5Fwf73ah4w16nvbW9Kz3ZC6Riimni9dh9M5R1dqbC5M+o0kSiGrIGT7Czcytk6Aj /oihvzKpVLXpooM+OlUmQUNuopPM4mLHvkmCkVTaonYe4JBM2hJTt/cW1kSYN8nIH9FU qf5k+1tNSzI1Ql09vi56//hyDGGyXT3IFh2Qhnvi/hGzNN/i6ML/g7dRQpTnVjjC9xlx H6f0S23ohO7C9sYBkphQXKlQoQkctl32y3hooAf5znqpEbleRj1Z49Lo4w/yRGs3ZZnH opZQ==
X-Gm-Message-State: ALyK8tL1c+0CIDxBSSyTEJS81AMc+pW6pMzW3QN/iY8gINQh1PMiQULe6Igq8rRfP0/stahGN+uhgEFGmcrqrw==
X-Received: by 10.157.5.198 with SMTP id 64mr7031994otd.60.1468449587973; Wed, 13 Jul 2016 15:39:47 -0700 (PDT)
In-Reply-To: <87a8hlz5yj.fsf@elektro.pacujo.net>
X-Content-Filtered-By: Mailman/MimeDel 2.1.22
X-BeenThere: python-list@python.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe: <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive: <http://mail.python.org/pipermail/python-list/>
List-Post: <mailto:python-list@python.org>
List-Help: <mailto:python-list-request@python.org?subject=help>
List-Subscribe: <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
X-Mailman-Original-Message-ID: <CAN8CLg=GcYzHn5ieaF-Zp2QVRkgscC4xHPMBHPDt6H8zZDbc6A@mail.gmail.com>
X-Mailman-Original-References: <d6053eeb-bb1b-49d7-95e2-9f15028746e5@googlegroups.com> <5783e7a6$0$1608$c3e8da3$5496439d@news.astraweb.com> <2a412b20-925c-4778-a71d-fad6266feab8@googlegroups.com> <578508ad$0$1614$c3e8da3$5496439d@news.astraweb.com> <bf5286ef-b091-4f3f-ace3-13a7002dbec3@googlegroups.com> <5785a790$0$1619$c3e8da3$5496439d@news.astraweb.com> <960e3589-00c9-4f71-97b1-2ffed104436f@googlegroups.com> <0502ae4a-e368-4552-4941-81c4584b57dc@gmail.com> <mailman.44.1468436625.21009.python-list@python.org> <87a8hlz5yj.fsf@elektro.pacujo.net>
Xref: csiph.com comp.lang.python:111417

On 14 July 2016 at 05:35, Marko Rauhamaa <marko@pacujo.net> wrote:

> Michael Torrie <torriem@gmail.com>:
> > If the data is truly random then it does not matter whether you have 5
> > bytes or 5 GB. There is no pattern to discern, and having more chunks
> > of random data won't make it possible to compress.
>
> That's true if "truly random" means "evenly distributed". You might have
> genuine random numbers with some other distribution, for example
> Gaussian: <URL: https://www.random.org/gaussian-distributions/>. Such
> sequences of random numbers may well be compressible.
>

No one is saying that *all* random data is incompressible - in fact, some
random samples are *very* compressible. A single sample of random data
might look very much like the text of "A Midsummer Night's Dream"
(especially if your method of choosing the random sample was to pick a book
off a library shelf).

But unless otherwise qualified, a claim of being able to compress random
data is taken to mean any and all sets of random data.

Anyway, that's going to be my only contribution to this thread.

Tim Delaney