Path: csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!newsfeed.xs4all.nl!newsfeed2a.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path: <rosuav@gmail.com>
X-Original-To: python-list@python.org
Delivered-To: python-list@mail.python.org
X-Spam-Status: OK 0.024
X-Spam-Evidence: '*H*': 0.95; '*S*': 0.00; 'subject:Python': 0.06; 'subject: -- ': 0.07; 'utf-8': 0.07; '"or': 0.09; 'bits': 0.09; 'compact': 0.09; 'unified': 0.09; 'cc:addr:python-list': 0.11; '(counting': 0.16; 'ascii,': 0.16; 'assigned,': 0.16; 'from:addr:rosuav': 0.16; 'from:name:chris angelico': 0.16; 'literacy': 0.16; 'rationale': 0.16; 'set,': 0.16; 'language': 0.16; 'wrote:': 0.18; 'wed,': 0.18; 'all,': 0.19; 'later': 0.20; 'fit': 0.20; '>>>': 0.22; 'cc:addr:python.org': 0.22; "aren't": 0.24; 'certainly': 0.24; 'unicode': 0.24; 'cc:2**0': 0.24; 'header :In-Reply-To:1': 0.27; 'character': 0.29; 'room': 0.29; 'characters': 0.30; 'message-id:@mail.gmail.com': 0.30; 'that.': 0.31; 'url:wiki': 0.31; 'usually': 0.31; '(maybe': 0.31; 'about.': 0.31; 'ordinary': 0.31; 'purely': 0.31; 'subject:skip:i 10': 0.31; 'such.': 0.31; 'url:wikipedia': 0.31; 'probably': 0.32; 'stuff': 0.32; "i'd": 0.34; 'but': 0.35; 'received:google.com': 0.35; 'there': 0.35; 'version': 0.36; 'possible': 0.36; 'url:org': 0.36; 'wrong': 0.37; 'being': 0.38; 'pm,': 0.38; 'either': 0.39; 'space': 0.40; 'how': 0.40; 'ian': 0.60; 'most': 0.60; 'extended': 0.61; 'reserved': 0.61; 'full': 0.61; 'more': 0.64; 'talking': 0.65; 'dont': 0.67; 'exceed': 0.68; 'limit': 0.70; 'chinese': 0.74; '"most': 0.84; "'most'": 0.84; '(while': 0.84; '100,000': 0.84; 'bmp,': 0.84; 'discrete': 0.84; 'usage.': 0.84; 'notion': 0.91; 'to:none': 0.92
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:cc :content-type; bh=EdEjExkpqAmje4q5uq2hbd3sIme57SsPL+8IVN416HY=; b=PBNCcDWehpBQvkmhGdEqvIx63K6egb2WuxHzsemlV0vLl8zYK+4lL5keP2bwolCvWT aUD/5/08ka+wW2tXiIzCeeWhuoa3DHymXflfXGxYHFgD22/AQogR8yJpVKsgLeCA8hzQ +nDJWrPkrTOAQvDM4I5KH5L6nh3zDR6hFlKV81ZczRwPj+vcctCdpKkX/lnvM6IExl+e drjFi9+Ig7RxEN0jmQNVGuEPCRZmGaCjcaiu2X1j76CUbBORNmwPJ+sgKX/IIibVa1SK wxwAC+imNuuRqcW72s6Xth6Kv8/82n1lkVT9MFUQ3bG18j9nV2rYCMakbwj7ojXLDdE/ 9gRg==
MIME-Version: 1.0
X-Received: by 10.58.237.199 with SMTP id ve7mr191929vec.66.1401866451636; Wed, 04 Jun 2014 00:20:51 -0700 (PDT)
In-Reply-To: <CALwzidnqV0wydcwASnVudCBXAUVxC3ZLtFLKVypKDqniy_w9zw@mail.gmail.com>
References: <CANw+MznPsKgJiW6e_O370VUsmVVxBfQ=M_7WUyU7+wNh+-qefA@mail.gmail.com> <CAPTjJmoB0eMMMhjUz++yYV2CEv=2xUXx7P8UuRvCk7y7gB-4+Q@mail.gmail.com> <20140603194949.3147497d@x34f> <CAPTjJmrwGVaJKmzLiX8buZQmGxrGJV657Jnb7fsK7j1-pLxtVA@mail.gmail.com> <mailman.10646.1401831682.18130.python-list@python.org> <44acd692-5dcd-4e5f-8238-7fbe0de4db2a@googlegroups.com> <mailman.10673.1401853976.18130.python-list@python.org> <c04434ce-cbc4-49ab-b312-24f1631dd894@googlegroups.com> <CALwzidnqV0wydcwASnVudCBXAUVxC3ZLtFLKVypKDqniy_w9zw@mail.gmail.com>
Date: Wed, 4 Jun 2014 17:20:51 +1000
Subject: Re: Micro Python -- a lean and efficient implementation of Python 3
From: Chris Angelico <rosuav@gmail.com>
Cc: Python <python-list@python.org>
Content-Type: text/plain; charset=UTF-8
X-BeenThere: python-list@python.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe: <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive: <http://mail.python.org/pipermail/python-list/>
List-Post: <mailto:python-list@python.org>
List-Help: <mailto:python-list-request@python.org?subject=help>
List-Subscribe: <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups: comp.lang.python
Message-ID: <mailman.10686.1401866454.18130.python-list@python.org>
Lines: 31
NNTP-Posting-Host: 2001:888:2000:d::a6
X-Trace: 1401866454 news.xs4all.nl 2878 [2001:888:2000:d::a6]:41243
X-Complaints-To: abuse@xs4all.nl
Xref: csiph.com comp.lang.python:72608

On Wed, Jun 4, 2014 at 3:02 PM, Ian Kelly <ian.g.kelly@gmail.com> wrote:
> On Tue, Jun 3, 2014 at 10:40 PM, Rustom Mody <rustompmody@gmail.com> wrote:
>>> 1) Most or all Chinese and Japanese characters
>>
>> Dont know how you count 'most'
>>
>> | One possible rationale is the desire to limit the size of the full
>> | Unicode character set, where CJK characters as represented by discrete
>> | ideograms may approach or exceed 100,000 (while those required for
>> | ordinary literacy in any language are probably under 3,000). Version 1
>> | of Unicode was designed to fit into 16 bits and only 20,940 characters
>> | (32%) out of the possible 65,536 were reserved for these CJK Unified
>> | Ideographs. Later Unicode has been extended to 21 bits allowing many
>> | more CJK characters (75,960 are assigned, with room for more).
>>
>> | From http://en.wikipedia.org/wiki/Han_unification
>
> So there are 20,940 CJK characters in the BMP, and approximately
> 55,000 more in the SIP.  I'd count 55,000 out of 75,960 as "most".

And I said "or all" because I have this vague notion that either NFC
or NFD pushes stuff out of the BMP, although I may be wrong on that.
But certainly 55K/75K "with room for more" is the "most" that I was
talking about. (Maybe it isn't "most" by usage. After all, hypertext
documents are usually smaller in UTF-8 than in UTF-16, despite "most
characters" (counting purely by 21-bit space in codepoints) being more
compact in UTF-16; most by usage is of ASCII, because hypertext
involves a lot of punctuation and such. But still, there are a lot of
CJK that aren't in the BMP.)

ChrisA