Path: csiph.com!fu-berlin.de!uni-berlin.de!not-for-mail From: Terry Reedy Newsgroups: comp.lang.python Subject: Re: Coding systems are political (was Exended ASCII and code pages) Date: Sun, 29 May 2016 14:46:29 -0400 Lines: 25 Message-ID: References: <8737p589bo.fsf@elektro.pacujo.net> <57475CB5.7010102@lucidity.plus.com> <87pos8y14e.fsf@elektro.pacujo.net> <5747c071$0$1593$c3e8da3$5496439d@news.astraweb.com> <87fut4xc8w.fsf@elektro.pacujo.net> <5747ed83$0$1620$c3e8da3$5496439d@news.astraweb.com> <8760u0x9qu.fsf@elektro.pacujo.net> <574819d8$0$1598$c3e8da3$5496439d@news.astraweb.com> <1464357085.645851.620574537.560EAC9E@webmail.messagingengine.com> <1464365340.674161.620708793.4CE81D69@webmail.messagingengine.com> <37c8a09e-f18b-44ab-8650-0146924bbb9e@googlegroups.com> <574a8021$0$1590$c3e8da3$5496439d@news.astraweb.com> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Trace: news.uni-berlin.de nlHdqFBY7G56+twD0gRisw6QFI1MLU6NABBpKyn+38MA== Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.004 X-Spam-Evidence: '*H*': 0.99; '*S*': 0.00; 'bits': 0.07; 'subject:code': 0.07; 'encode': 0.09; 'received:80.91': 0.09; 'received:80.91.229': 0.09; 'received:gmane.org': 0.09; 'received:list': 0.09; 'python': 0.10; 'assume': 0.11; 'jan': 0.11; 'conveys': 0.16; 'received:80.91.229.3': 0.16; 'received:io': 0.16; 'received:plane.gmane.org': 0.16; 'received:psf.io': 0.16; 'reedy': 0.16; 'set)': 0.16; 'wrote:': 0.16; 'byte': 0.18; 'bytes': 0.18; 'char': 0.18; 'developer': 0.20; 'ascii': 0.22; 'satisfying': 0.22; 'text,': 0.22; 'am,': 0.23; 'header:In-Reply-To:1': 0.24; 'header:User-Agent:1': 0.26; 'header:X-Complaints-To:1': 0.26; 'towards': 0.28; 'argue': 0.29; 'combination': 0.33; 'unicode': 0.35; 'there': 0.36; 'to:addr :python-list': 0.36; 'subject:: ': 0.37; 'being': 0.37; 'received:org': 0.37; 'to:addr:python.org': 0.40; 'information,': 0.61; 'received:96': 0.63; 'more': 0.63; 'other.': 0.64; 'natural': 0.67; 'costs': 0.67; 'million': 0.74; 'chinese': 0.79; 'received:fios.verizon.net': 0.91; '\xe2\x82\xac': 0.91; 'factors': 0.97; 'political': 0.97 X-Injected-Via-Gmane: http://gmane.org/ X-Gmane-NNTP-Posting-Host: pool-96-227-207-81.phlapa.fios.verizon.net User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.1.0 In-Reply-To: X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-Mailman-Original-Message-ID: X-Mailman-Original-References: <8737p589bo.fsf@elektro.pacujo.net> <57475CB5.7010102@lucidity.plus.com> <87pos8y14e.fsf@elektro.pacujo.net> <5747c071$0$1593$c3e8da3$5496439d@news.astraweb.com> <87fut4xc8w.fsf@elektro.pacujo.net> <5747ed83$0$1620$c3e8da3$5496439d@news.astraweb.com> <8760u0x9qu.fsf@elektro.pacujo.net> <574819d8$0$1598$c3e8da3$5496439d@news.astraweb.com> <1464357085.645851.620574537.560EAC9E@webmail.messagingengine.com> <1464365340.674161.620708793.4CE81D69@webmail.messagingengine.com> <37c8a09e-f18b-44ab-8650-0146924bbb9e@googlegroups.com> <574a8021$0$1590$c3e8da3$5496439d@news.astraweb.com> Xref: csiph.com comp.lang.python:109241 On 5/29/2016 2:12 AM, Rustom Mody wrote: > In short that a =E2=82=AC costs more than a $ is a combination of the f= actors > - a natural cause -- there are a million chars to encode (lets assume t= hat the > million of Unicode is somehow God-given AS A SET) > - an artificial political one -- out of the million-factorial permutati= ons of > that million, the one that the Unicode consortium chose is towards sati= sfying the > equation: Keep ASCII users undisturbed and happy From the Python developer viewpoint, Unicode might as well be a fact of = nature. I also note that in English text, a (phoneme) char conveys=20 about 6 bits of information, while in Chinese text, a (word) char=20 conveys perhaps 15 bits of information. So I argue that Python 3.3+'s=20 FSR is being fair in using 1 byte for the first and most often 2 bytes=20 for the other. --=20 Terry Jan Reedy