Path: csiph.com!newsfeed.hal-mli.net!feeder3.hal-mli.net!newsfeed.hal-mli.net!feeder1.hal-mli.net!newsfeed.xs4all.nl!newsfeed6.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
Return-Path: <rosuav@gmail.com>
X-Original-To: python-list@python.org
Delivered-To: python-list@mail.python.org
X-Spam-Status: OK 0.008
X-Spam-Evidence: '*H*': 0.98; '*S*': 0.00; 'strings.': 0.07; 'subject:string': 0.09; 'unicode,': 0.09; 'weak': 0.09; 'aug': 0.13; 'from:addr:rosuav': 0.16; 'from:name:chris angelico': 0.16; 'subject:3.3': 0.16; 'unusable.': 0.16; 'wrote:': 0.17; 'bytes': 0.17; 'received:209.85.214.174': 0.21; 'header:In-Reply-To:1': 0.25; 'message-id:@mail.gmail.com': 0.27; 'no,': 0.29; 'point': 0.31; 'to:addr:python-list': 0.33; 'received:google.com': 0.34; 'pm,': 0.35; 'received:209.85': 0.35; 'uses': 0.37; 'subject:New': 0.37; 'rather': 0.37; 'received:209': 0.37; 'subject:: ': 0.38; 'store': 0.38; 'fact': 0.38; 'to:addr:python.org': 0.39; 'received:209.85.214': 0.39; 'header:Received:5': 0.40; 'most': 0.61
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=dhGdRPDDyY2a9nrHUI0cZWCqiK0Obak4+mYrboBF6bQ=; b=wLMlunCzIOnezfsGZwdLfoX0Cc595rOI5qFV27adk+LaJ4bGEcN+IbPO9Ah1Dww+vK BaOmMI7zdAZzDeuSbXB5dC/ecLVQMbDPlmggSZdoMKgeHj/5R+uYEhZN9lVI2KATG5VY iCJf7SiHsrVErRxceo+w5vvGqwG7EaB8N6FAI7b/vh/w7ws3sFhH3iobV8tC0F9gPiki Lk+7ipp4ih2PowXl/16HF2mPdWs8I8P0Z4ruPjFYqFVtFufp/qQtJFW9VCNL1dMInKOl WX0urZioNwgGg2z7qEuEMT7LtbeipLYdzYDh+3OP5A55VwDxe0ejX2P0C1nJz24SEhu/ qN7w==
MIME-Version: 1.0
In-Reply-To: <11931ec9-1858-4ae8-8a61-1d154d105229@googlegroups.com>
References: <f801e06f-f7b2-4aca-b352-66856a939746@googlegroups.com> <308df2af-abe7-4043-b199-0a39f440e0ab@googlegroups.com> <502f8a2a$0$29978$c3e8da3$5496439d@news.astraweb.com> <d575737d-c1e3-47db-9c7b-10fe0300cba7@googlegroups.com> <mailman.3457.1345305136.4697.python-list@python.org> <4c62a649-bc21-4e47-9c0f-acb1b1e70e36@googlegroups.com> <mailman.3462.1345310859.4697.python-list@python.org> <f9beca36-3a12-41f2-bdc2-95b159c162d1@googlegroups.com> <mailman.3468.1345314897.4697.python-list@python.org> <5030891f$0$29978$c3e8da3$5496439d@news.astraweb.com> <mailman.3485.1345362201.4697.python-list@python.org> <5030aa44$0$29978$c3e8da3$5496439d@news.astraweb.com> <mailman.3489.1345369039.4697.python-list@python.org> <11931ec9-1858-4ae8-8a61-1d154d105229@googlegroups.com>
Date: Sun, 19 Aug 2012 20:26:44 +1000
Subject: Re: New internal string format in 3.3
From: Chris Angelico <rosuav@gmail.com>
To: python-list@python.org
Content-Type: text/plain; charset=ISO-8859-1
X-BeenThere: python-list@python.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe: <http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive: <http://mail.python.org/pipermail/python-list>
List-Post: <mailto:python-list@python.org>
List-Help: <mailto:python-list-request@python.org?subject=help>
List-Subscribe: <http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups: comp.lang.python
Message-ID: <mailman.3492.1345372006.4697.python-list@python.org>
Lines: 11
NNTP-Posting-Host: 2001:888:2000:d::a6
X-Trace: 1345372006 news.xs4all.nl 6885 [2001:888:2000:d::a6]:51612
X-Complaints-To: abuse@xs4all.nl
Xref: csiph.com comp.lang.python:27375

On Sun, Aug 19, 2012 at 8:19 PM,  <wxjmfauth@gmail.com> wrote:
> This is precicely the weak point of this flexible
> representation. It uses latin-1 and latin-1 is for
> most users simply unusable.

No, it uses Unicode, and as an optimization, attempts to store the
codepoints in less than four bytes for most strings. The fact that a
one-byte storage format happens to look like latin-1 is rather
coincidental.

ChrisA