Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #43963

Re: Is Unicode support so hard...

Path csiph.com!usenet.pasdenom.info!aioe.org!news.stack.nl!newsfeed.xs4all.nl!newsfeed2.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path <kwpolska@gmail.com>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.002
X-Spam-Evidence '*H*': 1.00; '*S*': 0.00; 'encoding': 0.05; 'say,': 0.05; '"as': 0.07; 'failing': 0.07; 'plenty': 0.07; 'responding': 0.07; 'subject:support': 0.07; 'string': 0.09; '(unicode': 0.09; 'bug.': 0.09; 'complicate': 0.09; 'escape': 0.09; 'expense': 0.09; 'mentions': 0.09; 'cc:addr:python-list': 0.11; 'python': 0.11; 'thread': 0.14; 'benjamin': 0.16; 'context:': 0.16; 'fails.': 0.16; 'fancy': 0.16; 'gpg': 0.16; 'guilty': 0.16; 'mangled': 0.16; 'newsgroups': 0.16; 'non-ascii': 0.16; 'rant,': 0.16; 'rule.': 0.16; 'saying.': 0.16; 'semantics': 0.16; 'subject:Unicode': 0.16; 'url:browse_thread': 0.16; 'url:thread': 0.16; 'sat,': 0.16; 'wrote:': 0.18; 'trying': 0.19; '>>>': 0.22; 'saying': 0.22; 'cc:addr:python.org': 0.22; 'this?': 0.23; 'recognize': 0.24; 'unicode': 0.24; 'question': 0.24; 'cc:2**0': 0.24; 'header:In- Reply-To:1': 0.27; 'chris': 0.29; 'am,': 0.29; 'character': 0.29; 'characters': 0.30; 'field,': 0.30; 'especially': 0.30; 'message- id:@mail.gmail.com': 0.30; "i'm": 0.30; 'url:mailman': 0.30; 'gives': 0.31; 'code': 0.31; 'usually': 0.31; 'way?': 0.31; 'figure': 0.32; 'url:python': 0.33; '-----': 0.33; 'implemented': 0.33; 'totally': 0.33; 'test': 0.35; 'received:google.com': 0.35; 'there': 0.35; 'really': 0.36; 'marks': 0.36; 'url:listinfo': 0.36; 'url:org': 0.36; 'should': 0.36; 'two': 0.37; 'performance': 0.37; 'pm,': 0.38; 'previous': 0.38; 'short': 0.38; 'does': 0.39; 'according': 0.40; 'url:mail': 0.40; 'how': 0.40; 'around.': 0.60; 'guy': 0.60; 'introduced': 0.61; 'from:charset:utf-8': 0.61; 'url:group': 0.63; 'provide': 0.64; 'account': 0.65; 'skip:\xe2 10': 0.65; '20,': 0.68; '21st': 0.68; '8bit%:43': 0.74; '.replace': 0.84; 'batchelder': 0.84; 'characters,': 0.84; 'fonts': 0.84; 'hijacking': 0.84; 'horrible': 0.84; 'ps.': 0.84; 'remark': 0.84; 'tex': 0.84; 'url:lang': 0.84; 'don\xe2\x80\x99t': 0.91; 'mean.': 0.91; 'to:none': 0.92; 'url:tk': 0.95; '2013': 0.98
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:cc:content-type:content-transfer-encoding; bh=q3flibN97TPVcvVvRV4vvvV5kEU0gkmQdgLSQxIw508=; b=SPZMM6dicaTFqkTvudEGZG4WzcamteFgCfKjzkWRxmt/s+k2tWEsHdDfozxp/ZAEWt 4P843p1ukvM6sl5nHJHNVUsgrJ1+V0++ODVzDd67d7LWN0/BQQCb7ShXdKVkNdMGUiWA sTsTkHzlWdLApZrAiWT7xyNREtjESxYv2TVUP6R6bqxo4vsUKvRUB0MFS8JAIcAGJYaM H7QFdWQSk+iihUAjhT+cJq2AUB5anl1W0dEF5yfKGRj7l3risulgzEkBNAQQk0KSsla1 di5fp/z82SgHI+DtRHp6ru9hs/LGLfX6JTv3QTUJw54oV5SmPe52zGb+refcVQ4mrJcw 7wGQ==
X-Received by 10.43.103.195 with SMTP id dj3mr10178421icc.3.1366481727681; Sat, 20 Apr 2013 11:15:27 -0700 (PDT)
MIME-Version 1.0
In-Reply-To <CAMuTYXgQB-AKo786u7dK2HLjTMNHvOBTxnXNUp2jUbSr9aLWRQ@mail.gmail.com>
References <d9798b4e-2825-4a36-93a3-f8a03d37a4bc@b3g2000vbo.googlegroups.com> <5172CEE4.9070403@nedbatchelder.com> <CAMuTYXgQB-AKo786u7dK2HLjTMNHvOBTxnXNUp2jUbSr9aLWRQ@mail.gmail.com>
From Chris “Kwpolska” Warrick <kwpolska@gmail.com>
Date Sat, 20 Apr 2013 20:15:07 +0200
Subject Re: Is Unicode support so hard...
Cc "python-list@python.org" <python-list@python.org>
Content-Type text/plain; charset=UTF-8
Content-Transfer-Encoding quoted-printable
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.15
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list/>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups comp.lang.python
Message-ID <mailman.860.1366481736.3114.python-list@python.org> (permalink)
Lines 74
NNTP-Posting-Host 2001:888:2000:d::a6
X-Trace 1366481736 news.xs4all.nl 2299 [2001:888:2000:d::a6]:33236
X-Complaints-To abuse@xs4all.nl
Xref csiph.com comp.lang.python:43963

Show key headers only | View raw


On Sat, Apr 20, 2013 at 8:02 PM, Benjamin Kaplan
<benjamin.kaplan@case.edu> wrote:
> On Sat, Apr 20, 2013 at 10:22 AM, Ned Batchelder <ned@nedbatchelder.com> wrote:
>> On 4/20/2013 1:12 PM, jmfauth wrote:
>>>
>>> In a previous post,
>>>
>>>
>>> http://groups.google.com/group/comp.lang.python/browse_thread/thread/6aec70817705c226#
>>> ,
>>>
>>> Chris “Kwpolska” Warrick wrote:
>>>
>>> “Is Unicode support so hard, especially in the 21st century?”
>>>
>>> --
>>>
>>> Unicode is not really complicate and it works very well (more
>>> than two decades of development if you take into account
>>> iso-14****).
>>>
>>> But, - I can say, "as usual" - people prefer to spend their
>>> time to make a "better Unicode than Unicode" and it usually
>>> fails. Python does not escape to this rule.
>>>
>>> -----
>>>
>>> I'm "busy" with TeX (unicode engine variant), fonts and typography.
>>> This gives me plenty of ideas to test the "flexible string
>>> representation" (FSR). I should recognize this FSR is failing
>>> particulary very well...
>>>
>>> I can almost say, a delight.
>>>
>>> jmf
>>> Unicode lover
>>
>> I'm totally confused about what you are saying.  What does "make a better
>> Unicode than Unicode" mean?  Are you saying that Python is guilty of this?
>> In what way?  Can you provide specifics?  Or are you saying that you like
>> how Python has implemented it?  "FSR is failing ... a delight"?  I don't
>> know what you mean.
>>
>> --Ned.
>
> Don't bother trying to figure this out. jmfauth has been hijacking
> every thread that mentions Unicode to complain about the flexible
> string representation introduced in Python 3.3. Apparently, having
> proper Unicode semantics (indexing is based on characters, not code
> points) at the expense of performance when calling .replace on the
> only non-ASCII or BMP character in the string is a horrible bug.
> --
> http://mail.python.org/mailman/listinfo/python-list

Don’t forget the original context: this was a short remark to a guy I
was responding to.  His newsgroups software (slrn according to the
headers) mangled the encoding of U+201C and U+201D in my From field,
turning them into three question marks each.  And jmf started a rant,
as usual…

PS. There are two fancy Unicode characters around.  Can you find both
of them, jmf?

--
Kwpolska <http://kwpolska.tk> | GPG KEY: 5EAAEA16
stop html mail                | always bottom-post
http://asciiribbon.org        | http://caliburn.nl/topposting.html

Back to comp.lang.python | Previous | NextPrevious in thread | Next in thread | Find similar | Unroll thread


Thread

Is Unicode support so hard... jmfauth <wxjmfauth@gmail.com> - 2013-04-20 10:12 -0700
  Re: Is Unicode support so hard... Ned Batchelder <ned@nedbatchelder.com> - 2013-04-20 13:22 -0400
  Re: Is Unicode support so hard... Benjamin Kaplan <benjamin.kaplan@case.edu> - 2013-04-20 11:02 -0700
  Re: Is Unicode support so hard... Chris Angelico <rosuav@gmail.com> - 2013-04-21 04:14 +1000
  Re: Is Unicode support so hard... Chris “Kwpolska” Warrick <kwpolska@gmail.com> - 2013-04-20 20:15 +0200
  Re: Is Unicode support so hard... Mark Lawrence <breamoreboy@yahoo.co.uk> - 2013-04-20 19:18 +0100
  Re: Is Unicode support so hard... Neil Hodgson <nhodgson@iinet.net.au> - 2013-04-21 09:03 +1000
    Re: Is Unicode support so hard... rusi <rustompmody@gmail.com> - 2013-04-20 18:37 -0700
      Re: Is Unicode support so hard... Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2013-04-21 03:36 +0000
        Re: Is Unicode support so hard... Chris Angelico <rosuav@gmail.com> - 2013-04-21 13:42 +1000
      Re: Is Unicode support so hard... Terry Jan Reedy <tjreedy@udel.edu> - 2013-04-21 05:02 -0400
      Re: Is Unicode support so hard... Mark Lawrence <breamoreboy@yahoo.co.uk> - 2013-04-21 13:03 +0100
  Re: Is Unicode support so hard... Ethan Furman <ethan@stoneleaf.us> - 2013-04-20 18:06 -0700
  Re: Is Unicode support so hard... 88888 Dihedral <dihedral88888@googlemail.com> - 2013-04-20 23:09 -0700

csiph-web