Path: csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!goblin2!goblin.stu.neva.ru!newsfeed.xs4all.nl!newsfeed1a.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.013 X-Spam-Evidence: '*H*': 0.97; '*S*': 0.00; 'irc': 0.05; 'output': 0.05; 'apis': 0.09; 'referenced': 0.09; 'subject:characters': 0.09; 'python': 0.11; 'bug': 0.12; 'thread': 0.14; 'windows': 0.15; '(both': 0.16; '4:25': 0.16; 'displaying': 0.16; 'earlier.': 0.16; 'subject:Unicode': 0.16; 'underlying': 0.16; 'fix': 0.17; 'wrote:': 0.18; 'bit': 0.19; '(but': 0.19; 'possible,': 0.19; 'written': 0.21; 'seems': 0.21; '>>>': 0.22; 'input': 0.22; 'pages,': 0.22; 'header:User-Agent:1': 0.23; 'adds': 0.24; 'subject:problem': 0.24; 'unicode': 0.24; 'fine': 0.24; 'logging': 0.26; 'header:In-Reply-To:1': 0.27; 'installed': 0.27; 'chris': 0.29; '[1]': 0.29; 'character': 0.29; 'url:code': 0.29; "doesn't": 0.30; 'andrew': 0.30; 'characters': 0.30; 'code': 0.31; '(my': 0.31; 'font': 0.31; 'subject:some': 0.31; 'anyone': 0.31; 'quite': 0.32; 'text': 0.33; 'bugs': 0.33; 'plain': 0.33; 'screen': 0.34; 'subject:with': 0.35; 'display': 0.35; 'but': 0.35; 'there': 0.35; 'interface,': 0.36; 'largely': 0.36; 'thanks': 0.36; 'received:10.0': 0.36; 'received:10': 0.37; 'problems': 0.38; 'to:addr:python-list': 0.38; 'pm,': 0.38; 'does': 0.39; 'to:addr:python.org': 0.39; 'read': 0.60; 'received:unknown': 0.61; 'issues,': 0.61; 'providing': 0.61; "you're": 0.61; 'real': 0.63; 'url:p': 0.64; 'more': 0.64; 'received:bluehost.com': 0.68; 'containing': 0.69; 'bot': 0.84; 'console,': 0.84; 'glenn': 0.84; 'received:69.89': 0.84; 'scraping': 0.84; 'selection,': 0.84; 'difficult,': 0.91 X-Authority-Analysis: v=2.1 cv=EJKVjTpC c=1 sm=1 tr=0 a=bHMQH+OLnPEWGwbUEerQzQ==:117 a=bHMQH+OLnPEWGwbUEerQzQ==:17 a=cNaOj0WVAAAA:8 a=f5113yIGAAAA:8 a=tcnv99F1KMcA:10 a=NQx7NIpX_PoA:10 a=WiSE-OA02TIA:10 a=aDqhzxAoLLkA:10 a=9HSTQGAzAAAA:8 a=7j9GTTBHwvYA:10 a=foBewTYRo0cA:10 a=r77TgQKjGQsHNAKrUKIA:9 a=9iDbn-4jx3cA:10 a=cKsnjEOsciEA:10 a=1XWaLZrsAAAA:8 a=Bm9vYrcv0C1K_K5rs-cA:9 a=QEXdDO2ut3YA:10 a=x-1bXhv298WJp58Xio8A:9 a=X54a6x3rvIeWjkAl:21 a=_W_S_7VecoQA:10 Date: Sun, 03 Aug 2014 21:14:44 -0700 From: Glenn Linderman User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: python-list@python.org Subject: Re: cmd.exe on WIndows - problem with displaying some Unicode characters References: <53DEC4F5.8090805@my.hennepintech.edu> <53DED137.7080907@g.nevcal.com> In-Reply-To: <53DED137.7080907@g.nevcal.com> Content-Type: multipart/alternative; boundary="------------060705080109010002090606" X-Identified-User: {1756:box1033.bluehost.com:areliabl:nevcal.com} {sentby:smtp auth 75.141.227.179 authed with test@nevcal.com} X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Newsgroups: comp.lang.python Message-ID: Lines: 88 NNTP-Posting-Host: 2001:888:2000:d::a6 X-Trace: 1407125703 news.xs4all.nl 2909 [2001:888:2000:d::a6]:50304 X-Complaints-To: abuse@xs4all.nl Xref: csiph.com comp.lang.python:75658 This is a multi-part message in MIME format. --------------060705080109010002090606 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 8/3/2014 5:17 PM, Glenn Linderman wrote: > On 8/3/2014 4:25 PM, Andrew Berg wrote: >> On 2014.08.03 18:08, Chris Angelico wrote: >>> The best way to do it is to use the Unicode codepage, but cmd.exe just >>> plain has issues. There are underlying Windows APIs for displaying >>> text that have problems with astral characters (I think that's what it >>> is), so ultimately, you're largely stuck. >> That is not quite true. The terminal has these issues, not the shell. Using >> cp65001 does make Unicode in a Windows terminal possible, but using a better >> terminal[1] makes it almost perfect (my experience has been that input can be >> difficult, but output works well). I personally have used an IRC bot written in >> Python with logging output containing Unicode characters that display just fine >> (both locally and over SSH). >> >> [1] I recommend ConEmu:https://code.google.com/p/conemu-maximus5/ > I will be reading more about conemu, thanks for the reference. Having read a bit about ConEmu, it seems that it is a "pretty face" built on top of Windows Console, by screen scraping the real (but hidden) Windows Console, and providing a number of interesting display features and modes. So while it adds functionality to the Windows Console interface, it doesn't seem like it is likely to fix bugs or resolve issues with code pages, font selection, or Unicode character repertoires, which are the issues of this thread and the bug I referenced earlier. Can anyone with ConEmu installed refute this interpretation of its functionality? --------------060705080109010002090606 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 7bit
On 8/3/2014 5:17 PM, Glenn Linderman wrote:
On 8/3/2014 4:25 PM, Andrew Berg wrote:
On 2014.08.03 18:08, Chris Angelico wrote:
The best way to do it is to use the Unicode codepage, but cmd.exe just
plain has issues. There are underlying Windows APIs for displaying
text that have problems with astral characters (I think that's what it
is), so ultimately, you're largely stuck.
That is not quite true. The terminal has these issues, not the shell. Using
cp65001 does make Unicode in a Windows terminal possible, but using a better
terminal[1] makes it almost perfect (my experience has been that input can be
difficult, but output works well). I personally have used an IRC bot written in
Python with logging output containing Unicode characters that display just fine
(both locally and over SSH).

[1] I recommend ConEmu: https://code.google.com/p/conemu-maximus5/
I will be reading more about conemu, thanks for the reference.

Having read a bit about ConEmu, it seems that it is a "pretty face" built on top of Windows Console, by screen scraping the real (but hidden) Windows Console, and providing a number of interesting display features and modes. So while it adds functionality to the Windows Console interface, it doesn't seem like it is likely to fix bugs or resolve issues with code pages, font selection, or Unicode character repertoires, which are the issues of this thread and the bug I referenced earlier.

Can anyone with ConEmu installed refute this interpretation of its functionality?
--------------060705080109010002090606--