Path: csiph.com!x330-a1.tempe.blueboxinc.net!usenet.pasdenom.info!gegeweb.org!newsfeed.kamp.net!newsfeed.kamp.net!newsfeed.freenet.ag!news2.euro.net!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.009 X-Spam-Evidence: '*H*': 0.98; '*S*': 0.00; 'subject:Python': 0.05; 'broken.': 0.07; 'garbage': 0.09; 'imho.': 0.09; 'received:80.91': 0.09; 'received:80.91.229': 0.09; 'received:gmane.org': 0.09; 'received:list': 0.09; 'answer,': 0.16; 'apps.': 0.16; 'fixing,': 0.16; 'input,': 0.16; 'mean,': 0.16; 'py3k': 0.16; 'subject:usage': 0.16; 'utf8': 0.16; 'wrote:': 0.18; '>>>': 0.18; 'slightly': 0.19; 'possibly': 0.19; 'input': 0.22; 'header:In- Reply-To:1': 0.22; '(or': 0.22; 'btw,': 0.23; 'subject:numbers': 0.23; 'do,': 0.25; 'obviously': 0.25; 'windows': 0.26; '(and': 0.30; 'characters,': 0.30; 'really,': 0.30; 'pure': 0.32; 'suggested': 0.32; 'rest': 0.32; "can't": 0.33; 'header:User- Agent:1': 0.33; 'header:X-Complaints-To:1': 0.34; 'answers': 0.34; 'from:addr:yahoo.co.uk': 0.34; 'to:addr:python-list': 0.35; 'question': 0.36; 'received:org': 0.36; 'issue': 0.37; 'think': 0.38; 'should': 0.38; 'data': 0.38; 'to:addr:python.org': 0.40; "you'll": 0.61; 'your': 0.61; 'you.': 0.62; 'fact,': 0.63; 'don\xe2\x80\x99t': 0.67; 'you\xe2\x80\x99ll': 0.67; 'bothered': 0.68; 'received:89': 0.69; 'thankful': 0.73; '8bit%:62': 0.77; 'tough': 0.82; 'notepad,': 0.84; 'received:as13285.net': 0.84; 'vista,': 0.84 X-Injected-Via-Gmane: http://gmane.org/ To: python-list@python.org From: Mark Lawrence Subject: Re: Python usage numbers Date: Sun, 12 Feb 2012 12:11:01 +0000 References: <4F36E2F5.9000505@gmail.com> <4f37229b$0$29986$c3e8da3$5496439d@news.astraweb.com> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Gmane-NNTP-Posting-Host: host-89-243-199-55.as13285.net User-Agent: Mozilla/5.0 (Windows NT 6.0; rv:10.0) Gecko/20120129 Thunderbird/10.0 In-Reply-To: X-Antivirus: avast! (VPS 120212-0, 12/02/2012), Outbound message X-Antivirus-Status: Clean X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.12 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Newsgroups: comp.lang.python Message-ID: Lines: 38 NNTP-Posting-Host: 2001:888:2000:d::a6 X-Trace: 1329048677 news.xs4all.nl 6904 [2001:888:2000:d::a6]:57242 X-Complaints-To: abuse@xs4all.nl Xref: x330-a1.tempe.blueboxinc.net comp.lang.python:20267 On 12/02/2012 08:26, Matej Cepl wrote: > On 12.2.2012 09:14, Matej Cepl wrote: >>> Obvious answers: >>> >>> - Try decoding with UTF8 or Latin1. Even if you don't get the right >>> characters, you'll get *something*. >>> >>> - Use open(filename, encoding='ascii', errors='surrogateescape') >>> >>> (Or possibly errors='ignore'.) >> >> These are not good answer, IMHO. The only answer I can think of, really, >> is: > > Slightly less flameish answer to the question “What should I do, > really?” is a tough one: all these suggested answers are bad because > they don’t deal with the fact, that your input data are obviously > broken. The rest is just pure GIGO … without fixing (and I mean, really, > fixing, not ignoring the problem, which is what the previous answers > suggest) your input, you’ll get garbage on output. And you should be > thankful to py3k that it shown the issue to you. > > BTW, can you display the following line? > > Příliš žluťoučký kůň úpěl ďábelské ódy. > > Best, > > Matěj Yes in Thunderbird, Notepad, Wordpad and Notepad++ on Windows Vista, can't be bothered to try any other apps. -- Cheers. Mark Lawrence.