Path: csiph.com!usenet.pasdenom.info!gegeweb.org!de-l.enfer-du-nord.net!feeder2.enfer-du-nord.net!feeds.phibee-telecom.net!newsfeed.xs4all.nl!newsfeed3.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
Return-Path: <python@mrabarnett.plus.com>
X-Original-To: python-list@python.org
Delivered-To: python-list@mail.python.org
X-Spam-Status: OK 0.000
X-Spam-Evidence: '*H*': 1.00; '*S*': 0.00; 'python,': 0.02; 'charset:iso-8859-7': 0.04; 'encoding': 0.05; 'paths': 0.07; 'rename': 0.07; 'skip:\\ 20': 0.07; 'utf-8': 0.07; 'bash': 0.09; 'encode': 0.09; 'filename': 0.09; 'filenames': 0.09; 'happen,': 0.09; 'skip:\\ 10': 0.09; 'from:addr:mrabarnett.plus.com': 0.16; 'from:addr:python': 0.16; 'from:name:mrab': 0.16; 'letters.': 0.16; 'message-id:@mrabarnett.plus.com': 0.16; 'renaming': 0.16; 'somehow,': 0.16; 'sorts': 0.16; 'weird': 0.16; 'fix': 0.17; 'wrote:': 0.18; 'file,': 0.19; 'passing': 0.19; 'command': 0.22; 'header:User-Agent:1': 0.23; 'bytes': 0.24; 'script': 0.25; 'suggested': 0.26; 'header:In-Reply-To:1': 0.27; "doesn't": 0.30; "skip:' 10": 0.31; 'away.': 0.31; "d'aprano": 0.31; 'steven': 0.31; 'file': 0.32; 'quite': 0.32; 'linux': 0.33; 'subject:from': 0.34; 'could': 0.34; 'problem': 0.35; 'subject: (': 0.35; 'tool': 0.35; 'but': 0.35; '\xf4\xef\xf5': 0.36; "didn't": 0.36; 'turn': 0.37; 'to:addr:python-list': 0.38; 'files': 0.38; 'to:addr:python.org': 0.39; 'how': 0.40; 'then,': 0.60; 'tell': 0.60; 'new': 0.61; 'back': 0.62; 'name': 0.63; 'more': 0.64; 'header:Reply-To:1': 0.67; 'invalid': 0.68; 'reply-to:no real name:2**0': 0.71; 'greek': 0.84; 'reply-to:addr:python.org': 0.84; '2013': 0.98
X-CM-Score: 0.00
X-CNFS-Analysis: v=2.1 cv=KrN0hwmN c=1 sm=1 tr=0 a=0nF1XD0wxitMEM03M9B4ZQ==:117 a=0nF1XD0wxitMEM03M9B4ZQ==:17 a=0Bzu9jTXAAAA:8 a=oyR3mlnJdzkA:10 a=AdgiQdVXbpoA:10 a=ihvODaAuJD4A:10 a=OUOv7kDek9cA:10 a=E_FQspuQcigA:10 a=EBOSESyhAAAA:8 a=8AHkEIZyAAAA:8 a=uw23S90zXSUA:10 a=tb6v7wp4umiRr85ttk8A:9 a=o3X3QV6JOaEA:10
X-AUTH: mrabarnett:2500
Date: Wed, 05 Jun 2013 19:32:15 +0100
From: MRAB <python@mrabarnett.plus.com>
User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:17.0) Gecko/20130509 Thunderbird/17.0.6
MIME-Version: 1.0
To: python-list@python.org
Subject: Re: Changing filenames from Greeklish => Greek (subprocess complain)
References: <2c425f2b-99de-4453-964e-c585f2043f71@googlegroups.com> <51ac3bd6$0$11118$c3e8da3@news.astraweb.com> <f6fe5e09-dd60-472f-a301-1c484b8e5ce6@googlegroups.com> <51ad1cdd$0$11118$c3e8da3@news.astraweb.com> <ec6a68fc-80b5-4592-9c49-e8ada8678455@googlegroups.com> <pan.2013.06.04.07.39.07.960000@nowhere.com> <ed5167fb-49aa-4e7d-8070-f117cf77a89b@googlegroups.com> <pan.2013.06.04.13.01.48.43000@nowhere.com> <ea843d15-0680-484c-b83b-a92aa2f7d6d2@googlegroups.com> <a79d0b13-063e-4675-9ad4-9acadba488c5@googlegroups.com> <306a22ea-fbf7-4097-af31-121a999957d6@googlegroups.com> <mailman.2649.1370354937.3114.python-list@python.org> <9c482ba0-23ac-4e66-a0e1-a18be9fd82d8@googlegroup> <mailman.2654.1370358447.3114.python-list@python.org> <06a19483-65df-4fcd-9430-b45a01c9dbab@googlegroups.com> <ade1e57a-585f-4941-be0a-1d019a27f1de@googlegroups.com> <51aed313$0$11118$c3e8da3@news.astraweb.com> <4c19b71d-4de5-41ad-b6ae-fb133a6c331e@googlegroups.com>
In-Reply-To: <4c19b71d-4de5-41ad-b6ae-fb133a6c331e@googlegroups.com>
Content-Type: text/plain; charset=ISO-8859-7; format=flowed
Content-Transfer-Encoding: 8bit
X-BeenThere: python-list@python.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: python-list@python.org
List-Id: General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe: <http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive: <http://mail.python.org/pipermail/python-list/>
List-Post: <mailto:python-list@python.org>
List-Help: <mailto:python-list-request@python.org?subject=help>
List-Subscribe: <http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups: comp.lang.python
Message-ID: <mailman.2754.1370457145.3114.python-list@python.org>
Lines: 23
NNTP-Posting-Host: 2001:888:2000:d::a6
X-Trace: 1370457145 news.xs4all.nl 15870 [2001:888:2000:d::a6]:58228
X-Complaints-To: abuse@xs4all.nl
Xref: csiph.com comp.lang.python:47128

On 05/06/2013 18:43, Νικόλαος Κούρας wrote:
> Τη Τετάρτη, 5 Ιουνίου 2013 8:56:36 π.μ. UTC+3, ο χρήστης Steven D'Aprano έγραψε:
>
> Somehow, I don't know how because I didn't see it happen, you have one or
> more files in that directory where the file name as bytes is invalid when
> decoded as UTF-8, but your system is set to use UTF-8. So to fix this you
> need to rename the file using some tool that doesn't care quite so much
> about encodings. Use the bash command line to rename each file in turn
> until the problem goes away.
>
> But renaming ia hsell access like 'mv 'Euxi tou Ihsou.mp3' 'Ευχή του Ιησου.mp3' leade to that unknown encoding of this bytestream '\305\365\367\336\ \364\357\365\ \311\347\363\357\375.mp3'
>
> But please tell me Steven what linux tool you think it can encode the weird filename to proper 'Ευχή του Ιησου.mp3' utf-8?
>
> or we cna write a script as i suggested to decode back the bytestream using all sorts of available decode charsets boiling down to the original greek letters.
>
Using Python, I think you could get the filenames using os.listdir,
passing the directory name as a bytestring so that it'll return the
names as bytestrings.

Then, for each name, you could decode from its current encoding and
encode to UTF-8 and rename the file, passing the old and new paths to
os.rename as bytestrings.