Path: csiph.com!usenet.pasdenom.info!gegeweb.org!de-l.enfer-du-nord.net!feeder1.enfer-du-nord.net!newsfeed.eweka.nl!eweka.nl!feeder3.eweka.nl!newsfeed.xs4all.nl!newsfeed2.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
Date: Wed, 05 Jun 2013 17:44:14 +0100
From: MRAB <python@mrabarnett.plus.com>
User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:17.0) Gecko/20130509 Thunderbird/17.0.6
MIME-Version: 1.0
To: python-list@python.org
Subject: Re: Changing filenames from Greeklish => Greek (subprocess complain)
References: <2c425f2b-99de-4453-964e-c585f2043f71@googlegroups.com> <306a22ea-fbf7-4097-af31-121a999957d6@googlegroups.com> <mailman.2649.1370354937.3114.python-list@python.org> <9c482ba0-23ac-4e66-a0e1-a18be9fd82d8@googlegroup> <mailman.2654.1370358447.3114.python-list@python.org> <06a19483-65df-4fcd-9430-b45a01c9dbab@googlegroups.com> <ade1e57a-585f-4941-be0a-1d019a27f1de@googlegroups.com> <mailman.2672.1370368442.3114.python-list@python.org> <dc20ecf5-76dd-4c2e-9a68-7ae3a3882268@googlegroups.com> <mailman.2675.1370371536.3114.python-list@python.org> <0c215f6d-c1eb-4dbf-b132-80e83ece0992@googlegroups.com> <4c271468-22f4-4c93-af14-02b978b2e6bd@googlegroups.com> <0a05fe41-12a9-47e5-a4e9-170140eb3eea@googlegroups.com> <mailman.2687.1370382939.3114.python-list@python.org> <96d574cf-653a-4d49-a5c9-475dfe082ccb@googlegroups.com> <b7d872bb-2005-456b-8d2e-b5fa22e9e6fe@googlegroups.com> <4fa2ed0b-f6e8-4cfd-bb81-92c30deba91e@googlegroups.com> <51AECF57.8020801@gmail.com>
In-Reply-To: <51AECF57.8020801@gmail.com>
Content-Type: text/plain; charset=ISO-8859-7; format=flowed
Content-Transfer-Encoding: 8bit
Precedence: list
Reply-To: python-list@python.org
Newsgroups: comp.lang.python
Message-ID: <mailman.2746.1370450657.3114.python-list@python.org>
Lines: 38
NNTP-Posting-Host: 2001:888:2000:d::a6
Xref: csiph.com comp.lang.python:47111

On 05/06/2013 06:40, Michael Torrie wrote:
> On 06/04/2013 10:15 PM, Νικόλαος Κούρας wrote:
>> One of my Greek filenames is "Ευχή του Ιησού.mp3". Just a Greek
>> filename with spaces. Is there a problem when a filename contain both
>> english and greek letters? Isn't it still a unicode string?
>>
>> All i did in my CentOS was 'mv "Euxi tou Ihsou.mp3" "Ευχή του
>> Ιησού.mp3"
>>
>> and the displayed filename after 'ls -l' returned was:
>>
>> is -rw-r--r-- 1 nikos nikos 3511233 Jun 4 14:11 \305\365\367\336\
>> \364\357\365\ \311\347\363\357\375.mp3
>>
>> There is no way at all to check the charset used to store it in hdd?
>> It should be UTF-8, but it doesn't look like it. Is there some linxu
>> command or some python command that will print out the actual
>> encoding of '\305\365\367\336\ \364\357\365\
>> \311\347\363\357\375.mp3' ?
>
> I can see that you are starting to understand things. I can't answer
> your question (don't know the answer), but you're correct about one
> thing.  A filename is just a sequence of bytes.  We'd hope it would be
> utf-8, but it could be anything.  Even worse, it's not possible to tell
> from a byte stream what encoding it is unless we just try one and see
> what happens.  Text editors, for example, have to either make a guess
> (utf-8 is a good one these days), or ask, or try to read from the first
> line of the file using ascii and see if there's a source code character
> set command to give it an idea.
>
 From the previous posts I guessed that the filename might be encoded
using ISO-8859-7:

 >>> s = b"\305\365\367\336\ \364\357\365\ \311\347\363\357\375.mp3"
 >>> s.decode("iso-8859-7")
'Ευχή\\ του\\ Ιησού.mp3'

Yes, that looks the same.