Path: csiph.com!usenet.pasdenom.info!weretis.net!feeder1.news.weretis.net!feeder.erje.net!eu.feeder.erje.net!newsfeed.xs4all.nl!newsfeed4.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
Date: Mon, 9 Feb 2015 20:35:49 +0000 (UTC)
From: Albert-Jan Roskam <fomcl@yahoo.com>
To: Mark Lawrence <breamoreboy@yahoo.co.uk>, "python-list@python.org" <python-list@python.org>
In-Reply-To: <mbaln0$vgp$1@ger.gmane.org>
References: <mbaln0$vgp$1@ger.gmane.org>
Subject: Re: locale bug in Python 2.7, 3.3, 3.4 (Win7 64)?
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Precedence: list
Reply-To: Albert-Jan Roskam <fomcl@yahoo.com>
Newsgroups: comp.lang.python
Message-ID: <mailman.18577.1423514509.18130.python-list@python.org>
Lines: 168
NNTP-Posting-Host: 2001:888:2000:d::a6
Xref: csiph.com comp.lang.python:85402



----- Original Message -----

> From: Mark Lawrence <breamoreboy@yahoo.co.uk>
> To: python-list@python.org
> Cc:=20
> Sent: Monday, February 9, 2015 5:02 PM
> Subject: Re: locale bug in Python 2.7, 3.3, 3.4 (Win7 64)?
>=20
> On 09/02/2015 15:43, Albert-Jan Roskam wrote:
>>  Hi,
>>=20
>>  In the locale module we have:
>>  * setlocale, the setter that also returns something
>>  * getlocale, the getter that returns the OS-specific locale tuple=20
> (supposedly!)
>>=20
>>  * getdefaultlocale, the getter that always returns a unix locale tuple
>>=20
>>  Why are the getlocale() results below sometimes windows-like, sometimes=
=20
> unix-like?
>>  It seems that I need to use setlocale(), with only the 'category'=20
> parameter, right?
>>=20
>>=20
>>  ActivePython 3.3.2.0 (ActiveState Software Inc.) based on
>>  Python 3.3.2 (default, Sep 16 2013, 23:11:39) [MSC v.1600 64 bit (AMD64=
)]=20
> on win32
>>  Type "help", "copyright", "credits" or=20
> "license" for more information.
>>>>>  import locale
>>>>>  locale.getlocale()
>>  (None, None)   # because setocale has not been called yet
>>=20
>>=20
>>  # works as expected
>>=20
>>>>>  locale.setlocale(locale.LC_ALL, "")
>>  'Dutch_Netherlands.1252'
>>>>>  locale.getlocale()
>>  ('Dutch_Netherlands', '1252')
>>=20
>>  # bug!>>> locale.setlocale(locale.LC_ALL, "german")
>>  'German_Germany.1252'
>>>>>  locale.getlocale()
>>  ('de_DE', 'cp1252')     # incorect, unix-like!
>>=20
>>=20
>>>>>  locale.setlocale(locale.LC_ALL,=20
> "German_Germany.1252")
>>  'German_Germany.1252'
>>>>>  locale.getlocale()
>>  ('de_DE', 'cp1252')     # incorect, unix-like!
>>=20
>>=20
>>  # bug!
>>=20
>>>>>  locale.setlocale(locale.LC_ALL, "spanish")
>>  'Spanish_Spain.1252'
>>>>>  locale.getlocale()
>>  ('es_ES', 'cp1252')   # incorect, unix-like!
>>=20
>>=20
>>  # works as expected
>>>>>  locale.setlocale(locale.LC_ALL, "italian")
>>  'Italian_Italy.1252'
>>>>>  locale.getlocale()
>>  ('Italian_Italy', '1252')    # correct!
>>=20
>>=20
>>  # ... maybe more?
>>=20
>>=20
>>  Regards,
>>=20
>>  Albert-Jan
>>=20
>=20
> There have been loads of bug reports on the issue tracker about locales.=
=20
>   I suggest that you take a look to see if there is an open issue about=
=20
> this problem.


Hi Mark -Thanks! I checked the bug tracker. Lots of locale-related bugs ind=
eed. I couldn't find this one though. Strange because what I am doing does =
not seem exotic at all. French, German, Portuguese and Spanish getlocale re=
sults are incorrect IMHO. Below is little check + output here in case it mi=
ght be useful for others. This is with Python 3.4, 3.3 and 2.7 on Windows 7=
 64.

from __future__ import print_function
import locale
import collections
import pprint


#https://msdn.microsoft.com/en-us/library/39cwe7zf%28v=3Dvs.80%29.aspx
languages =3D ("chinese czech danish dutch english finnish french german gr=
eek "
             "hungarian icelandic italian japanese korean norwegian polish =
"
             "portuguese russian slovak spanish swedish turkish")
d =3D collections.defaultdict(list)
t =3D collections.namedtuple("Locale", "lang setlocale getlocale")
for language in languages.split():
    sloc =3D locale.setlocale(locale.LC_ALL, language)
    gloc =3D locale.getlocale()
    record =3D t(language, sloc, gloc)
    if gloc[0][2] =3D=3D "_":
        d["unix-like"].append(record)
    else:
        d["windows-like"].append(record)
    =20
pprint.pprint(dict(d))


n:\>C:\Miniconda3\python.exe N:\temp\loc.py
{'unix-like': [Locale(lang=3D'french', setlocale=3D'French_France.1252', ge=
tlocale=3D('fr_FR', 'cp1252')),
               Locale(lang=3D'german', setlocale=3D'German_Germany.1252', g=
etlocale=3D('de_DE', 'cp1252')),
               Locale(lang=3D'portuguese', setlocale=3D'Portuguese_Brazil.1=
252', getlocale=3D('pt_BR', 'cp1252')),
               Locale(lang=3D'spanish', setlocale=3D'Spanish_Spain.1252', g=
etlocale=3D('es_ES', 'cp1252'))],
 'windows-like': [Locale(lang=3D'chinese', setlocale=3D"Chinese (Simplified=
)_People's Republic of China.936", getlocale=3D("Chinese (Simplified)_Peopl=
e's Republic of China", '936')),
                  Locale(lang=3D'czech', setlocale=3D'Czech_Czech Republic.=
1250', getlocale=3D('Czech_Czech Republic', '1250')),
                  Locale(lang=3D'danish', setlocale=3D'Danish_Denmark.1252'=
, getlocale=3D('Danish_Denmark', '1252')),
                  Locale(lang=3D'dutch', setlocale=3D'Dutch_Netherlands.125=
2', getlocale=3D('Dutch_Netherlands', '1252')),
                  Locale(lang=3D'english', setlocale=3D'English_United Stat=
es.1252', getlocale=3D('English_United States', '1252')),
                  Locale(lang=3D'finnish', setlocale=3D'Finnish_Finland.125=
2', getlocale=3D('Finnish_Finland', '1252')),
                  Locale(lang=3D'greek', setlocale=3D'Greek_Greece.1253', g=
etlocale=3D('Greek_Greece', '1253')),
                  Locale(lang=3D'hungarian', setlocale=3D'Hungarian_Hungary=
.1250', getlocale=3D('Hungarian_Hungary', '1250')),
                  Locale(lang=3D'icelandic', setlocale=3D'Icelandic_Iceland=
.1252', getlocale=3D('Icelandic_Iceland', '1252')),
                  Locale(lang=3D'italian', setlocale=3D'Italian_Italy.1252'=
, getlocale=3D('Italian_Italy', '1252')),
                  Locale(lang=3D'japanese', setlocale=3D'Japanese_Japan.932=
', getlocale=3D('Japanese_Japan', '932')),
                  Locale(lang=3D'korean', setlocale=3D'Korean_Korea.949', g=
etlocale=3D('Korean_Korea', '949')),
                  Locale(lang=3D'norwegian', setlocale=3D'Norwegian (Bokm=
=C3=A5l)_Norway.1252', getlocale=3D('Norwegian (Bokm=C3=A5l)_Norway', '1252=
')),
                  Locale(lang=3D'polish', setlocale=3D'Polish_Poland.1250',=
 getlocale=3D('Polish_Poland', '1250')),
                  Locale(lang=3D'russian', setlocale=3D'Russian_Russia.1251=
', getlocale=3D('Russian_Russia', '1251')),
                  Locale(lang=3D'slovak', setlocale=3D'Slovak_Slovakia.1250=
', getlocale=3D('Slovak_Slovakia', '1250')),
                  Locale(lang=3D'swedish', setlocale=3D'Swedish_Sweden.1252=
', getlocale=3D('Swedish_Sweden', '1252')),
                  Locale(lang=3D'turkish', setlocale=3D'Turkish_Turkey.1254=
', getlocale=3D('Turkish_Turkey', '1254'))]}