Re: Movie (MPAA) ratings and Python?

Path	csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!newsfeed.xs4all.nl!newsfeed3.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path	<drsalists@gmail.com>
X-Original-To	python-list@python.org
Delivered-To	python-list@mail.python.org
X-Spam-Status	OK 0.048
X-Spam-Evidence	'H': 0.91; 'S': 0.01; 'subject:Python': 0.06; 'assuming': 0.09; 'dan': 0.09; 'cc:addr:python-list': 0.11; "(i'm": 0.16; 'cc:name:python list': 0.16; 'guessing': 0.16; 'uncommon': 0.16; 'wrote:': 0.18; 'wed,': 0.18; 'addition,': 0.20; 'cc:addr:python.org': 0.22; 'question': 0.24; 'cc:2**0': 0.24; 'header:In-Reply-To:1': 0.27; 'correct': 0.29; 'am,': 0.29; 'subject:) ': 0.29; 'characters': 0.30; 'dec': 0.30; 'message- id:@mail.gmail.com': 0.30; "i'm": 0.30; 'probably': 0.32; 'text': 0.33; 'guess': 0.33; 'subject: (': 0.35; 'received:google.com': 0.35; 'subject:?': 0.36; 'fact': 0.38; 'pm,': 0.38; 'games,': 0.60; 'most': 0.60; 'tell': 0.60; 'hope': 0.61; 'batchelder': 0.84; 'rating.': 0.84; 'subject:Movie': 0.84; 'confidence': 0.95; '2013': 0.98
DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=rlMQwpnckpc9ZGya67osDR7wo4fEfrcieIi1l3CzVyI=; b=yM+ttCzObWQl0t67owwy9KjcshPaGYRHJVKhl5G/1mNht9iA89ZS8aeZq2YWj1hK0R 8tTh08DVaIDKk2O1YI1DEBxACr6hPXZI0+/nHM90t3JyrY67CmrWZ907fOHu9A/4MS68 K7jQtn3Ltn8T55zgZko9A3325IZWrUdc7q23H54Q84xd2oulN8fanRr+vRtvosEn1Jx5 1RnLB3TCC4wPTT32hmgAD8q7vKef103ZDd0uhWEH7l+WDnV9N/DyExUlS2hT1KziUpxi nVTn94x9gN3lgeCK37an2ojizrduWMnvQ8+eDWiijldWjo2KHQ60cYMm6LDdxacGnp48 j24g==
MIME-Version	1.0
X-Received	by 10.195.18.34 with SMTP id gj2mr3906290wjd.82.1386803255180; Wed, 11 Dec 2013 15:07:35 -0800 (PST)
In-Reply-To	<l8ab8p$m61$1@ger.gmane.org>
References	<CAGGBd_pn4Mv8R0QuueG093YR82a3+EM2Sy+mF5d1aJ1D25yoeA@mail.gmail.com> <2CDEC558-B896-402C-8F70-A3089A5EC93D@gmail.com> <CAGGBd_qOi=rahykpRwTFmXQMnKb4sLd-8T4jGYM6kF_R=9U29w@mail.gmail.com> <l8ab8p$m61$1@ger.gmane.org>
Date	Wed, 11 Dec 2013 15:07:35 -0800
Subject	Re: Movie (MPAA) ratings and Python?
From	Dan Stromberg <drsalists@gmail.com>
To	Ned Batchelder <ned@nedbatchelder.com>
Content-Type	multipart/alternative; boundary=001a11c28aca66030204ed4a4b00
Cc	Python List <python-list@python.org>
X-BeenThere	python-list@python.org
X-Mailman-Version	2.1.15
Precedence	list
List-Id	General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe	<https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-list/>
List-Post	<mailto:python-list@python.org>
List-Help	<mailto:python-list-request@python.org?subject=help>
List-Subscribe	<https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups	comp.lang.python
Message-ID	<mailman.3936.1386803257.18130.python-list@python.org> (permalink)
Lines	53
NNTP-Posting-Host	2001:888:2000:d::a6
X-Trace	1386803257 news.xs4all.nl 2852 [2001:888:2000:d::a6]:59124
X-Complaints-To	abuse@xs4all.nl
Xref	csiph.com comp.lang.python:61622

Show key headers only | View raw

[Multipart message — attachments visible in raw view] - view raw

On Wed, Dec 11, 2013 at 10:35 AM, Ned Batchelder <ned@nedbatchelder.com>wrote:

> On 12/10/13 6:50 PM, Dan Stromberg wrote:
> Now the question becomes: Why did chardet tell me it was windows-1255?  :)
>
> It probably told you it was Windows-1252 (I'm assuming the last 5 is a
> typo).
>
> Windows-1252 is a super-set of ISO-8859-1, so any text that is correct
> ISO-8859-1 is also correct Windows-1252.  In addition, it's not uncommon to
> find text marked as ISO-8859-1 that in fact has characters that make it
> Windows-1252.
>

 $ chardet mpaa-ratings-reasons.list
mpaa-ratings-reasons.list: windows-1255 (confidence: 0.97)

I'm aware that chardet is playing guessing games, though one would hope it
would guess well most of the time, and give a reasonable confidence rating.

Back to comp.lang.python | Previous | Next — Next in thread | Find similar | Unroll thread

Thread

Re: Movie (MPAA) ratings and Python? Dan Stromberg <drsalists@gmail.com> - 2013-12-11 15:07 -0800
  Re: Movie (MPAA) ratings and Python? Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2013-12-11 23:24 +0000
    Re: Movie (MPAA) ratings and Python? Dan Stromberg <drsalists@gmail.com> - 2013-12-11 15:39 -0800
    Re: Movie (MPAA) ratings and Python? Ned Batchelder <ned@nedbatchelder.com> - 2013-12-11 20:01 -0500
    Disable HTML in forum messages (was: Movie (MPAA) ratings and Python?) Ben Finney <ben+python@benfinney.id.au> - 2013-12-12 12:12 +1100
      Re: Disable HTML in forum messages (was: Movie (MPAA) ratings and Python?) rusi <rustompmody@gmail.com> - 2013-12-11 19:23 -0800
        Re: Disable HTML in forum messages (was: Movie (MPAA) ratings and Python?) Chris Angelico <rosuav@gmail.com> - 2013-12-12 15:27 +1100
        Re: Disable HTML in forum messages (was: Movie (MPAA) ratings and Python?) Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2013-12-12 11:05 +0000
          Re: Disable HTML in forum messages (was: Movie (MPAA) ratings and Python?) Steve Hayes <hayesstw@telkomsa.net> - 2013-12-12 15:36 +0200
    Re: Disable HTML in forum messages (was: Movie (MPAA) ratings and Python?) Ian Kelly <ian.g.kelly@gmail.com> - 2013-12-11 18:31 -0700
    Re: Movie (MPAA) ratings and Python? Ian Kelly <ian.g.kelly@gmail.com> - 2013-12-11 18:37 -0700
    Re: Movie (MPAA) ratings and Python? Dan Stromberg <drsalists@gmail.com> - 2013-12-11 19:52 -0800
    Re: Movie (MPAA) ratings and Python? Michael Torrie <torriem@gmail.com> - 2013-12-11 23:22 -0700
    Re: Movie (MPAA) ratings and Python? Dave Angel <davea@davea.name> - 2013-12-12 08:56 -0500

csiph-web