Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #110706

Re: Processing text data with different encodings

Path csiph.com!fu-berlin.de!uni-berlin.de!not-for-mail
From Random832 <random832@fastmail.com>
Newsgroups comp.lang.python
Subject Re: Processing text data with different encodings
Date Tue, 28 Jun 2016 11:01:37 -0400
Lines 11
Message-ID <mailman.85.1467126100.2358.python-list@python.org> (permalink)
References <ubl94dxa2e.ln2@news.c0t0d0s0.de> <nktcj3$4u8$1@ger.gmane.org> <mailman.68.1467102649.2358.python-list@python.org> <sdv94dx74e.ln2@news.c0t0d0s0.de> <57725ee6$0$1600$c3e8da3$5496439d@news.astraweb.com> <487a4dxgc.ln2@news.c0t0d0s0.de> <57728f27$0$1621$c3e8da3$5496439d@news.astraweb.com> <1467126097.2528395.650908785.4906EC42@webmail.messagingengine.com>
Mime-Version 1.0
Content-Type text/plain
Content-Transfer-Encoding 7bit
X-Trace news.uni-berlin.de 2N8SCqo3GakvHUh5dFWxhAiqhlWLYEHKzCy1lHFNPDeg==
Return-Path <random832@fastmail.com>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.003
X-Spam-Evidence '*H*': 0.99; '*S*': 0.00; 'subject:text': 0.04; 'counting': 0.07; 'present,': 0.07; 'received:internal': 0.09; 'encodings': 0.16; 'message-id:@webmail.messagingengine.com': 0.16; 'received:10.202': 0.16; 'received:10.202.2': 0.16; 'received:66.111': 0.16; 'received:66.111.4': 0.16; 'received:66.111.4.27': 0.16; 'received:io': 0.16; 'received:messagingengine.com': 0.16; 'received:out3-smtp.messagingengine.com': 0.16; 'received:psf.io': 0.16; 'us-ascii': 0.16; 'wrote:': 0.16; '"you': 0.18; 'header:In- Reply-To:1': 0.24; "i've": 0.25; 'argue': 0.29; "i'm": 0.30; 'maybe': 0.33; "d'aprano": 0.33; 'steven': 0.33; 'tue,': 0.34; 'text': 0.35; 'but': 0.36; 'to:addr:python-list': 0.36; 'subject:: ': 0.37; 'received:10': 0.37; 'sources': 0.37; 'received:66': 0.38; 'to:addr:python.org': 0.40; 'subject:with': 0.40; 'header :Message-Id:1': 0.61; 'side': 0.62; 'different': 0.63; 'more.': 0.63; 'fragments': 0.84
DKIM-Signature v=1; a=rsa-sha1; c=relaxed/relaxed; d=fastmail.com; h= content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-sasl-enc :x-sasl-enc; s=mesmtp; bh=FSBT/yHhtQj6nWBnugjGXL+vwWU=; b=SMa/+8 2lMAOnRsjXDDcEJFFJxBvsC+1YSzN3WNxifv7qNvVQ2AFlTo4kY0d3fwtrx36aCu LV6YtwxeG+8hWEcbAeKDOQtwLAHJcNIilnpJHtqJKc6GbfThkbozM3CFZwPPIyuE RpWAJvt5Atumv9wyymNj2eYC4pa+oGQXXyy3Q=
DKIM-Signature v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-sasl-enc:x-sasl-enc; s=smtpout; bh=FSBT/yHhtQj6nWB nugjGXL+vwWU=; b=DbWU4pHeTNSrWXwsxppikeIHn3ZXqr82Id51nuY+CeJR10L +b/fVVLqE0ZuP4XIJNgUfnDfot/9wlMFIOJPZOPRUbTn8Th8vu4QjKDKA4BAoeln EYpgD23pfGHcRf53U9KWpOO630WBPWhW0YKQ+LwuJj1uoxqchXTXcO/ShXCc=
X-Sasl-Enc A3cpUtOTPllznO1orHqGQ6rTzExusVJRHBre3lg8//qw 1467126097
X-Mailer MessagingEngine.com Webmail Interface - ajax-92c7b58a
In-Reply-To <57728f27$0$1621$c3e8da3$5496439d@news.astraweb.com>
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.22
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list/>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
X-Mailman-Original-Message-ID <1467126097.2528395.650908785.4906EC42@webmail.messagingengine.com>
X-Mailman-Original-References <ubl94dxa2e.ln2@news.c0t0d0s0.de> <nktcj3$4u8$1@ger.gmane.org> <mailman.68.1467102649.2358.python-list@python.org> <sdv94dx74e.ln2@news.c0t0d0s0.de> <57725ee6$0$1600$c3e8da3$5496439d@news.astraweb.com> <487a4dxgc.ln2@news.c0t0d0s0.de> <57728f27$0$1621$c3e8da3$5496439d@news.astraweb.com>
Xref csiph.com comp.lang.python:110706

Show key headers only | View raw

On Tue, Jun 28, 2016, at 10:52, Steven D'Aprano wrote:
>     "you will find THREE OR FOUR different encodings in one email. 
>     I think at the sending side they just glue different text 
>     fragments from different sources together without thinking 
>     about the encoding"
> 
> But I'm not going to argue any more. Maybe I've misunderstood you

Well, given that the other encodings he named were us-ascii and latin-1,
I think he was just counting windows-1252 as three different encodings
depending on what characters are present, as hyperbole.

Back to comp.lang.python | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Processing text data with different encodings Michael Welle <mwe012008@gmx.net> - 2016-06-28 09:25 +0200
  Re: Processing text data with different encodings Chris Angelico <rosuav@gmail.com> - 2016-06-28 17:46 +1000
    Re: Processing text data with different encodings Michael Welle <mwe012008@gmx.net> - 2016-06-28 10:35 +0200
      Re: Processing text data with different encodings Steven D'Aprano <steve@pearwood.info> - 2016-06-28 20:29 +1000
        Re: Processing text data with different encodings Michael Welle <mwe012008@gmx.net> - 2016-06-28 12:37 +0200
          Re: Processing text data with different encodings Chris Angelico <rosuav@gmail.com> - 2016-06-28 21:09 +1000
  Re: Processing text data with different encodings Peter Otten <__peter__@web.de> - 2016-06-28 10:30 +0200
    Re: Processing text data with different encodings Michael Welle <mwe012008@gmx.net> - 2016-06-28 12:17 +0200
      Re: Processing text data with different encodings Michael Welle <mwe012008@gmx.net> - 2016-06-28 12:44 +0200
      Re: Processing text data with different encodings Steven D'Aprano <steve@pearwood.info> - 2016-06-28 21:26 +1000
        Re: Processing text data with different encodings Michael Welle <mwe012008@gmx.net> - 2016-06-28 14:30 +0200
          Re: Processing text data with different encodings Steven D'Aprano <steve@pearwood.info> - 2016-06-29 00:52 +1000
            Re: Processing text data with different encodings Random832 <random832@fastmail.com> - 2016-06-28 11:01 -0400
            Re: Processing text data with different encodings Michael Welle <mwe012008@gmx.net> - 2016-06-28 17:52 +0200
              Re: Processing text data with different encodings Michael Welle <mwe012008@gmx.net> - 2016-06-29 06:45 +0200
          Re: Processing text data with different encodings Steven D'Aprano <steve@pearwood.info> - 2016-06-29 01:11 +1000
      Re: Processing text data with different encodings Peter Otten <__peter__@web.de> - 2016-06-28 13:31 +0200
        Re: Processing text data with different encodings Michael Welle <mwe012008@gmx.net> - 2016-06-28 15:16 +0200
  Re: Processing text data with different encodings Chris Angelico <rosuav@gmail.com> - 2016-06-28 20:25 +1000
  Re: Processing text data with different encodings Random832 <random832@fastmail.com> - 2016-06-28 11:52 -0400
  Re: Processing text data with different encodings Chris Angelico <rosuav@gmail.com> - 2016-06-29 04:03 +1000

csiph-web