Path: csiph.com!usenet.pasdenom.info!weretis.net!feeder4.news.weretis.net!feeds.phibee-telecom.net!newsfeed.xs4all.nl!newsfeed2.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Date: Tue, 08 Oct 2013 19:11:59 +0200
From: Andreas Perstinger <andipersti@gmail.com>
User-Agent: Mozilla/5.0 (X11; Linux i686; rv:24.0) Gecko/20100101 Thunderbird/24.0
MIME-Version: 1.0
To: python-list@python.org
Subject: Re: parsing email from stdin
References: <5253F884.7020306@rece.vub.ac.be> <525415B4.1030208@gmail.com> <525423F4.7000902@rece.vub.ac.be>
In-Reply-To: <525423F4.7000902@rece.vub.ac.be>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Precedence: list
Newsgroups: comp.lang.python
Message-ID: <mailman.868.1381252329.18130.python-list@python.org>
Lines: 56
NNTP-Posting-Host: 2001:888:2000:d::a6
Xref: csiph.com comp.lang.python:56432

On 08.10.2013 17:25, Antoon Pardon wrote:
> Op 08-10-13 16:24, Andreas Perstinger schreef:
>> Looking at the docs, I've found there is also "message_from_binary_file"
>> which works for me with your code.
>>
>> http://docs.python.org/3/library/email.parser.html#email.message_from_binary_file
>>
>
> I can't try that out right now, but I had a look at the code and the
> ByteParser that is mentioned their looks like this:
>
> class BytesFeedParser(FeedParser):
>       """Like FeedParser, but feed accepts bytes."""
>
>       def feed(self, data):
>           super().feed(data.decode('ascii', 'surrogateescape'))
>
>
> Somehow I doubt that trying to decode my utf-8 stream as if it was
> ascii will work.

Actually it does work:

$ cat testmail.txt
From: "someone" <someone@example.com>
To: "me" <me@example.com>
Subject: something
Content-Type: text/plain; charset="UTF-8";
Content-Transfer-Encoding: 8bit

foo bar AÄÖÜĎӅ baz

$ file testmail.txt
testmail.txt: news or mail, UTF-8 Unicode text

$ cat foo.py
#!/usr/bin/python3

import sys
from email import message_from_binary_file

sys.stdin = sys.stdin.detach()
msg = message_from_binary_file(sys.stdin)

print("from: ", msg['From'])
print("to: ", msg['To'])
print("subject: ", msg['Subject'])
print("body: ", msg.get_payload())

$ ./foo.py < testmail.txt
from:  "someone" <someone@example.com>
to:  "me" <me@example.com>
subject:  something
body:  foo bar AÄÖÜĎӅ baz

Bye, Andreas