Path: csiph.com!aioe.org!bofh.it!news.nic.it!robomod From: Andreas Tille Newsgroups: linux.debian.maint.python Subject: Issues when reading mailboxes from alioth-lists.debian.net Date: Wed, 19 Aug 2020 15:10:03 +0200 Message-ID: X-Original-To: Debian Python X-Mailbox-Line: From debian-python-request@lists.debian.org Wed Aug 19 13:01:48 2020 Old-Return-Path: X-Amavis-Spam-Status: No, score=-6.9 tagged_above=-10000 required=5.3 tests=[BAYES_00=-2, FOURLA=0.1, LDO_WHITELIST=-5] autolearn=ham autolearn_force=no X-Policyd-Weight: using cached result; rate: -4.6 MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="bjuZg6miEcdLYP6q" Content-Disposition: inline User-Agent: Mutt/1.10.1 (2018-07-13) X-Mailing-List: archive/latest/18580 List-ID: List-URL: List-Archive: https://lists.debian.org/msgid-search/20200819130131.GG7363@an3as.eu Approved: robomod@news.nic.it Lines: 62 Organization: linux.* mail to news gateway Sender: robomod@news.nic.it X-Original-Date: Wed, 19 Aug 2020 15:01:31 +0200 X-Original-Message-ID: <20200819130131.GG7363@an3as.eu> Xref: csiph.com linux.debian.maint.python:12831 --bjuZg6miEcdLYP6q Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Hi, in the teammetrics project I'm trying to parse mailboxes. This worked with Python2 but after porting the code to Python3 I get some encoding troubles. A specific one seem to be an error in the mailbox module. Please run the attached script test_mbox which downloads one of the critical mbox files from aliot-lists.debian.net and calls the also attached simple Python3 script which ends in: Traceback (most recent call last): File "./test_mbox.py", line 6, in if mbox_file.items() != []: File "/usr/lib/python3.8/mailbox.py", line 132, in items return list(self.iteritems()) File "/usr/lib/python3.8/mailbox.py", line 125, in iteritems value = self[key] File "/usr/lib/python3.8/mailbox.py", line 73, in __getitem__ return self.get_message(key) File "/usr/lib/python3.8/mailbox.py", line 781, in get_message msg.set_from(from_line[5:].decode('ascii')) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 37: ordinal not in range(128) Exit code: 1 IMHO it is a bug if those mailboxes can't be read. Am I missing something? Kind regards Andreas. -- http://fam-tille.de --bjuZg6miEcdLYP6q Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename=test_mbox #!/bin/sh wget https://alioth-lists.debian.net/pipermail/pkg-java-maintainers/2020-May.txt.gz gunzip 2020-May.txt.gz python3 test_mbox.py --bjuZg6miEcdLYP6q Content-Type: text/x-python; charset=us-ascii Content-Disposition: attachment; filename="test_mbox.py" #!/usr/bin/python3 import mailbox mbox_file = mailbox.mbox('2020-May.txt') if mbox_file.items() != []: print("OK") --bjuZg6miEcdLYP6q--