Re: Python 3.x stuffing utf-8 into SQLite db

Path	csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!newsfeed.xs4all.nl!newsfeed4a.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
Return-Path	<skip.montanaro@gmail.com>
X-Original-To	python-list@python.org
Delivered-To	python-list@mail.python.org
X-Spam-Status	OK 0.008
X-Spam-Evidence	'H': 0.98; 'S': 0.00; 'encoding': 0.05; 'subject:Python': 0.06; 'utf-8': 0.07; 'subject:into': 0.09; 'cc:addr:python-list': 0.11; 'windows': 0.15; 'csv': 0.16; 'reasonably': 0.16; 'thanks,': 0.17; 'wrote:': 0.18; 'any,': 0.19; 'file,': 0.19; 'feb': 0.22; 'input': 0.22; 'cc:addr:python.org': 0.22; 'bytes': 0.24; 'skip': 0.24; 'cc:2**0': 0.24; 'defined': 0.27; 'header:In-Reply-To:1': 0.27; 'chris': 0.29; 'characters': 0.30; 'message-id:@mail.gmail.com': 0.30; 'file': 0.32; 'up.': 0.33; 'something': 0.35; 'but': 0.35; 'received:google.com': 0.35; 'should': 0.36; 'pm,': 0.38; 'sure': 0.39; 'helps': 0.61; 'show': 0.63; 'telling': 0.64; 'to:addr:gmail.com': 0.65; 'export': 0.74; '2015': 0.84
DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=N/3idxosSwHYWZNhV/IS6w1eE5hqjuPmeexAoh2WX6g=; b=cWfVB4i2pE3HCTvP11HBXumsZ3ykIjldc1NytBsSWJDJzHHLV/oRPlA2C3ze2Wu2kJ 9TMO7iqoQ3G0hCm92mmzFeYhggs1Ds19gjbPLamc+8iB9dDzb3l4/D5GA5/Tm8In0sqV //eifhnI+TK9DpMo/bmw2VB0UjD2rIXsiDi01iJ7n5PUb0+7Fchq4zkOKpu5zmE5aMfM fTPKiaj/yUKEz6XOKniay3ctDBJX1n7rhSnWs4otUB/5QAJZ77XxFSM/vu+SH2taS7fU m5ptrWE0DZlCt5appynr9XinD1slEXdMM0BBLUEsLXAd4y+WU4lJPy5KE8XLyaxZRxgg qxkA==
MIME-Version	1.0
X-Received	by 10.182.71.73 with SMTP id s9mr12728224obu.15.1423503041068; Mon, 09 Feb 2015 09:30:41 -0800 (PST)
In-Reply-To	<CAPTjJmpJV4KYcL50_=0hv+BLKaGX_X9wqQgMJeszMrHgAK+drA@mail.gmail.com>
References	<CANc-5UwYdoPLKuqRbrfbOrQTVafOaZmWZ+8SnDc-TZp1NEXcQg@mail.gmail.com> <CAPTjJmpJV4KYcL50_=0hv+BLKaGX_X9wqQgMJeszMrHgAK+drA@mail.gmail.com>
Date	Mon, 9 Feb 2015 11:30:41 -0600
Subject	Re: Python 3.x stuffing utf-8 into SQLite db
From	Skip Montanaro <skip.montanaro@gmail.com>
To	Chris Angelico <rosuav@gmail.com>
Content-Type	text/plain; charset=UTF-8
Cc	Python <python-list@python.org>
X-BeenThere	python-list@python.org
X-Mailman-Version	2.1.15
Precedence	list
List-Id	General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe	<https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-list/>
List-Post	<mailto:python-list@python.org>
List-Help	<mailto:python-list-request@python.org?subject=help>
List-Subscribe	<https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups	comp.lang.python
Message-ID	<mailman.18566.1423503049.18130.python-list@python.org> (permalink)
Lines	10
NNTP-Posting-Host	2001:888:2000:d::a6
X-Trace	1423503049 news.xs4all.nl 2858 [2001:888:2000:d::a6]:38789
X-Complaints-To	abuse@xs4all.nl
Xref	csiph.com comp.lang.python:85382

Show key headers only | View raw

On Sun, Feb 8, 2015 at 9:58 PM, Chris Angelico <rosuav@gmail.com> wrote:
> Those three characters are the CP-1252 decode of the bytes for U+2019
> in UTF-8 (E2 80 99). Not sure if that helps any, but given that it was
> an XLSX file, Windows codepages are reasonably likely to show up.

Thanks, Chris. Are you telling me I should have defined the input file
encoding for my CSV file as CP-1252, or that something got hosed on
the export from XLSX to CSV? Or something else?

Skip

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread

Thread

Re: Python 3.x stuffing utf-8 into SQLite db Skip Montanaro <skip.montanaro@gmail.com> - 2015-02-09 11:30 -0600

csiph-web