Path: csiph.com!usenet.pasdenom.info!aioe.org!news.stack.nl!newsfeed.xs4all.nl!newsfeed2.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
To: python-list@python.org
From: Terry Reedy <tjreedy@udel.edu>
Subject: Re: Dealing with \r in CSV fields in Python2.4
Date: Wed, 04 Sep 2013 17:15:10 -0400
References: <20130904100403.163b42bd@bigbox.christie.dr>
Mime-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: quoted-printable
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:17.0) Gecko/20130801 Thunderbird/17.0.8
In-Reply-To: <20130904100403.163b42bd@bigbox.christie.dr>
Precedence: list
Newsgroups: comp.lang.python
Message-ID: <mailman.63.1378329325.5461.python-list@python.org>
Lines: 63
NNTP-Posting-Host: 2001:888:2000:d::a6
Xref: csiph.com comp.lang.python:53653

On 9/4/2013 11:04 AM, Tim Chase wrote:
> I've got some old 2.4 code (requires an external lib that hasn't been
> upgraded) that needs to process a CSV file where some of the values
> contain \r characters.  It appears that in more recent versions (just
> tested in 2.7; docs suggest this was changed in 2.5), Python does the
> Right Thing=E2=84=A2 and just creates values in the row containing that=
 \r.
> However, in 2.4, the csv module chokes on it with
>
>    _csv.Error: newline inside string
>
> as demoed by the example code at the bottom of this email.

While probably not necessary for this problem, one can use more that one =

Python version to solve a problem. For instance, You could use a current =

version to read the data and transform it so that it can be piped to 2.4 =

code running in a subprocess.

>  What's the
> best way to deal with this?  At the moment, I'm just using something
> like
>
>    def unCR(f):
>      for line in f:
>        yield line.replace('\r', '')
>
>    f =3D file('input.csv', 'rb')
>    for row in csv.reader(unCR(f)):
>      code_to_process(row)
>
> but this throws away data that I'd really prefer to keep if possible.
>
> I know 2.4 isn't exactly popular, and in an ideal world, I'd just
> upgrade to a later 2.x version that does what I need.  Any old-time
> 2.4 pythonistas have sage advice for me?
>
> -tkc
>
>
> from cStringIO import StringIO
> import csv
> f =3D file('out.txt', 'wb')
> w =3D csv.writer(f)
> w.writerow(["One", "Two"])
> w.writerow(["First\rSecond", "Third"])
> f.close()
>
> f =3D file('out.txt', 'rb')
> r =3D csv.reader(f)
> for i, row in enumerate(r): # works in 2.7, fails in 2.4
>      print repr(row)
> f.close()
>
>


--=20
Terry Jan Reedy