Path: csiph.com!usenet.pasdenom.info!aioe.org!news.stack.nl!newsfeed.xs4all.nl!newsfeed1.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
Date: Wed, 4 Sep 2013 10:41:17 -0500
From: Tim Chase <python.list@tim.thechases.com>
To: python-list@python.org
Subject: Re: Dealing with \r in CSV fields in Python2.4
In-Reply-To: <5227523A.7040900@mrabarnett.plus.com>
References: <20130904100403.163b42bd@bigbox.christie.dr> <5227523A.7040900@mrabarnett.plus.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Precedence: list
Newsgroups: comp.lang.python
Message-ID: <mailman.50.1378309209.5461.python-list@python.org>
Lines: 34
NNTP-Posting-Host: 2001:888:2000:d::a6
Xref: csiph.com comp.lang.python:53633

On 2013-09-04 16:31, MRAB wrote:
> You could try replacing the '\r' with another character that doesn't
> appear elsewhere and then change it back afterwards.
> 
> MARKER = '\x01'
> 
> def cr_to_marker(f):
>      for line in f:
>          yield line.replace('\r', MARKER)
> 
> def marker_to_cr(item):
>      return item.replace(MARKER, '\r')
> 
> f = file('out.txt', 'rb')
> r = csv.reader(cr_to_marker(f))
> for i, row in enumerate(r): # works in 2.7, fails in 2.4
>      row = [marker_to_cr(item) for item in row]
>      print repr(row)
> f.close()

This works pretty well.  I'm not sure if there's a grave performance
penalty for mucking with strings so much, but at this point my
Care-o-Meter is barely registering, as long as it works.

> Which OS are you using? On Windows the lines (rows) end with
> '\r\n', so the last item of each row will end with '\r', which
> you'll need to strip off. (That would be a problem only if the last
> item of a row could end with '\r'.)

It's on Win32.

-tkc