getting fileinput to do errors='ignore' or 'replace'?

Path	csiph.com!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From	Adam Funk <a24061@ducksburg.com>
Newsgroups	comp.lang.python
Subject	getting fileinput to do errors='ignore' or 'replace'?
Date	Thu, 03 Dec 2015 15:12:15 +0000
Organization	$CABAL
Lines	19
Message-ID	<fn26jcxltl.ln2@news.ducksburg.com> (permalink)
X-Trace	individual.net 3UPpRIRS1LNY8ylP1gnCQgd2jy70eUjv+GEVIsCJmIJd747sBO
X-Orig-Path	news.ducksburg.com!not-for-mail
Cancel-Lock	sha1:XAaUGjGiL+WKBDJCY9G/wyFf18k= sha1:d7/w6Gys0ihBgV+jf7AoutuW3/k=
User-Agent	slrn/pre1.0.3-5 (Linux)
Xref	csiph.com comp.lang.python:99961

Show key headers only | View raw

I'm having trouble with some input files that are almost all proper
UTF-8 but with a couple of troublesome characters mixed in, which I'd
like to ignore instead of throwing ValueError.  I've found the
openhook for the encoding

for line in fileinput.input(options.files, openhook=fileinput.hook_encoded("utf-8")):
    do_stuff(line)

which the documentation describes as "a hook which opens each file
with codecs.open(), using the given encoding to read the file", but
I'd like codecs.open() to also have the errors='ignore' or
errors='replace' effect.  Is it possible to do this?

Thanks.


-- 
Why is it drug addicts and computer afficionados are both 
called users?                          --- Clifford Stoll

Back to comp.lang.python | Previous | Next — Next in thread | Find similar | Unroll thread

Thread

getting fileinput to do errors='ignore' or 'replace'? Adam Funk <a24061@ducksburg.com> - 2015-12-03 15:12 +0000
  Re: getting fileinput to do errors='ignore' or 'replace'? Adam Funk <a24061@ducksburg.com> - 2015-12-03 15:18 +0000
    Re: getting fileinput to do errors='ignore' or 'replace'? Peter Otten <__peter__@web.de> - 2015-12-03 17:11 +0100
      Re: getting fileinput to do errors='ignore' or 'replace'? Adam Funk <a24061@ducksburg.com> - 2015-12-03 19:17 +0000
    Re: getting fileinput to do errors='ignore' or 'replace'? Terry Reedy <tjreedy@udel.edu> - 2015-12-03 11:48 -0500
      Re: getting fileinput to do errors='ignore' or 'replace'? Adam Funk <a24061@ducksburg.com> - 2015-12-03 19:21 +0000
    Re: getting fileinput to do errors='ignore' or 'replace'? Oscar Benjamin <oscar.j.benjamin@gmail.com> - 2015-12-03 22:26 +0000
    Re: getting fileinput to do errors='ignore' or 'replace'? Serhiy Storchaka <storchaka@gmail.com> - 2015-12-04 10:34 +0200
    Re: getting fileinput to do errors='ignore' or 'replace'? Oscar Benjamin <oscar.j.benjamin@gmail.com> - 2015-12-04 09:00 +0000
      Re: getting fileinput to do errors='ignore' or 'replace'? Adam Funk <a24061@ducksburg.com> - 2015-12-07 14:46 +0000
  Re: getting fileinput to do errors='ignore' or 'replace'? MRAB <python@mrabarnett.plus.com> - 2015-12-03 16:12 +0000
  Re: getting fileinput to do errors='ignore' or 'replace'? Laura Creighton <lac@openend.se> - 2015-12-03 17:46 +0100
    Re: getting fileinput to do errors='ignore' or 'replace'? Adam Funk <a24061@ducksburg.com> - 2015-12-03 19:17 +0000
      Re: getting fileinput to do errors='ignore' or 'replace'? Laura Creighton <lac@openend.se> - 2015-12-03 21:40 +0100

csiph-web