Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.soft-sys.math.mathematica > #9172

Problems reading text files with embedded delimiters

From Mark Coleman <markspcoleman@gmail.com>
Newsgroups comp.soft-sys.math.mathematica
Subject Problems reading text files with embedded delimiters
Date 2012-03-20 07:26 +0000
Organization Steven M. Christensen and Associates, Inc and MathTensor, Inc.
Message-ID <jk9bfb$bo1$1@smc.vnet.net> (permalink)

Show all headers | View raw


Hi,

I'm struggling with importing a large flat file into Mathematica. The file,
which was pulled off one of my company's legacy mainframe systems,
contains about 100 fields and several million rows, including a mix of
dates, reals, and text. The fields are delimited by commas.

One of the text fields, however, is quite large and contains commas,
line feeds, carriage returns, etc -- lots of characters commonly used
as delimiters. It is also a variable length field. There does not seem
to be anything characters within the field that would allow the
specification of a simple delimiter. I've tried the default Import[]
command as well as various permutations of ReadList[] using Record,
Word, and String specifications.

I'm wondering if anyone could suggest an approach that would allow me
to read this file. More precisely, is there a way to avoid reading
characters embedded in the large text field that Mathematica thinks are field
delimiters?

Thanks,

Mark

Back to comp.soft-sys.math.mathematica | Previous | Next — Next in thread | Find similar | Unroll thread


Thread

Problems reading text files with embedded delimiters Mark Coleman <markspcoleman@gmail.com> - 2012-03-20 07:26 +0000
  Re: Problems reading text files with embedded delimiters Rodrigo Murta <murta@rodrigomurta.com> - 2012-03-21 10:50 +0000
  Re: Problems reading text files with embedded delimiters David Reiss <dbreiss@gmail.com> - 2012-03-22 10:48 +0000

csiph-web