Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #75358

Re: Load a CSV with different row lengths

Newsgroups comp.lang.python
Date 2014-07-29 22:00 -0700
References <CAKcMNB+pYdcETcCs=QEPhU-mLr3nwqX0T66_jT1zq-vgWGMeLg@mail.gmail.com> <CANc-5UxaZh6So8cy94FV17ic6MzFh0L5LZrk+3SZbyCPCtUUmQ@mail.gmail.com> <mailman.12416.1406639326.18130.python-list@python.org>
Message-ID <b0b596fc-1e4c-49da-80e6-7095edef9ceb@googlegroups.com> (permalink)
Subject Re: Load a CSV with different row lengths
From Miki Tebeka <miki.tebeka@gmail.com>

Show all headers | View raw

Greetings,

> I should've mentioned that I want to import my csv as a data frame or numpy array or as a table.
If you know the max length of a row, then you can do something like:
    def gen_rows(stream, max_length):
        for row in csv.reader(stream):
            yield row + ([None] * (max_length - len(line))

    max_length = 10
    with open('data.csv') as fo:
        df = pd.DataFrame.from_records(gen_rows(fo, max_length))


HTH,
Miki

Back to comp.lang.python | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Re: Load a CSV with different row lengths Ryan de Vera <ryan.devera.03@gmail.com> - 2014-07-29 09:08 -0400
  Re: Load a CSV with different row lengths Miki Tebeka <miki.tebeka@gmail.com> - 2014-07-29 22:00 -0700
    Re: Load a CSV with different row lengths Peter Otten <__peter__@web.de> - 2014-07-30 10:16 +0200

csiph-web