Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #73369

Re: Not Responding When Dealing with Large Data

Path csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!feeds.phibee-telecom.net!newsfeed.xs4all.nl!newsfeed2.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path <philip.dexter@gmail.com>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.043
X-Spam-Evidence '*H*': 0.91; '*S*': 0.00; 'responding': 0.07; 'cc:addr:python-list': 0.11; 'chunks': 0.16; 'subject:Not': 0.16; 'wrote:': 0.18; 'wed,': 0.18; 'trying': 0.19; 'work,': 0.20; 'cc:addr:python.org': 0.22; 'text,': 0.24; 'cc:2**0': 0.24; 'cc:no real name:2**0': 0.24; 'header:In-Reply-To:1': 0.27; 'message- id:@mail.gmail.com': 0.30; "i'm": 0.30; 'lines': 0.31; '100000': 0.31; 'file': 0.32; 'problem': 0.35; 'subject:with': 0.35; 'received:google.com': 0.35; 'doing': 0.36; 'list.': 0.37; 'pm,': 0.38; 'how': 0.40; 'read': 0.60; 'new': 0.61; 'high': 0.63; 'love': 0.65; 'to:addr:gmail.com': 0.65
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=zFhV5CLgs8Dgp9msMMdTF79pD/narf9yULwi4+mFZBI=; b=TGeQVWRU/F6uIdmv+6cI5DDYlm+2etD0Njcl9tz865jO1w0XwpGYBJgXX4kga8MQlX B354mpzOSY6IKjNQD54YGd7yjrSjRzzE6wHaRKIr/pulQ/VVACB7YjDpLZFYnIzS4C1a 8TRO7GMqDiqB3ghrmsc5p0yXHhJgfZxbwlU6i9ZuF+FtnAPlzG6Ry6bCHJbsO8mpdhai 6ePzWhGypvpxzSKBI57dVgylUpYV9Iz8i94Z/XFhmnZTvPwoTvkzec79GNZJXScCkr6z Y1UnWdRpCXYvs4hlyahjLFYHkfTHtrzMrkvwLU9t/7K+uzsgKIY2FRKyQA7j9N756v4F D72w==
MIME-Version 1.0
X-Received by 10.194.88.199 with SMTP id bi7mr6538185wjb.79.1403112970628; Wed, 18 Jun 2014 10:36:10 -0700 (PDT)
In-Reply-To <00d330e3-fc8a-4b7e-b2bd-f1a48bc335c1@googlegroups.com>
References <00d330e3-fc8a-4b7e-b2bd-f1a48bc335c1@googlegroups.com>
Date Wed, 18 Jun 2014 13:36:10 -0400
Subject Re: Not Responding When Dealing with Large Data
From Philip Dexter <philip.dexter@gmail.com>
To cutey Love <cuteywithlove@gmail.com>
Content-Type text/plain; charset=UTF-8
X-Mailman-Approved-At Wed, 18 Jun 2014 20:22:36 +0200
Cc python-list@python.org
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.15
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list/>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups comp.lang.python
Message-ID <mailman.11117.1403115758.18130.python-list@python.org> (permalink)
Lines 9
NNTP-Posting-Host 2001:888:2000:d::a6
X-Trace 1403115758 news.xs4all.nl 2909 [2001:888:2000:d::a6]:57326
X-Complaints-To abuse@xs4all.nl
Xref csiph.com comp.lang.python:73369

Show key headers only | View raw

On Wed, Jun 18, 2014 at 1:20 PM, cutey Love <cuteywithlove@gmail.com> wrote:
> I'm trying to read in 100000 lines of text, use some functions to edit them and then return a new list.
>
> The problem is my program always goes not responding when the amount of lines are a high number.
>
> I don't care how long the program takes to work, just need it to stop crashing?


What are you doing with the data? Try reading in the file chunks at a time

Back to comp.lang.python | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Not Responding When Dealing with Large Data cutey Love <cuteywithlove@gmail.com> - 2014-06-18 10:20 -0700
  Re: Not Responding When Dealing with Large Data Philip Dexter <philip.dexter@gmail.com> - 2014-06-18 13:36 -0400
  Re: Not Responding When Dealing with Large Data Tim <jtim.arnold@gmail.com> - 2014-06-18 11:37 -0700
  Re: Not Responding When Dealing with Large Data John Gordon <gordon@panix.com> - 2014-06-18 19:10 +0000
  Re: Not Responding When Dealing with Large Data Michael Torrie <torriem@gmail.com> - 2014-06-18 13:25 -0600
  Re: Not Responding When Dealing with Large Data Paul McNett <paul@mcnettware.com> - 2014-06-18 12:23 -0700
  Re: Not Responding When Dealing with Large Data cutey Love <cuteywithlove@gmail.com> - 2014-06-18 15:32 -0700
    Re: Not Responding When Dealing with Large Data Paul McNett <paul@mcnettware.com> - 2014-06-18 15:48 -0700
    Re: Not Responding When Dealing with Large Data Ian Kelly <ian.g.kelly@gmail.com> - 2014-06-18 17:06 -0600
      Re: Not Responding When Dealing with Large Data cutey Love <cuteywithlove@gmail.com> - 2014-06-19 01:17 -0700
        Re: Not Responding When Dealing with Large Data MRAB <python@mrabarnett.plus.com> - 2014-06-19 12:25 +0100
          Re: Not Responding When Dealing with Large Data Peter Pearson <ppearson@nowhere.invalid> - 2014-06-19 16:21 +0000
            Re: Not Responding When Dealing with Large Data MRAB <python@mrabarnett.plus.com> - 2014-06-19 17:54 +0100

csiph-web