Path: csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!feeds.phibee-telecom.net!newsfeed.xs4all.nl!newsfeed2.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.043 X-Spam-Evidence: '*H*': 0.91; '*S*': 0.00; 'responding': 0.07; 'cc:addr:python-list': 0.11; 'chunks': 0.16; 'subject:Not': 0.16; 'wrote:': 0.18; 'wed,': 0.18; 'trying': 0.19; 'work,': 0.20; 'cc:addr:python.org': 0.22; 'text,': 0.24; 'cc:2**0': 0.24; 'cc:no real name:2**0': 0.24; 'header:In-Reply-To:1': 0.27; 'message- id:@mail.gmail.com': 0.30; "i'm": 0.30; 'lines': 0.31; '100000': 0.31; 'file': 0.32; 'problem': 0.35; 'subject:with': 0.35; 'received:google.com': 0.35; 'doing': 0.36; 'list.': 0.37; 'pm,': 0.38; 'how': 0.40; 'read': 0.60; 'new': 0.61; 'high': 0.63; 'love': 0.65; 'to:addr:gmail.com': 0.65 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=zFhV5CLgs8Dgp9msMMdTF79pD/narf9yULwi4+mFZBI=; b=TGeQVWRU/F6uIdmv+6cI5DDYlm+2etD0Njcl9tz865jO1w0XwpGYBJgXX4kga8MQlX B354mpzOSY6IKjNQD54YGd7yjrSjRzzE6wHaRKIr/pulQ/VVACB7YjDpLZFYnIzS4C1a 8TRO7GMqDiqB3ghrmsc5p0yXHhJgfZxbwlU6i9ZuF+FtnAPlzG6Ry6bCHJbsO8mpdhai 6ePzWhGypvpxzSKBI57dVgylUpYV9Iz8i94Z/XFhmnZTvPwoTvkzec79GNZJXScCkr6z Y1UnWdRpCXYvs4hlyahjLFYHkfTHtrzMrkvwLU9t/7K+uzsgKIY2FRKyQA7j9N756v4F D72w== MIME-Version: 1.0 X-Received: by 10.194.88.199 with SMTP id bi7mr6538185wjb.79.1403112970628; Wed, 18 Jun 2014 10:36:10 -0700 (PDT) In-Reply-To: <00d330e3-fc8a-4b7e-b2bd-f1a48bc335c1@googlegroups.com> References: <00d330e3-fc8a-4b7e-b2bd-f1a48bc335c1@googlegroups.com> Date: Wed, 18 Jun 2014 13:36:10 -0400 Subject: Re: Not Responding When Dealing with Large Data From: Philip Dexter To: cutey Love Content-Type: text/plain; charset=UTF-8 X-Mailman-Approved-At: Wed, 18 Jun 2014 20:22:36 +0200 Cc: python-list@python.org X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Newsgroups: comp.lang.python Message-ID: Lines: 9 NNTP-Posting-Host: 2001:888:2000:d::a6 X-Trace: 1403115758 news.xs4all.nl 2909 [2001:888:2000:d::a6]:57326 X-Complaints-To: abuse@xs4all.nl Xref: csiph.com comp.lang.python:73369 On Wed, Jun 18, 2014 at 1:20 PM, cutey Love wrote: > I'm trying to read in 100000 lines of text, use some functions to edit them and then return a new list. > > The problem is my program always goes not responding when the amount of lines are a high number. > > I don't care how long the program takes to work, just need it to stop crashing? What are you doing with the data? Try reading in the file chunks at a time