Path: csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!news.albasani.net!rt.uk.eu.org!newsfeed.xs4all.nl!newsfeed4.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.161 X-Spam-Level: * X-Spam-Evidence: '*H*': 0.69; '*S*': 0.01; 'subject:files': 0.09; 'subject:How': 0.10; 'cc:addr:python-list': 0.11; 'csv': 0.16; 'wrote:': 0.18; 'memory': 0.22; 'cc:addr:python.org': 0.22; 'cc:2**0': 0.24; "i've": 0.25; 'header:In-Reply-To:1': 0.27; 'am,': 0.29; 'url:mailman': 0.30; 'pickle': 0.31; 'file': 0.32; 'stuff': 0.32; 'url:python': 0.33; 'accessing': 0.36; 'url:listinfo': 0.36; 'useful': 0.36; 'charset:us-ascii': 0.36; 'subject:?': 0.36; 'url:org': 0.36; 'received:10': 0.37; 'thank': 0.38; 'url:mail': 0.40; 'read': 0.60; 'simply': 0.61; 'you.': 0.62; 'header:Message-Id:1': 0.63; 'to:addr:gmail.com': 0.65; 'again?': 0.84; 'oct.': 0.84; '2013,': 0.91; 'why?': 0.91 References: <0044bfd0-f07f-4f7b-b976-5df034b6fec6@googlegroups.com> Mime-Version: 1.0 (1.0) In-Reply-To: <0044bfd0-f07f-4f7b-b976-5df034b6fec6@googlegroups.com> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Mailer: iPhone Mail (11A501) From: Stephane Wirtel Subject: Re: How pickle helps in reading huge files? Date: Wed, 16 Oct 2013 09:05:42 +0200 To: Harsh Jha Cc: "python-list@python.org" X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Newsgroups: comp.lang.python Message-ID: Lines: 12 NNTP-Posting-Host: 2001:888:2000:d::a6 X-Trace: 1381907510 news.xs4all.nl 15935 [2001:888:2000:d::a6]:53656 X-Complaints-To: abuse@xs4all.nl Xref: csiph.com comp.lang.python:56872 Keep it in memory=20 > On 16 oct. 2013, at 08:55 AM, Harsh Jha wrote: >=20 > I've a huge csv file and I want to read stuff from it again and again. Is i= t useful to pickle it and keep and then unpickle it whenever I need to use t= hat data? Is it faster that accessing that file simply by opening it again a= nd again? Please explain, why? >=20 > Thank you. > --=20 > https://mail.python.org/mailman/listinfo/python-list