Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #31764

RE: Python does not take up available physical memory

Path csiph.com!usenet.pasdenom.info!weretis.net!feeder1.news.weretis.net!feeder.erje.net!newsfeed.xs4all.nl!newsfeed5.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path <ramit.prasad@jpmorgan.com>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.000
X-Spam-Evidence '*H*': 1.00; '*S*': 0.00; 'subject:Python': 0.05; 'memory.': 0.05; '(of': 0.07; 'completeness': 0.07; 'python': 0.09; 'available)': 0.09; 'received:155': 0.09; 'itself.': 0.11; 'subject:not': 0.11; 'disclaimers': 0.16; 'disclaimers,': 0.16; 'from:addr:jpmorgan.com': 0.16; 'received:155.180': 0.16; 'received:155.180.234': 0.16; 'received:155.180.234.122': 0.16; 'received:159.53': 0.16; 'received:159.53.110': 0.16; 'received:159.53.110.174': 0.16; 'received:bankone.net': 0.16; 'received:exchad.jpmchase.net': 0.16; 'received:jpmchase.com': 0.16; 'received:jpmchase.net': 0.16; 'received:se3.svr.bankone.net': 0.16; 'received:sj2.jpmchase.com': 0.16; 'received:svr.bankone.net': 0.16; 'securities,': 0.16; 'url:disclosures': 0.16; 'url:jpmorgan': 0.16; 'wrote:': 0.17; 'thanks,': 0.18; 'memory': 0.18; 'load': 0.19; 'to:name:python- list@python.org': 0.20; 'file.': 0.20; 'converted': 0.22; 'mention': 0.23; 'originally': 0.23; 'received:169.254': 0.24; 'tried': 0.25; 'least': 0.25; 'header:In-Reply-To:1': 0.25; 'accuracy': 0.27; 'noticed': 0.28; 'received:169': 0.29; 'that.': 0.30; 'error': 0.30; 'code': 0.31; 'file': 0.32; 'to:addr:python- list': 0.33; 'but': 0.36; 'charset:us-ascii': 0.36; 'data': 0.37; 'subject:: ': 0.38; 'object': 0.38; 'to:addr:python.org': 0.39; 'takes': 0.39; 'information,': 0.63; 'url:email': 0.63; 'more': 0.63; 'gave': 0.65; 'legal': 0.65; 'subject': 0.66; 'purchase': 0.67; 'physical': 0.69; 'sale': 0.76; 'received:169.254.8': 0.84; 'subject:available': 0.96
X-DKIM OpenDKIM Filter v2.1.3 sj2.jpmchase.com q9JJY7dh028864
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=jpmorgan.com; s=smtpout; t=1350675248; bh=JGzG8qclaBBx5ncr7ErfQ2fLHg55XJuozTRuQ7bzukU=; h=From:To:Subject:Date:Message-ID:References:In-Reply-To: Content-Transfer-Encoding:MIME-Version:Content-Type; b=eo+cj71vX8LW1XVgWD8ZGyxPuPb1oWj+upeCyhu5oHeFKUnIwAIfLQ+NtoxCdz42U A8vJRKycfNGR6C3v7WkjrIhjnSaYwWo+PSfpj9FHNA01ReekGAvrhUF3rUutmYqake /rU6uH9Y0SOM8yzCOx1EP9rLA23QvLCgF0D5ze4E=
From "Prasad, Ramit" <ramit.prasad@jpmorgan.com>
To "python-list@python.org" <python-list@python.org>
Subject RE: Python does not take up available physical memory
Thread-Topic Python does not take up available physical memory
Thread-Index Ac2uHGpaUb5JSqdJR1m8LKyDAm0X3wAk7LKA//87toCAAD8YsA==
Date Fri, 19 Oct 2012 19:33:46 +0000
References <76D03718A3233B4C8CC236C169B535B5A23E063E45@AUSP01VMBX08.collaborationhost.net> <k5s743$6jl$1@ger.gmane.org> <76D03718A3233B4C8CC236C169B535B5A23E063EB5@AUSP01VMBX08.collaborationhost.net>
In-Reply-To <76D03718A3233B4C8CC236C169B535B5A23E063EB5@AUSP01VMBX08.collaborationhost.net>
Accept-Language en-US
Content-Language en-US
X-MS-Has-Attach
X-MS-TNEF-Correlator
x-originating-ip [10.67.79.47]
Content-Transfer-Encoding quoted-printable
MIME-Version 1.0
X-DLP-FWD Yes
Content-Type text/plain; charset="us-ascii"
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.15
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <http://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list/>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <http://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups comp.lang.python
Message-ID <mailman.2530.1350675714.27098.python-list@python.org> (permalink)
Lines 13
NNTP-Posting-Host 2001:888:2000:d::a6
X-Trace 1350675714 news.xs4all.nl 6940 [2001:888:2000:d::a6]:37897
X-Complaints-To abuse@xs4all.nl
Xref csiph.com comp.lang.python:31764

Show key headers only | View raw


Pradipto Banerjee wrote:
> Thanks, I tried that. Still got MemoryError, but at least this time python tried to use the physical memory.
> What I noticed is that before it gave me the error it used up to 1.5GB (of the 2.23 GB originally showed as
> available) - so in general, python takes up more memory than the size of the file itself.


Of course it will. Python has to keep its own code in memory and 
load the file. Not to mention that the file is converted from data 
into a Python object with its own overhead.

Ramit Prasad


This email is confidential and subject to important disclaimers and
conditions including on offers for the purchase or sale of
securities, accuracy and completeness of information, viruses,
confidentiality, legal privilege, and legal entity disclaimers,
available at http://www.jpmorgan.com/pages/disclosures/email.  

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread


Thread

RE: Python does not take up available physical memory "Prasad, Ramit" <ramit.prasad@jpmorgan.com> - 2012-10-19 19:33 +0000

csiph-web