Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #67897

Re: script uses up all memory

Path csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!newsfeed.xs4all.nl!newsfeed3.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
Return-Path <larry.martell@gmail.com>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.072
X-Spam-Evidence '*H*': 0.86; '*S*': 0.00; 'memory.': 0.07; 'subject:script': 0.09; 'reproduce': 0.16; 'wrote:': 0.18; 'wed,': 0.18; 'thu,': 0.19; 'memory': 0.22; 'to:name:python- list@python.org': 0.22; 'script.': 0.24; 'environment': 0.24; "i've": 0.25; 'script': 0.25; 'post': 0.26; 'header:In-Reply- To:1': 0.27; 'chris': 0.29; 'am,': 0.29; 'message- id:@mail.gmail.com': 0.30; 'larry': 0.31; 'this.': 0.32; 'subject:all': 0.32; 'running': 0.33; 'problem': 0.35; 'no,': 0.35; 'received:google.com': 0.35; 'version': 0.36; "didn't": 0.36; "i'll": 0.36; 'effort': 0.37; 'to:addr:python-list': 0.38; 'pm,': 0.38; 'rather': 0.38; 'anything': 0.39; 'does': 0.39; 'to:addr:python.org': 0.39; 'days': 0.60; 'simply': 0.61; 'here': 0.66; 'mar': 0.68; 'forks': 0.84; 'messed': 0.84
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=ctx7w/i0qsBtZC2+BvNKoSVZi++WeDgofJdlvgUGqx4=; b=ozbXmzvrI+WSLKmGjAOGVJKLlm22TNFcnUYOKVepFD0ZR67V87eRXplq61dBYTc+YH nv/gOFuLYHeY8rU4mb2oz5jfQUAAEszNiqYZBV+ZjiTZPkl/mspt17wsD3f5oscfdw15 m7Vu3zPMhbTo8tLV4wVvw3K/nmNSzZ8Gc/XHXho88v17/L1HfmHZttWK0YRS7i9VZXHc ynLm56ynXqEAlMhTRo/yGeWKxSQVYoRWA216Moh1/nFZ6Aug7sdyKc9lrfV3RwtIY8NY SzIazQPHh+9vb583t9jkrHDuSIv6kJfl10fevjJlH5+4zaT345DDQ76wanPecMVbQ7EM CIEA==
MIME-Version 1.0
X-Received by 10.194.61.114 with SMTP id o18mr5453554wjr.6.1394065214020; Wed, 05 Mar 2014 16:20:14 -0800 (PST)
In-Reply-To <CAPTjJmpzpVC-aDX36mQfnLLOPMrrkkaW7tTo=yYJ0bu1XsrPxA@mail.gmail.com>
References <CACwCsY65gpn_Zx78wquE-rmrZu10pu9GYbzWd-Y3ypzHsMb2Yw@mail.gmail.com> <CAPTjJmpzpVC-aDX36mQfnLLOPMrrkkaW7tTo=yYJ0bu1XsrPxA@mail.gmail.com>
Date Wed, 5 Mar 2014 19:20:13 -0500
Subject Re: script uses up all memory
From Larry Martell <larry.martell@gmail.com>
To "python-list@python.org" <python-list@python.org>
Content-Type text/plain; charset=UTF-8
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.15
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list/>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups comp.lang.python
Message-ID <mailman.7851.1394065648.18130.python-list@python.org> (permalink)
Lines 26
NNTP-Posting-Host 2001:888:2000:d::a6
X-Trace 1394065648 news.xs4all.nl 2909 [2001:888:2000:d::a6]:59817
X-Complaints-To abuse@xs4all.nl
Xref csiph.com comp.lang.python:67897

Show key headers only | View raw


On Wed, Mar 5, 2014 at 5:39 PM, Chris Angelico <rosuav@gmail.com> wrote:
> On Thu, Mar 6, 2014 at 9:27 AM, Larry Martell <larry.martell@gmail.com> wrote:
>> I have a script that forks off other processes and attempts to manage
>> them. Here is a stripped down version of the script:
>>
>>         self.sleepTime = 300
>
> That's not a stand-alone script.

No, that is just the part that does the work (inside the 'while
true'). I'll try and post a standalone script tomorrow.

> What environment is it running in?

CentOS 6,4

> Can you reproduce the problem outside of that environment?

I will try that tomorrow.

> Also: Can you simply use multiprocessing rather than going through all
> the effort of subprocess.Popen?

Perhaps. I didn't write this. A client gave it to me and said 'figure
out why it uses up all the memory and hangs.' I've messed around with
for days and cannot see anything that would consume so much memory.

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread


Thread

Re: script uses up all memory Larry Martell <larry.martell@gmail.com> - 2014-03-05 19:20 -0500

csiph-web