Path: csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!newsfeed.xs4all.nl!newsfeed3.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
Return-Path: <larry.martell@gmail.com>
X-Original-To: python-list@python.org
Delivered-To: python-list@mail.python.org
X-Spam-Status: OK 0.072
X-Spam-Evidence: '*H*': 0.86; '*S*': 0.00; 'memory.': 0.07; 'subject:script': 0.09; 'reproduce': 0.16; 'wrote:': 0.18; 'wed,': 0.18; 'thu,': 0.19; 'memory': 0.22; 'to:name:python- list@python.org': 0.22; 'script.': 0.24; 'environment': 0.24; "i've": 0.25; 'script': 0.25; 'post': 0.26; 'header:In-Reply- To:1': 0.27; 'chris': 0.29; 'am,': 0.29; 'message- id:@mail.gmail.com': 0.30; 'larry': 0.31; 'this.': 0.32; 'subject:all': 0.32; 'running': 0.33; 'problem': 0.35; 'no,': 0.35; 'received:google.com': 0.35; 'version': 0.36; "didn't": 0.36; "i'll": 0.36; 'effort': 0.37; 'to:addr:python-list': 0.38; 'pm,': 0.38; 'rather': 0.38; 'anything': 0.39; 'does': 0.39; 'to:addr:python.org': 0.39; 'days': 0.60; 'simply': 0.61; 'here': 0.66; 'mar': 0.68; 'forks': 0.84; 'messed': 0.84
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=ctx7w/i0qsBtZC2+BvNKoSVZi++WeDgofJdlvgUGqx4=; b=ozbXmzvrI+WSLKmGjAOGVJKLlm22TNFcnUYOKVepFD0ZR67V87eRXplq61dBYTc+YH nv/gOFuLYHeY8rU4mb2oz5jfQUAAEszNiqYZBV+ZjiTZPkl/mspt17wsD3f5oscfdw15 m7Vu3zPMhbTo8tLV4wVvw3K/nmNSzZ8Gc/XHXho88v17/L1HfmHZttWK0YRS7i9VZXHc ynLm56ynXqEAlMhTRo/yGeWKxSQVYoRWA216Moh1/nFZ6Aug7sdyKc9lrfV3RwtIY8NY SzIazQPHh+9vb583t9jkrHDuSIv6kJfl10fevjJlH5+4zaT345DDQ76wanPecMVbQ7EM CIEA==
MIME-Version: 1.0
X-Received: by 10.194.61.114 with SMTP id o18mr5453554wjr.6.1394065214020; Wed, 05 Mar 2014 16:20:14 -0800 (PST)
In-Reply-To: <CAPTjJmpzpVC-aDX36mQfnLLOPMrrkkaW7tTo=yYJ0bu1XsrPxA@mail.gmail.com>
References: <CACwCsY65gpn_Zx78wquE-rmrZu10pu9GYbzWd-Y3ypzHsMb2Yw@mail.gmail.com> <CAPTjJmpzpVC-aDX36mQfnLLOPMrrkkaW7tTo=yYJ0bu1XsrPxA@mail.gmail.com>
Date: Wed, 5 Mar 2014 19:20:13 -0500
Subject: Re: script uses up all memory
From: Larry Martell <larry.martell@gmail.com>
To: "python-list@python.org" <python-list@python.org>
Content-Type: text/plain; charset=UTF-8
X-BeenThere: python-list@python.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe: <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive: <http://mail.python.org/pipermail/python-list/>
List-Post: <mailto:python-list@python.org>
List-Help: <mailto:python-list-request@python.org?subject=help>
List-Subscribe: <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups: comp.lang.python
Message-ID: <mailman.7851.1394065648.18130.python-list@python.org>
Lines: 26
NNTP-Posting-Host: 2001:888:2000:d::a6
X-Trace: 1394065648 news.xs4all.nl 2909 [2001:888:2000:d::a6]:59817
X-Complaints-To: abuse@xs4all.nl
Xref: csiph.com comp.lang.python:67897

On Wed, Mar 5, 2014 at 5:39 PM, Chris Angelico <rosuav@gmail.com> wrote:
> On Thu, Mar 6, 2014 at 9:27 AM, Larry Martell <larry.martell@gmail.com> wrote:
>> I have a script that forks off other processes and attempts to manage
>> them. Here is a stripped down version of the script:
>>
>>         self.sleepTime = 300
>
> That's not a stand-alone script.

No, that is just the part that does the work (inside the 'while
true'). I'll try and post a standalone script tomorrow.

> What environment is it running in?

CentOS 6,4

> Can you reproduce the problem outside of that environment?

I will try that tomorrow.

> Also: Can you simply use multiprocessing rather than going through all
> the effort of subprocess.Popen?

Perhaps. I didn't write this. A client gave it to me and said 'figure
out why it uses up all the memory and hangs.' I've messed around with
for days and cannot see anything that would consume so much memory.