Path: csiph.com!x330-a1.tempe.blueboxinc.net!usenet.pasdenom.info!gegeweb.org!de-l.enfer-du-nord.net!feeder2.enfer-du-nord.net!feeder.news-service.com!newsfeed.xs4all.nl!newsfeed6.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
MIME-Version: 1.0
Sender: chris@rebertia.com
In-Reply-To: <D59C59453D0EDC43832490B6DADFAECF0432A193@XMB-RCD-214.cisco.com>
References: <20110808013500.7c9e30ff44caee0f0bbf988a@johnohagan.com> <D59C59453D0EDC43832490B6DADFAECF0432A191@XMB-RCD-214.cisco.com> <CAMZYqRSxAzLaea6aR0DNDnc-Jv3XWSPvo6cZdv4D0hcL5eeKTg@mail.gmail.com> <D59C59453D0EDC43832490B6DADFAECF0432A192@XMB-RCD-214.cisco.com> <CAMZYqRRbSmdJ5e66p7Tvi7-+X_Kpf4vjVhwr=YUkjo2WkPA-rA@mail.gmail.com> <D59C59453D0EDC43832490B6DADFAECF0432A193@XMB-RCD-214.cisco.com>
Date: Wed, 10 Aug 2011 00:36:18 -0700
Subject: Re: subprocess.Popen and thread module
From: Chris Rebert <clp2@rebertia.com>
To: "Danny Wong (dannwong)" <dannwong@cisco.com>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Cc: python-list@python.org
Precedence: list
Newsgroups: comp.lang.python
Message-ID: <mailman.2092.1312961781.1164.python-list@python.org>
Lines: 45
NNTP-Posting-Host: 2001:888:2000:d::a6
Xref: x330-a1.tempe.blueboxinc.net comp.lang.python:11101

> From: Chris Rebert <clp2@rebertia.com>
>> On Tue, Aug 9, 2011 at 11:38 PM, Danny Wong (dannwong)
>> <dannwong@cisco.com> wrote:
>>> Hi All,
>>> =C2=A0 I'm trying to execute some external commands from multiple datab=
ase.
>>> I'm using threads and subprocess.Popen ( from docs, all the popen*
>>> functions are deprecated and I was told to use subprocess.Popen) to
>>> execute the external commands in parallel, but the commands seems to
>>> hang.
>>
>> What's your Popen() call look like?
>
> On Tue, Aug 9, 2011 at 11:48 PM, Danny Wong (dannwong)
> <dannwong@cisco.com> wrote:
>> =C2=A0 =C2=A0try:
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0cmd_output =3D subprocess.Popen(['scm', 'load=
', '--force', '-r', nickname, '-d', directory, project], stdout=3Dsubproces=
s.PIPE, stderr=3Dsubprocess.PIPE)
>> =C2=A0 =C2=A0 =C2=A0 =C2=A0status =3D cmd_output.wait()
>
> Er, did you read the warning about Popen.wait() in the docs? (emphasis ad=
ded):

On Tue, Aug 9, 2011 at 11:56 PM, Danny Wong (dannwong)
<dannwong@cisco.com> wrote:
> I did read that portion of the doc, then I change it to communicate and i=
t still hangs. So I reverted back to "wait" while launching one thread to s=
ee if I could isolate the problem, but it still hangs regardless of using "=
wait" or "communicate".

Since you want to log the output to a file, have you tried:

logfile =3D open("path/to/file", 'r')
proc =3D subprocess.Popen(['scm', 'load', '--force', '-r', nickname,
'-d', directory, project], stdout=3Dlogfile, stderr=3Dsubprocess.STDOUT)
status =3D proc.wait()

or similar?

Cheers,
Chris
--
Damn Outlook/Exchange and its "On Behalf Of"!
http://rebertia.com