Path: csiph.com!fu-berlin.de!uni-berlin.de!not-for-mail
From: Chris Angelico <rosuav@gmail.com>
Newsgroups: comp.lang.python
Subject: Re: intermittent ValueErrors from subprocess
Date: Mon, 16 May 2016 08:59:19 +1000
Lines: 29
Message-ID: <mailman.6.1463353165.19823.python-list@python.org>
References: <57389A9D.1010205@gmail.com> <CAPTjJmp1H99HKmEarskE1b-ia0=KFDBTpfU+cWt6vVFeJtBHZg@mail.gmail.com> <5738F8E2.1030403@gmail.com> <CAPTjJmrNLFnvWOr=0D=WT3FJuZ1btFuLsxxrRaAF5M2D7GYtXg@mail.gmail.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=UTF-8
In-Reply-To: <5738F8E2.1030403@gmail.com>
Precedence: list
Xref: csiph.com comp.lang.python:108649

On Mon, May 16, 2016 at 8:32 AM, Pavlos Parissis
<pavlos.parissis@gmail.com> wrote:
>> Searching the CPython sources for that exception shows one hit:
>> selectors.py, where it converts a file object to an integer file
>> descriptor. (You could have helped out by showing us the full
>> traceback.)
>
> I did, https://gist.github.com/unixsurfer/67db620d87f667423f6f6e3a04e0bff5

Ah. I didn't click that link in your original post - didn't know it
was the traceback. Better would have been to at least say so; best
would have been to include it inline.

>> Is it possible you were running out of file descriptors,
>> or in some other way unable to create the pipe?
>
> I don't think as I see right now only 8 FDs:
>
> sudo ls -1 /proc/22706/fd|wc
>       8       8      16
>

If you can recreate the problem consistently, it would be worth
messing around with slightly lower level APIs - using subprocess.Popen
rather than check_output, for instance - and see what you can do
without the pipes. Somewhere, something's failing, and it's not easy
to see what.

ChrisA