Path: csiph.com!news.swapon.de!fu-berlin.de!uni-berlin.de!not-for-mail
From: Pavlos Parissis <pavlos.parissis@gmail.com>
Newsgroups: comp.lang.python
Subject: intermittent ValueErrors from subprocess
Date: Sun, 15 May 2016 17:49:49 +0200
Lines: 103
Message-ID: <mailman.32.1463327394.2226.python-list@python.org>
References: <57389A9D.1010205@gmail.com>
Mime-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="NdDh6tjMhghA2dghThnpLE85d6ba1SjeK"
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Icedove/38.7.0
Precedence: list
Xref: csiph.com comp.lang.python:108639

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--NdDh6tjMhghA2dghThnpLE85d6ba1SjeK
Content-Type: multipart/mixed; boundary="6OUiEmRlAkcevUuu3M7lC4M3eBCHtgJ1k"
From: Pavlos Parissis <pavlos.parissis@gmail.com>
To: python-list@python.org
Message-ID: <57389A9D.1010205@gmail.com>
Subject: intermittent ValueErrors from subprocess

--6OUiEmRlAkcevUuu3M7lC4M3eBCHtgJ1k
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

Hi,

I get intermittent ValueErrors[1] from subprocess when I check if an IP
is assigned to loopback interface by running:

/sbin/ip address show dev lo to 10.52.12.2/32

I use subprocess.check_output like this:

cmd =3D [
    '/sbin/ip',
    'address',
    'show',
    'dev',
    "{}".format(self.config['interface']),
    'to',
    "{}".format(self.config['ip_prefix']),
]

try:
    out =3D subprocess.check_output(
        cmd,
        universal_newlines=3DTrue,
        timeout=3D1)
except subprocess.CalledProcessError as error:
    return True
except subprocess.TimeoutExpired:
    return True
else:
    if self.config['ip_prefix'] in out:
        return True
    else:
        return False


and I get the following exception:

ValueError: Invalid file object: <_io.TextIOWrapper name=3D11
encoding=3D'UTF-8'>

As a consequence of the raised exception thread dies and I now catch
ValueError in the same try block in order to avoid the crash.

It has happened ~5 times and this code is executed from multiple
threads and every ~10secs on several(~40) systems for more than
18months. So, it is quite impossible for me to reproduce it.
It could be that the system returns corrupted data or python fails for
some unknown reason to parse the output.

The program uses Python 3.4.4 and runs on Debian stable and CentOS 6/7.

The full code path in question can be found here:
https://github.com/unixsurfer/anycast_healthchecker/blob/master/anycast_h=
ealthchecker/servicecheck.py#L90

I did a search on bugs.python.org about it but I didn't find anything.

Has anyone seen this behavior before?

Cheers,
Pavlos

[1] https://gist.github.com/unixsurfer/67db620d87f667423f6f6e3a04e0bff5


--6OUiEmRlAkcevUuu3M7lC4M3eBCHtgJ1k--

--NdDh6tjMhghA2dghThnpLE85d6ba1SjeK
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQIcBAEBCAAGBQJXOJqeAAoJEIP8ktofcXa58RIQAKcYGnkUoIE5rhBlQeC4Ge17
qJSikGUu0DqFKDXbTDSxS34ng8OzHVK32E4S+ZlC+gQKaL36waHNdG51qvAfZW3y
C+pdcj0iPR4CjJYB4oECSxdhCnZXy3Mev6YpOowb05d7qtnZzvZNITGuiffjj3+D
FmbDr4Jha+GLOVnPTScVaVVZKEx1eaA/HV6rL4OShWiK99M7Xtd3le2zCLKAJcT0
R/8CpIajqfPphfQN26Ef5qTiFEwgOHBEl9W5HBUXUAfcEIfU8HpyQFJVzTNU6cRy
A8+daEOxJTEOiuF91VMFv5n44UVwcz1vXwXpQKKaA+nZfedb4aan8rI0gzHsV0Ly
cqEuiNE89NrTVy5bgnTAWGtvWvXUc6HQeqTDnqZLcImwZITZI564D1NUekALgW3X
zviVCpxfKmcSJD0msQNg54ZdOl0tg964ISNYVC05DCpQPCoXjTMgPH8M/Ec/Ycoy
yydU3dUS1PuATYBvtUBk7R8c4wtmDaEXZuYCwCzJLR9jYfDEV4kiIi0plwJONUGy
Z6eVh1FlmoskctRGL5K6ZNimWbB4fVJ4rbIpMF/UFrjKX5Mu6qiHQZydU/0CMljA
bSnDqWLFgiyZ0z4jsrMmDn+wXHL7mI7capYY4vvBfuXLIjA3bOlzU/QPFSMkgWno
H5rs8+g8QnC/XkYU0a8B
=pGdX
-----END PGP SIGNATURE-----

--NdDh6tjMhghA2dghThnpLE85d6ba1SjeK--