Groups > linux.debian.maint.python > #13141

Re: gotchas when running tests via pybuild?

Path	csiph.com!newsfeed.xs4all.nl!newsfeed7.news.xs4all.nl!3.eu.feeder.erje.net!feeder.erje.net!news2.arglkargh.de!news.mixmin.net!aioe.org!bofh.it!news.nic.it!robomod
From	Thomas Goirand <zigo@debian.org>
Newsgroups	linux.debian.maint.python
Subject	Re: gotchas when running tests via pybuild?
Date	Sun, 24 Jan 2021 11:30:02 +0100
Message-ID	<BAKOC-1xA-9@gated-at.bofh.it> (permalink)
References	<BA8gh-3Cp-1@gated-at.bofh.it>
X-Mailbox-Line	From debian-python-request@lists.debian.org Sun Jan 24 10:26:11 2021
Old-Return-Path	<zigo@debian.org>
X-Amavis-Spam-Status	No, score=-9.729 tagged_above=-10000 required=5.3 tests=[BAYES_00=-2, LDO_WHITELIST=-5, MURPHY_DRUGS_REL8=0.02, NICE_REPLY_A=-2.749] autolearn=ham autolearn_force=no
X-Policyd-Weight	using cached result; rate: -3.5
Organization	Debian
User-Agent	Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.6.0
MIME-Version	1.0
Content-Type	text/plain; charset=windows-1252
Content-Language	en-US
Content-Transfer-Encoding	quoted-printable
X-Mailing-List	<debian-python@lists.debian.org> archive/latest/18918
List-ID	<debian-python.lists.debian.org>
List-URL	<https://lists.debian.org/debian-python/>
List-Archive	https://lists.debian.org/msgid-search/8ef938f4-3b2a-cff7-5464-e36b5688fca5@debian.org
Approved	robomod@news.nic.it
Lines	46
Sender	robomod@news.nic.it
X-Original-Date	Sun, 24 Jan 2021 11:25:53 +0100
X-Original-Message-ID	<8ef938f4-3b2a-cff7-5464-e36b5688fca5@debian.org>
X-Original-References	<YAsGDm7sRWBOgmmu@debian.org>
Xref	csiph.com linux.debian.maint.python:13141

Show key headers only | View raw

On 1/22/21 6:06 PM, Antonio Terceiro wrote:
> Hi,
> 
> I'm working on python-eventlet, to fix a FTBFS bug and an
> incompatibility with python3.9. I got both fixes ready, but I'm not
> fighting with the fact that the test suite fails randomly. In my
> experiments, the test suite fails ~40% of the time, but *only when run
> during the build* (!!).
> 
> - I added a testsuite run to autopkgtest, and it consistently passes,
>   100% of the time.
> - If I run the same command as pybuild runs manually (python3 -m nose)
>   on a fully patched tree, it passes 100% of the time.
> - Only during the build -- when executed automatically by pybuild -- the
>   test fails ~40% of the time.
> 
> The failures are the typical failures you get when testing concurrency
> code: timeouts, race conditions, etc, and it happens on different tests
> every time. What I don't quite understand yet is why this _only_ happens
> during the Debian package build.
> 
> I already checked that the tests don't use anything else from the source
> tree beyond the tests themselves and the python modules. For example the
> autopkgtest copies tests/, and only it, to a temp directory and runs the
> tests from there; and works every time. So in principle I wouldn't need
> to have an explicit testfiles file.
> 
> Does anybody have an insight on cases like this? Are there any details
> that I'm missing?
> 
> If anyone wants to try it, the git repository is up to date.

Hi,

Eventlet looks broken beyond just the unit tests. I did a deployment of
OpenStack on unstable, and there's lots of issues on absolutely all
daemons. Hopefully, I can fine time to investigate this next week.

Cheers,

Thomas Goirand (zigo)

Back to linux.debian.maint.python | Previous | Next — Previous in thread | Find similar | Unroll thread

Thread

gotchas when running tests via pybuild? Antonio Terceiro <terceiro@debian.org> - 2021-01-22 18:20 +0100
  Re: gotchas when running tests via pybuild? Diane Trout <diane@ghic.org> - 2021-01-22 20:10 +0100
  Re: gotchas when running tests via pybuild? Thomas Goirand <zigo@debian.org> - 2021-01-24 11:30 +0100

csiph-web