Groups > linux.debian.maint.python > #13141

Re: gotchas when running tests via pybuild?

From	Thomas Goirand <zigo@debian.org>
Newsgroups	linux.debian.maint.python
Subject	Re: gotchas when running tests via pybuild?
Date	2021-01-24 11:30 +0100
Message-ID	<BAKOC-1xA-9@gated-at.bofh.it> (permalink)
References	<BA8gh-3Cp-1@gated-at.bofh.it>
Organization	Debian

Show all headers | View raw

On 1/22/21 6:06 PM, Antonio Terceiro wrote:
> Hi,
> 
> I'm working on python-eventlet, to fix a FTBFS bug and an
> incompatibility with python3.9. I got both fixes ready, but I'm not
> fighting with the fact that the test suite fails randomly. In my
> experiments, the test suite fails ~40% of the time, but *only when run
> during the build* (!!).
> 
> - I added a testsuite run to autopkgtest, and it consistently passes,
>   100% of the time.
> - If I run the same command as pybuild runs manually (python3 -m nose)
>   on a fully patched tree, it passes 100% of the time.
> - Only during the build -- when executed automatically by pybuild -- the
>   test fails ~40% of the time.
> 
> The failures are the typical failures you get when testing concurrency
> code: timeouts, race conditions, etc, and it happens on different tests
> every time. What I don't quite understand yet is why this _only_ happens
> during the Debian package build.
> 
> I already checked that the tests don't use anything else from the source
> tree beyond the tests themselves and the python modules. For example the
> autopkgtest copies tests/, and only it, to a temp directory and runs the
> tests from there; and works every time. So in principle I wouldn't need
> to have an explicit testfiles file.
> 
> Does anybody have an insight on cases like this? Are there any details
> that I'm missing?
> 
> If anyone wants to try it, the git repository is up to date.

Hi,

Eventlet looks broken beyond just the unit tests. I did a deployment of
OpenStack on unstable, and there's lots of issues on absolutely all
daemons. Hopefully, I can fine time to investigate this next week.

Cheers,

Thomas Goirand (zigo)

Back to linux.debian.maint.python | Previous | Next — Previous in thread | Find similar | Unroll thread

Thread

gotchas when running tests via pybuild? Antonio Terceiro <terceiro@debian.org> - 2021-01-22 18:20 +0100
  Re: gotchas when running tests via pybuild? Diane Trout <diane@ghic.org> - 2021-01-22 20:10 +0100
  Re: gotchas when running tests via pybuild? Thomas Goirand <zigo@debian.org> - 2021-01-24 11:30 +0100

csiph-web