Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.maint.python > #16516

Re: Correct command to skip multiple tests in autopkgtest?

Show all headers | View raw

[Multipart message — attachments visible in raw view] - view raw

On Friday, November 1, 2024 4:03:45 PM MST Soren Stoutner wrote:
> I am in the process of packaging pyinstaller.
> 
> https://pypi.org/project/pyinstaller/
> 
> Many of pyinstaller’s tests require the pyinstaller-hooks-contrib package,
> which I am also in the process of packaging.
> 
> https://pypi.org/project/pyinstaller-hooks-contrib/
> 
> But pyinstaller-hooks-contrib depends on pyinstaller for its tests.
> 
> In order to bootstrap the introduction of these packages into Debian, I am
> temporarily disabling the pyinstaller tests that depend on pyinstaller-
hooks-
> contrib using the following command in debian/rules:
> 
> export PYBUILD_TEST_ARGS=-k\
> 	'not test_find_module\
> 	and not test_metadata_searching\
> 	and not test_Qt_QTranslate\
> 	and not test_zeep\
> 	and not test_scapy3\
> 	and not test_zope_interface\
> 	and not test_gevent\
> 	and not test_user_preferred_locale\
> 	and not test_pytz'
> 
> This works successfully during the build process:
> 
> 1004 passed, 286 skipped, 25 deselected, 24 xfailed, 1 xpassed, 17 warnings 
in
> 6969.97s (1:56:09)
> 
> https://salsa.debian.org/soren/python-pyinstaller/-/jobs/6514811#L6635
> 
> But, for some reason, autopkgtest doesn’t like the format of the arguments.
> 
> I: pybuild base:311: cd /tmp/autopkgtest-lxc.ntf_swjm/downtmp/
autopkgtest_tmp/
> build; python3.12 -m pytest -k 'not test_find_module and not
> test_metadata_searching and not test_Qt_QTranslate and not test_zeep and not
> test_scapy3 and not test_zope_interface and not test_gevent and not
> test_user_preferred_locale and not test_pytz'
> usage: __main__.py [-h] [--link-only] {samedir,subdir,parentdir}
> __main__.py: error: argument test_type: invalid choice: 'not test_find_module
> and not test_metadata_searching and not test_Qt_QTranslate and not test_zeep
> and not test_scapy3 and not test_zope_interface and not test_gevent and not
> test_user_preferred_locale and not test_pytz' (choose from 'samedir',
> 'subdir', ‘parentdir’)
> 
> https://salsa.debian.org/soren/python-pyinstaller/-/jobs/6514819#L781
> 
> I have tried several syntax variations without success.  Does anyone know 
the
> correct syntax for skipping several tests in autopgktest?

In the case of PyInstaller, the answer ended up being to not use `Testsuite: 
autopkgtest-pkg-pybuild` and instead call the tests manually using debian/
tests/control.

https://salsa.debian.org/soren/python-pyinstaller/-/blob/main/debian/tests/
control?ref_type=heads

Although there are some further errors to investigate, this at least allowed 
the tests to run.

https://salsa.debian.org/soren/python-pyinstaller/-/pipelines/772011

I am uncertain why `Testsuite: autopkgtest-pkg-pybuild` was failing, but it 
may relate in some way to the fact that PyInstaller has so many tests that 
they are all organized into subdirectories.  Perhaps not having any tests 
directly in `tests` was an issue.  At least, that is one possible meaning of 
the `choose from 'samedir', 'subdir', ‘parentdir’)` in the error message.

https://github.com/pyinstaller/pyinstaller/tree/develop/tests

-- 
Soren Stoutner
soren@debian.org

Back to linux.debian.maint.python | Previous | Next — Previous in thread | Find similar

Thread

Correct command to skip multiple tests in autopkgtest? Soren Stoutner <soren@debian.org> - 2024-11-02 00:10 +0100
  Re: Correct command to skip multiple tests in autopkgtest? Soren Stoutner <soren@debian.org> - 2024-11-06 22:30 +0100
    Re: Correct command to skip multiple tests in autopkgtest? Julian Gilbey <julian@d-and-j.net> - 2024-11-11 21:20 +0100
      Re: Correct command to skip multiple tests in autopkgtest? Soren Stoutner <soren@debian.org> - 2024-11-12 19:10 +0100
  Re: Correct command to skip multiple tests in autopkgtest? Soren Stoutner <soren@debian.org> - 2024-12-03 01:30 +0100

csiph-web