Path: csiph.com!fu-berlin.de!bofh.it!news.nic.it!robomod From: Soren Stoutner Newsgroups: linux.debian.maint.python Subject: Re: Correct command to skip multiple tests in autopkgtest? Date: Tue, 03 Dec 2024 01:30:01 +0100 Message-ID: References: X-Original-To: Debian Python Team X-Mailbox-Line: From debian-python-request@lists.debian.org Tue Dec 3 00:25:03 2024 Old-Return-Path: X-Amavis-Spam-Status: No, score=-114.749 tagged_above=-10000 required=5.3 tests=[BAYES_00=-2, DKIMWL_WL_HIGH=-0.34, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, LDO_WHITELIST=-5, MURPHY_SCAM1=0.1, PGPSIGNATURE=-5, RCVD_IN_DNSWL_MED=-2.3, UNPARSEABLE_RELAY=0.001, USER_IN_DKIM_WELCOMELIST=-0.01, USER_IN_DKIM_WHITELIST=-100] autolearn=ham autolearn_force=no Organization: Debian MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart2078078.yZuYMa6mSP"; micalg="pgp-sha512"; protocol="application/pgp-signature" X-Debian-User: soren X-Mailing-List: archive/latest/22601 List-ID: List-URL: List-Archive: https://lists.debian.org/msgid-search/3813148.LDvLIpks8f@soren-desktop Approved: robomod@news.nic.it Lines: 130 Sender: robomod@news.nic.it X-Original-Date: Mon, 02 Dec 2024 17:24:37 -0700 X-Original-Message-ID: <3813148.LDvLIpks8f@soren-desktop> X-Original-References: <2952489.034xB63fYD@soren-desktop> Xref: csiph.com linux.debian.maint.python:16516 --nextPart2078078.yZuYMa6mSP Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8"; protected-headers="v1" From: Soren Stoutner To: Debian Python Team Subject: Re: Correct command to skip multiple tests in autopkgtest? Date: Mon, 02 Dec 2024 17:24:37 -0700 Message-ID: <3813148.LDvLIpks8f@soren-desktop> Organization: Debian In-Reply-To: <2952489.034xB63fYD@soren-desktop> References: <2952489.034xB63fYD@soren-desktop> MIME-Version: 1.0 On Friday, November 1, 2024 4:03:45 PM MST Soren Stoutner wrote: > I am in the process of packaging pyinstaller. >=20 > https://pypi.org/project/pyinstaller/ >=20 > Many of pyinstaller=E2=80=99s tests require the pyinstaller-hooks-contrib= package, > which I am also in the process of packaging. >=20 > https://pypi.org/project/pyinstaller-hooks-contrib/ >=20 > But pyinstaller-hooks-contrib depends on pyinstaller for its tests. >=20 > In order to bootstrap the introduction of these packages into Debian, I am > temporarily disabling the pyinstaller tests that depend on pyinstaller- hooks- > contrib using the following command in debian/rules: >=20 > export PYBUILD_TEST_ARGS=3D-k\ > 'not test_find_module\ > and not test_metadata_searching\ > and not test_Qt_QTranslate\ > and not test_zeep\ > and not test_scapy3\ > and not test_zope_interface\ > and not test_gevent\ > and not test_user_preferred_locale\ > and not test_pytz' >=20 > This works successfully during the build process: >=20 > 1004 passed, 286 skipped, 25 deselected, 24 xfailed, 1 xpassed, 17 warnin= gs=20 in > 6969.97s (1:56:09) >=20 > https://salsa.debian.org/soren/python-pyinstaller/-/jobs/6514811#L6635 >=20 > But, for some reason, autopkgtest doesn=E2=80=99t like the format of the = arguments. >=20 > I: pybuild base:311: cd /tmp/autopkgtest-lxc.ntf_swjm/downtmp/ autopkgtest_tmp/ > build; python3.12 -m pytest -k 'not test_find_module and not > test_metadata_searching and not test_Qt_QTranslate and not test_zeep and = not > test_scapy3 and not test_zope_interface and not test_gevent and not > test_user_preferred_locale and not test_pytz' > usage: __main__.py [-h] [--link-only] {samedir,subdir,parentdir} > __main__.py: error: argument test_type: invalid choice: 'not test_find_mo= dule > and not test_metadata_searching and not test_Qt_QTranslate and not test_z= eep > and not test_scapy3 and not test_zope_interface and not test_gevent and n= ot > test_user_preferred_locale and not test_pytz' (choose from 'samedir', > 'subdir', =E2=80=98parentdir=E2=80=99) >=20 > https://salsa.debian.org/soren/python-pyinstaller/-/jobs/6514819#L781 >=20 > I have tried several syntax variations without success. Does anyone know= =20 the > correct syntax for skipping several tests in autopgktest? In the case of PyInstaller, the answer ended up being to not use `Testsuite= :=20 autopkgtest-pkg-pybuild` and instead call the tests manually using debian/ tests/control. https://salsa.debian.org/soren/python-pyinstaller/-/blob/main/debian/tests/ control?ref_type=3Dheads Although there are some further errors to investigate, this at least allowe= d=20 the tests to run. https://salsa.debian.org/soren/python-pyinstaller/-/pipelines/772011 I am uncertain why `Testsuite: autopkgtest-pkg-pybuild` was failing, but it= =20 may relate in some way to the fact that PyInstaller has so many tests that= =20 they are all organized into subdirectories. Perhaps not having any tests=20 directly in `tests` was an issue. At least, that is one possible meaning o= f=20 the `choose from 'samedir', 'subdir', =E2=80=98parentdir=E2=80=99)` in the = error message. https://github.com/pyinstaller/pyinstaller/tree/develop/tests =2D-=20 Soren Stoutner soren@debian.org --nextPart2078078.yZuYMa6mSP Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part. Content-Transfer-Encoding: 7Bit -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEJKVN2yNUZnlcqOI+wufLJ66wtgMFAmdOT8UACgkQwufLJ66w tgNdxxAAuYktVE7lGTxBgbNI0DrVmbjfnH377EHEYawlqm8WH0t3jPlqw+NqnstY cIJDlkCY6dL36YjSPLhr1YFJB+UnTBJYCpyKZqqJkAYiFMOnZhgnCU13Yo2ymGv8 Y0blW6r47wIm+9nhdJCViSX0D/lXZlP7UQ7IfmG/9asD7MrybnZlOYp4vhvHVW3o awZ03afojg9AyVfc2NaeRV7TvdUYOWTn9o0BRLRzJeB0Oj3B/QRA9us0U7H3KB5n Hq/0wxNuJ7pWS4lkJ1Fa5kHw9GzaZrLSljkFZkmQCr6jAUjXmNKH3Vy6NWWIj+J9 GUA4cYr0+gpTePOwRELCO+/XsmU+blIGvguElTGts6Nb0mxRH1CYwjnBTMIIOw6q sWXIQkw5GE13URPavRpqM0GkxhsieuYMq7xty1eCCSnC5JAkcorCpbkvFlsXxBmN 5LFBLPpFe0qMHSJyIqg5clNNwb2+zbiPp7b5qTKgYEPRUGMq5bwL/Zwj0N9FhzNj 7WD6DjkuWTUIQyhFcef/dMLCJy4qFjLxCjbYl8TS16X7xdp9f2JTBPqT0g5elJs8 gzwX2IF9FqDwyn9j0waF0gNSHjW70MC1t3lPdJIjw5JDwAjfk/bwDLHupMmSWDOS 6CjtCVnw3E6NDUqguJ0w1S30yGcTmaaCCOudT7p+1h0jqwosBQ0= =rZCY -----END PGP SIGNATURE----- --nextPart2078078.yZuYMa6mSP--