Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.bugs.dist > #1083452

Bug#1000803: autopkgtest: avoid duplication with autopkgtests and how unittests are run at build-time

Show all headers | View raw

Package: autopkgtest
Version: 5.16
Severity: normal
X-Debbugs-Cc: morph@debian.org

Hello,
There are at least 2 main places where source packages declare tests:

1. in debian/rules, to be executed at build-time
2. in debina/tests/*, to be executed post-build via autopkgtests

Usually 1) are written first, because you need to get them to pass during
build-time; this activity also require to add additional dependencies to
debian/control, which are only required by tests (and not by the package
building commands).

And then there's 2), where often you're required to duplicate the steps from 1)
and that could lead to misalignment, forgotten dependencies (and so failures), 
etc.

In general, it's preferred to reduce duplication to the minimum, just to avoid
the problems listed above, but autopkgtest kinda requires you to have exactly
this duplication.

F.e., i make sure to mark <!nocheck> all the b-d only needed for tests, but
there's no selector in debian/tests/control to only pull in those packages, and
sometimes the quickest way is to get all @builddeps@, even if that has the risk
to include extra packages in the mix.

There's also the problem of duplicating how we run tests; while autopkgtest
is less restrictive than the buildd environment (f.e. via allow-network), there
could be substantial duplication on how test runners are setup in d/rules and
in autopkgtest.

I dont know if you ever thought about the duplication problem, i feel it would
be really helpful if that could be substantially reduced.

Thanks,
Sandro


-- System Information:
Debian Release: 11.0
  APT prefers unstable
  APT policy: (500, 'unstable'), (1, 'experimental')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 5.14.0-4-amd64 (SMP w/8 CPU threads)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE not set
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled

Versions of packages autopkgtest depends on:
ii  apt-utils       2.3.12
ii  libdpkg-perl    1.20.9
ii  procps          2:3.3.17-5
ii  python3         3.9.8-1
ii  python3-debian  0.1.39

Versions of packages autopkgtest recommends:
ii  autodep8  0.24

Versions of packages autopkgtest suggests:
ii  lxc               1:4.0.10-1
pn  lxd               <none>
pn  ovmf              <none>
pn  qemu-efi-aarch64  <none>
pn  qemu-efi-arm      <none>
pn  qemu-system       <none>
ii  qemu-utils        1:6.1+dfsg-8+b1
ii  schroot           1.6.10-12
pn  vmdb2             <none>

-- no debconf information

Back to linux.debian.bugs.dist | Previous | Next — Next in thread | Find similar | Unroll thread

Thread

Bug#1000803: autopkgtest: avoid duplication with autopkgtests and how unittests are run at build-time Sandro Tosi <morph@debian.org> - 2021-11-29 05:50 +0100
  Bug#1000803: autopkgtest: avoid duplication with autopkgtests and how unittests are run at build-time Antonio Terceiro <terceiro@debian.org> - 2021-11-29 19:40 +0100
    Bug#1000803: autopkgtest: avoid duplication with autopkgtests and how unittests are run at build-time Sandro Tosi <morph@debian.org> - 2021-11-30 07:00 +0100
      Bug#1000803: autopkgtest: avoid duplication with autopkgtests and how unittests are run at build-time Antonio Terceiro <terceiro@debian.org> - 2021-12-02 00:30 +0100
        Bug#1000803: autopkgtest: avoid duplication with autopkgtests and how unittests are run at build-time Antonio Terceiro <terceiro@debian.org> - 2021-12-20 20:10 +0100
          Bug#1000803: dh-python: add pybuild-autopkgtest, a test runner Antonio Terceiro <terceiro@debian.org> - 2021-12-25 14:30 +0100

csiph-web