Path: csiph.com!fu-berlin.de!bofh.it!news.nic.it!robomod From: Alexandre Detiste Newsgroups: linux.debian.maint.python Subject: Re: missing pkg_resources dependencies Date: Sun, 16 Feb 2025 02:00:02 +0100 Message-ID: References: X-Mailbox-Line: From debian-python-request@lists.debian.org Sun Feb 16 00:54:44 2025 Old-Return-Path: X-Amavis-Spam-Status: No, score=-7.199 tagged_above=-10000 required=5.3 tests=[BAYES_00=-2, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, LDO_WHITELIST=-5, RCVD_IN_DNSWL_NONE=-0.0001] autolearn=ham autolearn_force=no X-Policyd-Weight: using cached result; rate: -5.5 X-Forwarded-Encrypted: i=1; AJvYcCU3Ty29UWxxehDpWecPTbYupc9eSgNJMD+jotw6oYgi0WxtBRSterDXMqc49r5JvoPHeXFsO6ZguFzsaQA=@lists.debian.org, AJvYcCW+O2Bg8UA0umTpc6XOo3BRrr/Jh4MmxY4EwGccz4M7kAHDWqBaspy4Fu/TQY9YEhXH4vowWixxh9Eqrw==@lists.debian.org X-Gm-Message-State: AOJu0YwrJqFECq7bCiVxd/CF5lv6au7SgjHw53KKJjh7tS5pGdGUs/ZM 9BLH+S4LLUf+/ixg6f1lTS7czHyICmtz0YeVogjI6fRZzo4bDJcg/fkJ8Fqak8CvSkF0pkZtrsH qpuVimQLpJeD4qQe/SZYU9fAs1aV+FmKx X-Gm-Gg: ASbGncv6Hi19kqnMe0GdlzfjDUCoCZnPLtDNEi5XaDhP+bijmkG/imOBf21TAWc+uAJ Bcqz4e9GWpZ2u71OywCND2IkOJQ5puw/4LKo31NDSQPY4pq+R9bgNsYdkJt/e2Y3UOUA31OY= X-Google-SMTP-Source: AGHT+IGkaJBZBSSv/zJ62+T9bREFEDIdDonvUsASgaSSAj07o32rq/O50oxJWFnSb0BsVRT4ElkLzZ5S9uBsbI2BW0E= X-Received: by 2002:a05:6902:c01:b0:e44:82ef:398b with SMTP id 3f1490d57ef6-e5dc933854amr3392602276.49.1739667267284; Sat, 15 Feb 2025 16:54:27 -0800 (PST) MIME-Version: 1.0 X-Gm-Features: AWEUYZl4GpZv-6k6dK8-2LUlBYaFM7r2oIEOFMLT9qKJPmWh1kiD3khGZwSKeD4 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Mailing-List: archive/latest/22818 List-ID: List-URL: List-Archive: https://lists.debian.org/msgid-search/CADsTwj++n-5Mt_fhw_WL0VmORdGGm=AX=4p5KYF4fk8djyDUKg@mail.gmail.com Approved: robomod@news.nic.it Lines: 220 Organization: linux.* mail to news gateway Sender: robomod@news.nic.it X-Original-Date: Sun, 16 Feb 2025 01:54:16 +0100 X-Original-Message-ID: X-Original-References: Xref: csiph.com linux.debian.maint.python:16715 And the now obligatory dd-list. python-bioframe was fixed today, pairtools was likely only caused by python-bioframe --- grep pkg_res dump.log | cut -d/ -f9 | sort -u | dd-list -i --nou Debian Astro Team astroquery Debian Astronomy Maintainers mpl-scatter-density Debian Astronomy Team specreduce-data Debian Med Packaging Team biomaj3 biomaj3-core circlator kleborate mirtop pairtools pyensembl python-bioframe Debian OpenStack git-review Debian Python Team afew bernhard geoalchemy2 Jelmer Vernoo=C4=B3 lintian-brush Le dim. 16 f=C3=A9vr. 2025 =C3=A0 01:29, Alexandre Detiste a =C3=A9crit : > > Hi, > > I'm worried that a lot of undeclared dependencies on > python3-pkg-resources will creep up in Trixie > and none of us will notice because we all have python3-setuptools > installed somehow. > > By scrapping UDD & ci.debian.net I can find a lot of failing CI jobs > that needs this one-line fix in d-control. > > Of course it would be more effecient to zgrep ModuleNotFoundError > inside https://ci.debian.net, > like what was done for SyntaxWarning inside piuparts architecture. > > Another orthogonal worry: the (over-)use of @builddeps@ in > d/test/control let packages > pass CI as Green while they will fail for end-users because of some > missing deps. > > Greetings, > > Alexandre > ----- > > tchet@quieter:~/udd/ci$ ./ci.py > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/afew/57418208/l= og.gz > 66s E ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/afew/57418208/l= og.gz > 66s E ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/afew/57418208/l= og.gz > 66s E ModuleNotFoundError: No module named 'pkg_resources' > > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/5741= 5625/log.gz > 100s E ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/5741= 5625/log.gz > 100s E ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/5741= 5625/log.gz > 100s E ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/5741= 5625/log.gz > 100s E ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/5741= 5625/log.gz > 100s E ModuleNotFoundError: No module named 'pkg_resources' > > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/b/bernhard/574139= 94/log.gz > 26s ModuleNotFoundError: No module named 'pkg_resources' > > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/b/biomaj3/5740883= 1/log.gz > 57s ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/b/biomaj3-core/57= 401997/log.gz > 35s E ModuleNotFoundError: No module named 'pkg_resources' > > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409= 170/log.gz > 66s E ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409= 170/log.gz > 66s E ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409= 170/log.gz > 66s E ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409= 170/log.gz > 66s E ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409= 170/log.gz > 66s E ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409= 170/log.gz > 66s E ModuleNotFoundError: No module named 'pkg_resources' > > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/574= 02616/log.gz > 106s E ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/574= 02616/log.gz > 106s E ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/574= 02616/log.gz > 106s E ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/574= 02616/log.gz > 106s E ModuleNotFoundError: No module named 'pkg_resources' > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/574= 02616/log.gz > 106s E ModuleNotFoundError: No module named 'pkg_resources' > > https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/git-review/5742= 2016/log.gz > 42s ModuleNotFoundError: No module named 'pkg_resources' > > ------ > > #!/usr/bin/python3 > > # https://udd.debian.org/schema/udd.html > # https://ci.debian.net/data/autopkgtest/unstable/amd64/p/python-debian/5= 7324755/log.gz > > import time > > import requests > import psycopg2 > > conn =3D psycopg2.connect("postgresql://udd-mirror:udd-mirror@udd-mirror.= debian.net/udd") > cursor =3D conn.cursor() > > # maybe it's Python, maybe it's Maybelline > SQL =3D """ > select source, arch, run_id > from ci > where suite=3D'unstable' > and status=3D'fail' > and date > TIMESTAMP '%TS% 00:01:01' > and not source like 'cl-%' > and not source like 'golang-%' > and not source like 'haskell-%' > and not source like 'lib%perl' > and not source like 'lua-%' > and not source like 'node-%' > and not source like 'openjdk-%' > and not source like 'php%' > and not source like 'postgresql-%' > and not source like 'ruby-%' > and not source like 'rust-%' > and not source like 'r-bioc-%' > and not source like 'r-cran-%' > order by source, arch > """ > > cursor.execute(SQL.replace('%TS%', '2025-01-01')) > > counts =3D dict() > urls =3D dict() > > for row in cursor.fetchall(): > source, arch, run_id =3D row > if source not in counts: > counts[source] =3D 0 > counts[source] +=3D 1 > url =3D 'https://ci.debian.net/data/autopkgtest/unstable/%s/%s/%s/%s/l= og.gz' > % ( > arch, > source[0], > source, > run_id, > ) > urls[source] =3D url > > conn.close() > > for source, count in counts.items(): > if count < 3: > continue > url =3D urls[source] > > time.sleep(0.3) > > r =3D requests.get(url) > for line in r.text.splitlines(): > if 'ModuleNotFoundError' in line: > print(url, line)