Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.maint.python > #16715

Re: missing pkg_resources dependencies

Path csiph.com!fu-berlin.de!bofh.it!news.nic.it!robomod
From Alexandre Detiste <alexandre.detiste@gmail.com>
Newsgroups linux.debian.maint.python
Subject Re: missing pkg_resources dependencies
Date Sun, 16 Feb 2025 02:00:02 +0100
Message-ID <KgBaO-h6Sj-1@gated-at.bofh.it> (permalink)
References <KgARr-h6KG-1@gated-at.bofh.it>
X-Mailbox-Line From debian-python-request@lists.debian.org Sun Feb 16 00:54:44 2025
Old-Return-Path <alexandre.detiste@gmail.com>
X-Amavis-Spam-Status No, score=-7.199 tagged_above=-10000 required=5.3 tests=[BAYES_00=-2, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, LDO_WHITELIST=-5, RCVD_IN_DNSWL_NONE=-0.0001] autolearn=ham autolearn_force=no
X-Policyd-Weight using cached result; rate: -5.5
X-Forwarded-Encrypted i=1; AJvYcCU3Ty29UWxxehDpWecPTbYupc9eSgNJMD+jotw6oYgi0WxtBRSterDXMqc49r5JvoPHeXFsO6ZguFzsaQA=@lists.debian.org, AJvYcCW+O2Bg8UA0umTpc6XOo3BRrr/Jh4MmxY4EwGccz4M7kAHDWqBaspy4Fu/TQY9YEhXH4vowWixxh9Eqrw==@lists.debian.org
X-Gm-Message-State AOJu0YwrJqFECq7bCiVxd/CF5lv6au7SgjHw53KKJjh7tS5pGdGUs/ZM 9BLH+S4LLUf+/ixg6f1lTS7czHyICmtz0YeVogjI6fRZzo4bDJcg/fkJ8Fqak8CvSkF0pkZtrsH qpuVimQLpJeD4qQe/SZYU9fAs1aV+FmKx
X-Gm-Gg ASbGncv6Hi19kqnMe0GdlzfjDUCoCZnPLtDNEi5XaDhP+bijmkG/imOBf21TAWc+uAJ Bcqz4e9GWpZ2u71OywCND2IkOJQ5puw/4LKo31NDSQPY4pq+R9bgNsYdkJt/e2Y3UOUA31OY=
X-Google-SMTP-Source AGHT+IGkaJBZBSSv/zJ62+T9bREFEDIdDonvUsASgaSSAj07o32rq/O50oxJWFnSb0BsVRT4ElkLzZ5S9uBsbI2BW0E=
X-Received by 2002:a05:6902:c01:b0:e44:82ef:398b with SMTP id 3f1490d57ef6-e5dc933854amr3392602276.49.1739667267284; Sat, 15 Feb 2025 16:54:27 -0800 (PST)
MIME-Version 1.0
X-Gm-Features AWEUYZl4GpZv-6k6dK8-2LUlBYaFM7r2oIEOFMLT9qKJPmWh1kiD3khGZwSKeD4
Content-Type text/plain; charset="UTF-8"
Content-Transfer-Encoding quoted-printable
X-Mailing-List <debian-python@lists.debian.org> archive/latest/22818
List-ID <debian-python.lists.debian.org>
List-URL <https://lists.debian.org/debian-python/>
List-Archive https://lists.debian.org/msgid-search/CADsTwj++n-5Mt_fhw_WL0VmORdGGm=AX=4p5KYF4fk8djyDUKg@mail.gmail.com
Approved robomod@news.nic.it
Lines 220
Organization linux.* mail to news gateway
Sender robomod@news.nic.it
X-Original-Date Sun, 16 Feb 2025 01:54:16 +0100
X-Original-Message-ID <CADsTwj++n-5Mt_fhw_WL0VmORdGGm=AX=4p5KYF4fk8djyDUKg@mail.gmail.com>
X-Original-References <CADsTwjKY1Uamxjb_nSEo1yWx6SiRMeOggn=HYBy3H2-+kKrQ-A@mail.gmail.com>
Xref csiph.com linux.debian.maint.python:16715

Show key headers only | View raw

And the now obligatory dd-list.

  python-bioframe was fixed today,
  pairtools was likely only caused by python-bioframe

---

grep pkg_res dump.log  | cut -d/ -f9 | sort -u | dd-list -i --nou

Debian Astro Team <debian-astro-maintainers@lists.alioth.debian.org>
  astroquery

Debian Astronomy Maintainers <debian-astro-maintainers@lists.alioth.debian.org>
  mpl-scatter-density

Debian Astronomy Team <debian-astro-maintainers@lists.alioth.debian.org>
  specreduce-data

Debian Med Packaging Team <debian-med-packaging@lists.alioth.debian.org>
  biomaj3
  biomaj3-core
  circlator
  kleborate
  mirtop
  pairtools
  pyensembl
  python-bioframe

Debian OpenStack <team+openstack@tracker.debian.org>
  git-review

Debian Python Team <team+python@tracker.debian.org>
  afew
  bernhard
  geoalchemy2

Jelmer Vernooij <jelmer@debian.org>
  lintian-brush




Le dim. 16 févr. 2025 à 01:29, Alexandre Detiste
<alexandre.detiste@gmail.com> a écrit :
>
> Hi,
>
> I'm worried that a lot of undeclared dependencies on
> python3-pkg-resources will creep up in Trixie
> and none of us will notice because we all have python3-setuptools
> installed somehow.
>
> By scrapping UDD & ci.debian.net I can find a lot of failing CI jobs
> that needs this one-line fix in d-control.
>
> Of course it would be more effecient to zgrep ModuleNotFoundError
> inside https://ci.debian.net,
> like what was done for SyntaxWarning inside piuparts architecture.
>
> Another orthogonal worry: the (over-)use of @builddeps@ in
> d/test/control let packages
> pass CI as Green while they will fail for end-users because of some
> missing deps.
>
> Greetings,
>
> Alexandre
> -----
>
> tchet@quieter:~/udd/ci$ ./ci.py
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/afew/57418208/log.gz
>  66s E   ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/afew/57418208/log.gz
>  66s E   ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/afew/57418208/log.gz
>  66s E   ModuleNotFoundError: No module named 'pkg_resources'
>
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/57415625/log.gz
> 100s E   ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/57415625/log.gz
> 100s E   ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/57415625/log.gz
> 100s E   ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/57415625/log.gz
> 100s E   ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/57415625/log.gz
> 100s E   ModuleNotFoundError: No module named 'pkg_resources'
>
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/b/bernhard/57413994/log.gz
>  26s ModuleNotFoundError: No module named 'pkg_resources'
>
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/b/biomaj3/57408831/log.gz
>  57s ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/b/biomaj3-core/57401997/log.gz
>  35s E   ModuleNotFoundError: No module named 'pkg_resources'
>
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz
>  66s E   ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz
>  66s E   ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz
>  66s E   ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz
>  66s E   ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz
>  66s E   ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz
>  66s E   ModuleNotFoundError: No module named 'pkg_resources'
>
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/57402616/log.gz
> 106s E   ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/57402616/log.gz
> 106s E   ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/57402616/log.gz
> 106s E   ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/57402616/log.gz
> 106s E   ModuleNotFoundError: No module named 'pkg_resources'
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/57402616/log.gz
> 106s E   ModuleNotFoundError: No module named 'pkg_resources'
>
> https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/git-review/57422016/log.gz
>  42s ModuleNotFoundError: No module named 'pkg_resources'
>
> ------
>
> #!/usr/bin/python3
>
> # https://udd.debian.org/schema/udd.html
> # https://ci.debian.net/data/autopkgtest/unstable/amd64/p/python-debian/57324755/log.gz
>
> import time
>
> import requests
> import psycopg2
>
> conn = psycopg2.connect("postgresql://udd-mirror:udd-mirror@udd-mirror.debian.net/udd")
> cursor = conn.cursor()
>
> # maybe it's Python, maybe it's Maybelline
> SQL = """
>    select source, arch, run_id
>    from ci
>    where suite='unstable'
>    and status='fail'
>    and date > TIMESTAMP '%TS% 00:01:01'
>    and not source like 'cl-%'
>    and not source like 'golang-%'
>    and not source like 'haskell-%'
>    and not source like 'lib%perl'
>    and not source like 'lua-%'
>    and not source like 'node-%'
>    and not source like 'openjdk-%'
>    and not source like 'php%'
>    and not source like 'postgresql-%'
>    and not source like 'ruby-%'
>    and not source like 'rust-%'
>    and not source like 'r-bioc-%'
>    and not source like 'r-cran-%'
>    order by source, arch
> """
>
> cursor.execute(SQL.replace('%TS%', '2025-01-01'))
>
> counts = dict()
> urls = dict()
>
> for row in cursor.fetchall():
>    source, arch, run_id = row
>    if source not in counts:
>        counts[source] = 0
>    counts[source] += 1
>    url = 'https://ci.debian.net/data/autopkgtest/unstable/%s/%s/%s/%s/log.gz'
> % (
>         arch,
>         source[0],
>         source,
>         run_id,
>    )
>    urls[source] = url
>
> conn.close()
>
> for source, count in counts.items():
>    if count < 3:
>       continue
>    url = urls[source]
>
>    time.sleep(0.3)
>
>    r = requests.get(url)
>    for line in r.text.splitlines():
>        if 'ModuleNotFoundError' in line:
>            print(url, line)

Back to linux.debian.maint.python | Previous | Next — Previous in thread | Next in thread | Find similar

Thread

missing pkg_resources dependencies Alexandre Detiste <alexandre.detiste@gmail.com> - 2025-02-16 01:40 +0100
  Re: missing pkg_resources dependencies Alexandre Detiste <alexandre.detiste@gmail.com> - 2025-02-16 02:00 +0100
  Re: missing pkg_resources dependencies Mathias Behrle <mbehrle@debian.org> - 2025-02-16 19:00 +0100
    Re: missing pkg_resources dependencies Andrey Rakhmatullin <wrar@debian.org> - 2025-02-16 19:30 +0100
      Re: missing pkg_resources dependencies Alexandre Detiste <alexandre.detiste@gmail.com> - 2025-02-16 19:40 +0100

csiph-web