Path: csiph.com!news.samoylyk.net!gothmog.csi.it!bofh.it!news.nic.it!robomod From: Alexandre Detiste Newsgroups: linux.debian.maint.python Subject: missing pkg_resources dependencies Date: Sun, 16 Feb 2025 01:40:01 +0100 Message-ID: X-Mailbox-Line: From debian-python-request@lists.debian.org Sun Feb 16 00:30:30 2025 Old-Return-Path: X-Amavis-Spam-Status: No, score=-7.199 tagged_above=-10000 required=5.3 tests=[BAYES_00=-2, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, LDO_WHITELIST=-5, RCVD_IN_DNSWL_NONE=-0.0001] autolearn=ham autolearn_force=no X-Policyd-Weight: using cached result; rate: -5.5 X-Gm-Message-State: AOJu0YzwVjcuEJxY5UFQ6e9jzn28g3u8sQKYtndebcektMiqQcXFQfGB aGGUF8zSZPE8NM8Zctq5SLoFjpAqWCgztWHC9pdK82HFLY+oE3Ld9EuyQnUvuG2GWMPpWJ9tcze mvMlkWv0XCplm61EsS3vHOkMn+Z8sMv8x X-Gm-Gg: ASbGncvfQh1eX6+UIsO9csSShbvJsnBUSGk6KT963UcNbucpTO5/XzUlARPnf4DuZhx Wb3oAa8Q3N3z75X4/FwBcEUux4iVG3H2Jgz1DqVbZN59+NmFGW1tadfrDiODJXi3QLCr7ftI= X-Google-SMTP-Source: AGHT+IELgXlZWgGNpACnelvnQ+TfOmMdupyHDZUv3SOg8GVYWxRAor50fn2kzmn2FDIsic3JZaKHP0SCGkakZIU7Tr4= X-Received: by 2002:a05:6902:1205:b0:e58:2a5:241a with SMTP id 3f1490d57ef6-e5dc980e747mr3120644276.9.1739665810703; Sat, 15 Feb 2025 16:30:10 -0800 (PST) MIME-Version: 1.0 X-Gm-Features: AWEUYZkKpCfJ9hBMz2AeMtDuaJr0eyrPGGpNGUlHLZJQ7huICjMkxDTcqS1SHv8 Content-Type: text/plain; charset="UTF-8" X-Mailing-List: archive/latest/22817 List-ID: List-URL: List-Archive: https://lists.debian.org/msgid-search/CADsTwjKY1Uamxjb_nSEo1yWx6SiRMeOggn=HYBy3H2-+kKrQ-A@mail.gmail.com Approved: robomod@news.nic.it Lines: 148 Organization: linux.* mail to news gateway Sender: robomod@news.nic.it X-Original-Date: Sun, 16 Feb 2025 01:29:59 +0100 X-Original-Message-ID: Xref: csiph.com linux.debian.maint.python:16714 Hi, I'm worried that a lot of undeclared dependencies on python3-pkg-resources will creep up in Trixie and none of us will notice because we all have python3-setuptools installed somehow. By scrapping UDD & ci.debian.net I can find a lot of failing CI jobs that needs this one-line fix in d-control. Of course it would be more effecient to zgrep ModuleNotFoundError inside https://ci.debian.net, like what was done for SyntaxWarning inside piuparts architecture. Another orthogonal worry: the (over-)use of @builddeps@ in d/test/control let packages pass CI as Green while they will fail for end-users because of some missing deps. Greetings, Alexandre ----- tchet@quieter:~/udd/ci$ ./ci.py https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/afew/57418208/log.gz 66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/afew/57418208/log.gz 66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/afew/57418208/log.gz 66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/57415625/log.gz 100s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/57415625/log.gz 100s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/57415625/log.gz 100s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/57415625/log.gz 100s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/a/astroquery/57415625/log.gz 100s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/b/bernhard/57413994/log.gz 26s ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/b/biomaj3/57408831/log.gz 57s ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/b/biomaj3-core/57401997/log.gz 35s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz 66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz 66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz 66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz 66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz 66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/c/circlator/57409170/log.gz 66s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/57402616/log.gz 106s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/57402616/log.gz 106s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/57402616/log.gz 106s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/57402616/log.gz 106s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/geoalchemy2/57402616/log.gz 106s E ModuleNotFoundError: No module named 'pkg_resources' https://ci.debian.net/data/autopkgtest/unstable/ppc64el/g/git-review/57422016/log.gz 42s ModuleNotFoundError: No module named 'pkg_resources' ------ #!/usr/bin/python3 # https://udd.debian.org/schema/udd.html # https://ci.debian.net/data/autopkgtest/unstable/amd64/p/python-debian/57324755/log.gz import time import requests import psycopg2 conn = psycopg2.connect("postgresql://udd-mirror:udd-mirror@udd-mirror.debian.net/udd") cursor = conn.cursor() # maybe it's Python, maybe it's Maybelline SQL = """ select source, arch, run_id from ci where suite='unstable' and status='fail' and date > TIMESTAMP '%TS% 00:01:01' and not source like 'cl-%' and not source like 'golang-%' and not source like 'haskell-%' and not source like 'lib%perl' and not source like 'lua-%' and not source like 'node-%' and not source like 'openjdk-%' and not source like 'php%' and not source like 'postgresql-%' and not source like 'ruby-%' and not source like 'rust-%' and not source like 'r-bioc-%' and not source like 'r-cran-%' order by source, arch """ cursor.execute(SQL.replace('%TS%', '2025-01-01')) counts = dict() urls = dict() for row in cursor.fetchall(): source, arch, run_id = row if source not in counts: counts[source] = 0 counts[source] += 1 url = 'https://ci.debian.net/data/autopkgtest/unstable/%s/%s/%s/%s/log.gz' % ( arch, source[0], source, run_id, ) urls[source] = url conn.close() for source, count in counts.items(): if count < 3: continue url = urls[source] time.sleep(0.3) r = requests.get(url) for line in r.text.splitlines(): if 'ModuleNotFoundError' in line: print(url, line)