Path: csiph.com!aioe.org!bofh.it!news.nic.it!robomod From: Stefano Rivera Newsgroups: linux.debian.maint.python Subject: [MBF] pybuild: Stop calling setup.py test? Date: Mon, 15 Aug 2022 20:30:01 +0200 Message-ID: X-Mailbox-Line: From debian-python-request@lists.debian.org Mon Aug 15 18:27:40 2022 Old-Return-Path: X-Amavis-Spam-Status: No, score=-104.923 tagged_above=-10000 required=5.3 tests=[BAYES_00=-2, BODY_8BITS=1.5, DKIMWL_WL_HIGH=-0.573, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FVGT_m_MULTI_ODD=0.02, GMAIL=1, HEADER_FROM_DIFFERENT_DOMAINS=0.25, LDO_WHITELIST=-5, T_SCC_BODY_TEXT_LINE=-0.01, USER_IN_DKIM_WELCOMELIST=-0.01, USER_IN_DKIM_WHITELIST=-100] autolearn=ham autolearn_force=no X-Policyd-Weight: using cached result; rate: -4.6 Mail-Followup-To: debian-python@lists.debian.org X-Gpg-Public-Key: http://www.rivera.za.net/stefano.gpg MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="xmv7ok4q62olw7yi" Content-Disposition: inline Content-Transfer-Encoding: 8bit User-Agent: NeoMutt/20201127 X-Mailing-List: archive/latest/20182 List-ID: List-URL: List-Archive: https://lists.debian.org/msgid-search/20220815182722.7gahp4b63macxq6a@satie.tumbleweed.org.za Approved: robomod@news.nic.it Lines: 475 Organization: linux.* mail to news gateway Sender: robomod@news.nic.it X-Original-Date: Mon, 15 Aug 2022 18:27:22 +0000 X-Original-Message-ID: <20220815182722.7gahp4b63macxq6a@satie.tumbleweed.org.za> Xref: csiph.com linux.debian.maint.python:14348 --xmv7ok4q62olw7yi Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Calling "setup.py test" has been deprecated since setuptools 28.5. That's 6 years ago. pybuild calls currently setup.py test, when it can see that the package supports it, and another test runner hasn't been selected. I looked at dropping support for this (https://bugs.debian.org/982298) last year. I did some test builds and decided that breaking 50 odd packages to stop calling setup.py test wasn't worth it. I just ran the tests again, and the numbers are 41 new FTBFS, and 54 packages start emitting "Ran 0 tests", so they lost test coverage. dd-lists attached. That's an improvement over last year, but still enough to give me pause on just changing pybuild and breaking packages. We also now know that calling setup.py at all is deprecated. "setup.py test" support hasn't been removed yet, and I don't know if it will be, at this point... Options: 1. Change pybuild, cause 41 new FTBFS, and 54 packages to lose testing. File FTBFS bugs. 2. File "Severity: important" bugs on the packages that would FTBFS or lose testing. Change pybuild when most of these are closed. 3. File "Severity: minor" bugs on the packages that would FTBFS or lose testing. Leave pybuild as is, for now. Change pybuild when upstream setuptools drops support for "setup.py test". SR -- Stefano Rivera http://tumbleweed.org.za/ +1 415 683 3272 --xmv7ok4q62olw7yi Content-Type: text/plain; charset=utf-8 Content-Disposition: attachment; filename="new-failures.dd-list" Content-Transfer-Encoding: 8bit Adam Cecile python-libais (U) Aggelos Avgerinos elasticsearch-curator (U) Andrius Merkys pdb-tools (U) Antoine Beaupré magic-wormhole Apollon Oikonomopoulos elasticsearch-curator (U) Arnaud Fontaine python-libusb1 Brian May django-guardian (U) factory-boy (U) Debian Accessibility Team pocketsphinx-python Debian Math Team python-pulp Debian OpenStack python-funcsigs Debian Python Team autopep8 (U) django-classy-tags django-guardian elasticsearch-curator factory-boy flask-autoindex flask-testing lazr.uri (U) lesana manuel mmllib multiprocess (U) ponyorm powerline python-applicationinsights python-argcomplete python-ciso8601 python-django-ical python-django-swapper python-libais python-libusb1 (U) python-pkginfo python-wadllib (U) pyzbar quark-sphinx-theme zodbpickle Debian QA Group python-chameleon python-ofxhome xmldiff zope.i18nmessageid Debian Tryton Maintainers tryton-server Debichem Team pdb-tools Dominik George mmllib (U) Elena Grandi lesana (U) Evangelos Ribeiro Tzaras pyzbar (U) Federico Ceratto python-django-bootstrap-form (U) Felix Krull quark-sphinx-theme (U) FreedomBox Packaging Team python-django-bootstrap-form Héctor Orón Martínez python-phabricator James Valleroy manuel (U) python-django-bootstrap-form (U) Jameson Graef Rollins magic-wormhole (U) Jan Dittberner python-pkginfo (U) Jelmer Vernooij ponyorm (U) upstream-ontologist Jerome Charaoui powerline (U) Jon Bernard lttnganalyses (U) Jonathan Carter flask-autoindex (U) Julien Muchembled zodbpickle (U) Julien Puydt python-django-ical (U) Luca Boccassi python-applicationinsights (U) Malihe Asemani python-ciso8601 (U) Marc Dequènes (Duck) python-argcomplete (U) Mathias Behrle tryton-server (U) Michael Fladischer django-classy-tags (U) python-django-swapper (U) Michael Jeanson lttnganalyses Nicolas Dandrimont flask-testing (U) Nilesh Patra python-pulp (U) Ondřej Surý django-classy-tags (U) Pirate Praveen pyramid-jinja2 Samuel Henrique powerline (U) Samuel Thibault pocketsphinx-python (U) Sandro Tosi multiprocess Stefano Rivera lazr.uri python-wadllib Stefano Zacchiroli flask-testing (U) Steffen Moeller python-pulp (U) Sunil Mohan Adapa python-django-bootstrap-form (U) Sylvestre Ledru autopep8 Thomas Goirand django-classy-tags (U) python-funcsigs (U) --xmv7ok4q62olw7yi Content-Type: text/plain; charset=utf-8 Content-Disposition: attachment; filename="losing-testing.dd-list" Content-Transfer-Encoding: 8bit Adam Cecile python-libais (U) Adrian Alves python-stopit (U) Ana Rodríguez López siphashc Andrea Colangelo python-roman (U) Andreas Tille sphinxcontrib-autoprogram (U) Andrej Shadura python-phonenumbers (U) Andrius Merkys pycifrw (U) python-freesasa (U) python-peakutils (U) Arto Jantunen pytrainer (U) Carl Chenet retweet Chris MacNaughton python3-onelogin-saml2 (U) Christopher Baines pygtail (U) Colin Watson httmock (U) Daniele Tricoli simplegeneric (U) David Watson pep8 (U) Debian Fonts Task Force mutatormath Debian Python Modules Team python-decorator Debian Python Team blist cccolutils chargebee-python flask-basicauth (U) flask-bcrypt gitless httmock objgraph pep8 pycifrw pygtail pyjks pyparsing2 python-beniget python-cpuinfo python-decorator python-dictobj python-django-ical python-freesasa python-geoip2 python-libais python-lupa python-memprof python-peakutils python-phonenumbers python-pyfakefs python-pyotp python-roman python-stopit python-stubserver python-vobject python-zc.customdoctests python3-onelogin-saml2 pytrainer retweet (U) robot-detection simplegeneric sphinxcontrib-autoprogram transmissionrpc wikitrans zope.interface Debian Science Team python-nxs Debian Security Tools plyara Debian Tryton Maintainers simpleeval Diego M. Rodriguez python-beniget (U) Guido Günther python-vobject (U) Hans-Christoph Steiner pyjks (U) Hugo Lefeuvre pyrandom2 python-cpuinfo (U) python-pyotp (U) James Page python3-onelogin-saml2 (U) Javi Merino python-memprof (U) Jelmer Vernooij lintian-brush python-ghdiff python-vobject (U) Jonas Meurer robot-detection (U) Julien Muchembled python-zc.customdoctests (U) Julien Puydt python-django-ical (U) Kevin Murray sphinxcontrib-autoprogram (U) Laszlo Boszormenyi (GCS) pyro4 Marc Haber journal-brief Martin Kratochvíl python-geoip2 (U) Mathias Behrle simpleeval (U) Matthew Grant pyparsing2 (U) Michael Fladischer python-lupa (U) Michael Gilbert blist (U) Michael R. Crusoe python-stubserver (U) mpd maintainers sonata Noèl Köthe pytrainer (U) Olivier Sallou python-dictobj (U) Ondřej Kobližek python-geoip2 (U) Ondřej Nový python-geoip2 (U) python-pyfakefs (U) Ondřej Surý brotli (U) Orestis Ioannou flask-bcrypt (U) Peter Pentchev gitless (U) Pierre-Elliott Bécue zope.interface (U) Piotr Ożarowski python-decorator (U) Robert Haist plyara (U) Sandro Tosi flask-basicauth Scott Kitterman chargebee-python (U) Sergio Durigan Junior cccolutils (U) Simon McVittie sonata (U) Stefano Rivera objgraph (U) Stuart Prescott python-nxs (U) Sylvestre Ledru pep8 (U) Thomas Goirand pyparsing2 (U) python-pyotp (U) Tomasz Buchert brotli Tristan Seligmann python-phpserialize Vincent Bernat transmissionrpc (U) Yao Wei (魏銘廷) mutatormath (U) أحمد المحمودي (Ahmed El-Mahmoudy) wikitrans (U) --xmv7ok4q62olw7yi--