Path: csiph.com!aioe.org!bofh.it!news.nic.it!robomod From: Shayan Doust Newsgroups: linux.debian.maint.python Subject: Re: Issues with packaging intake Date: Fri, 19 Jun 2020 21:50:02 +0200 Message-ID: References: X-Original-To: Scott Talbert X-Mailbox-Line: From debian-python-request@lists.debian.org Fri Jun 19 19:47:33 2020 Old-Return-Path: X-Amavis-Spam-Status: No, score=-9.9 tagged_above=-10000 required=5.3 tests=[BAYES_00=-2, FOURLA=0.1, LDO_WHITELIST=-5, MEDS2=2, PGPSIGNATURE=-5, RCVD_IN_DNSWL_NONE=-0.0001] autolearn=ham autolearn_force=no X-Policyd-Weight: using cached result; rate: -5.5 Autocrypt: addr=hello@shayandoust.me; keydata= mQINBF1v4u4BEADISlcZDW9MHwXL9l8FvoTn48rEmQLhvHhGlMvqmH65yZvpXiutFyvwABWp U6nAH4KxKtIOWEct6OWKgkRcHK2GSs70jPvVKVb1RTg19Umdv9XfikMmo71DzdA9PDXmnAbP jj2qZCQNj6WSWQe+8Je6vxUHcUPpI/SboLTxqCCYj6UM+qgZJSdJXROJens2Rr+MieyoFzMk I1YpeaZFRorN5D0xu+3DWB8tnfmlux1cPuyhjwXFRG5OLEJ4vxeVL2L2dsbUHrxsxg+Oxg3T ghUYdGyKU0qxGcIBzNk9v/eKuYRqW+GcN3pzdera6uwruZ+Ej06B7ifJ8+k6Gk/ed04cGXhx M+ILlcDdhcgFcpLoLO/+P67aqxrx/DQTCyObnKmip1+9lQYrubUhK74cnDmXPqpR8XYePASg LU3SNKPAeGQeEL9Ang9ZTnMF0p80WjZUXzTml8449tPW3+aCHA+5fxmAQD64ZzUBkgLi2jdz +hgJ/KG0389YJEEaSJzTNFwlXGgv/oe8U/9rqvN0he6jeVVRK50f6+meD86OcdHF3dCV9PNb zo5NzyyI7mrryxke4rh5nRTZUabdJ64djh7Lc0yvFIGEeR3PnvDEffqsHuuRp1ansl1FIGhI MlF5G24qLWbgKTaAw3xMBMRPCpNDQCli5pVlyS527eQLTb05NQARAQABtDRTaGF5YW4gRG91 c3QgKFBlcnNvbmFsIEVNQUlMKSA8aGVsbG9Ac2hheWFuZG91c3QubWU+iQJRBBMBCAA7AhsP BQsJCAcCBhUKCQgLAgQWAgMBAh4BAheAFiEEBAGoEKbyQwMeo5dZbX1EGRnQI5UFAl7NoWAC GQEACgkQbX1EGRnQI5XqHQ/+K/kqEiXImhbbJFwnzjqX+4sKaWCUP0EXrsga6Oz8utZ55nJz 6op8e8oMEHL4ovK5eeX0m1iknve/6NNYKHjqOHBpMMBGIkM7S6la6QqJZy8rrqWwaJot6dkL N9Plb1sxuL/Xm2CFYjK89TC4EL7/CBf5OvIEo+/L6oBZaXgd7/zIfUxqo5E/CRJe+AuboXd/ 1vep8XoMz0EUBYIy3GJyFYIWFQXfXccTMowdJMsausjQCEdIcuqOY89LjjHeIGlbtW51H12b Jjh/OE1RIvyuCJxCC/NI08bky2d2E1VL4m9T4KcwTVfF9jx28A28rRgrjYnsad5QYMjNqTIz wcSQeKBqjJPU0bNEU2XYy/X2329f71j71CEplQdicVXwQaYmE6jVICXe+GqL8/VqlPP2JIIP gmBuCXuh88kmhwWFO1leDBFpFHJ8HExcvnXK/HuMX8RHriQVgP/ylWc4d6Die8dg49eYCl+6 WVsmG6OTd9JJE+L2Msafsv9VzsXGkwbAV1oWlf2H/K4SSp5WSL8jkgzr75YgNj3XejTKGQjH GT+8veHwbr0rlAQcZ8yzqf7DR5tlWIXUJFAIm0PQ4j24Ip8oJHoNDCeuQy3HSzIEelXRga7h 92ebht65aHOkSXbMkluBSYFoiIF6E3FQ0lRM29LiJrqNiFsGFFovusz/CJM= User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="8SILpxYyAfLjbaG434v55YsOJm4h4aXFj" X-Mailing-List: archive/latest/18377 List-ID: List-URL: List-Archive: https://lists.debian.org/msgid-search/944847d9-5c28-d948-27d9-5df023202272@shayandoust.me Approved: robomod@news.nic.it Lines: 217 Organization: linux.* mail to news gateway Sender: robomod@news.nic.it X-Original-Cc: debian-python@lists.debian.org X-Original-Date: Fri, 19 Jun 2020 20:46:35 +0100 X-Original-Message-ID: <944847d9-5c28-d948-27d9-5df023202272@shayandoust.me> X-Original-References: <276c662e-c9e0-5620-9945-35b717c6b24d@shayandoust.me> Xref: csiph.com linux.debian.maint.python:12665 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --8SILpxYyAfLjbaG434v55YsOJm4h4aXFj Content-Type: multipart/mixed; boundary="JcCpw9ogvibv9U9k3CouQwrdBLnMQRHrC" --JcCpw9ogvibv9U9k3CouQwrdBLnMQRHrC Content-Type: multipart/mixed; boundary="------------0E90106794E3DAF5F3EC7206" Content-Language: en-US This is a multi-part message in MIME format. --------------0E90106794E3DAF5F3EC7206 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hello Scott, Many thanks for your prompt response. > Yes, this is unfortunately a common packaging problem due to the test > target running before the install target which causes problems for a lo= t > of Python packages that do additional work during the install step. Ah right. Thanks for the information (for future packaging too). > Anyway, you can fix most of the failures by creating a > debian/pybuild.testfiles file that contains: > intake.egg-info I can confirm that this has indeed fixed most of the tests. > For the console scripts, I don't have any good ideas other than > overriding dh_auto_test and dh_auto_install (so that you run > dh_auto_test *after* dh_auto_install). But you will probably have to > set PATH and PYTHONPATH to include the install directories so that the > console scripts and Python modules can be found. There were only a few non-critical tests that failed, however I managed to fix some of them. With around 300 (if I remember correctly) tests passing, there's enough coverage and I will simply query with upstream later for the couple of minor tests that failed. Thanks again & Kind regards, Shayan Doust On 18/06/2020 22:24, Scott Talbert wrote: > On Thu, 18 Jun 2020, Shayan Doust wrote: >=20 >> I have been having some issues with packaging intake[1] for the Debian= >> Med packaging team, specifically during pytest. There are a lot of tes= ts >> failing, so I contacted upstream for a solution. >> >> According to upstream, the "entrypoints in the setup script are not >> being registered when using python3 setup.py build", so I decided to d= o >> some experimentation. It seems like the entry_points do actually get >> registered and installed, so I experimentally overrode dh_auto_test an= d >> only triggered dh_auto_test after dh_install (which is also overridden= ). >> Unfortunately, this has not made any difference and a good hundred uni= t >> tests fail. >> >> I am new to Python packaging, especially one that features entry point= s. >> If anyone could please kindly look into the package (and possibly even= >> building it), this would be much appreciated. >> >> Kind regards, >> Shayan Doust >> >> [1]: https://salsa.debian.org/med-team/intake >=20 > Yes, this is unfortunately a common packaging problem due to the test > target running before the install target which causes problems for a lo= t > of Python packages that do additional work during the install step. >=20 > Anyway, you can fix most of the failures by creating a > debian/pybuild.testfiles file that contains: > intake.egg-info >=20 > This causes the egg-info to be copied into the directory used for > testing. This solves the errors related to plugins but not the ones > related to console scripts, since the console script shims don't get > created until 'install' runs.=C2=A0 :( >=20 > For the console scripts, I don't have any good ideas other than > overriding dh_auto_test and dh_auto_install (so that you run > dh_auto_test *after* dh_auto_install).=C2=A0 But you will probably have= to > set PATH and PYTHONPATH to include the install directories so that the > console scripts and Python modules can be found. >=20 > Maybe someone else will have a better idea. >=20 > Scott --------------0E90106794E3DAF5F3EC7206 Content-Type: application/pgp-keys; name="0x6D7D441919D02395.asc" Content-Transfer-Encoding: quoted-printable Content-Disposition: attachment; filename="0x6D7D441919D02395.asc" -----BEGIN PGP PUBLIC KEY BLOCK----- mQINBF1v4u4BEADISlcZDW9MHwXL9l8FvoTn48rEmQLhvHhGlMvqmH65yZvpXiut FyvwABWpU6nAH4KxKtIOWEct6OWKgkRcHK2GSs70jPvVKVb1RTg19Umdv9XfikMm o71DzdA9PDXmnAbPjj2qZCQNj6WSWQe+8Je6vxUHcUPpI/SboLTxqCCYj6UM+qgZ JSdJXROJens2Rr+MieyoFzMkI1YpeaZFRorN5D0xu+3DWB8tnfmlux1cPuyhjwXF RG5OLEJ4vxeVL2L2dsbUHrxsxg+Oxg3TghUYdGyKU0qxGcIBzNk9v/eKuYRqW+Gc N3pzdera6uwruZ+Ej06B7ifJ8+k6Gk/ed04cGXhxM+ILlcDdhcgFcpLoLO/+P67a qxrx/DQTCyObnKmip1+9lQYrubUhK74cnDmXPqpR8XYePASgLU3SNKPAeGQeEL9A ng9ZTnMF0p80WjZUXzTml8449tPW3+aCHA+5fxmAQD64ZzUBkgLi2jdz+hgJ/KG0 389YJEEaSJzTNFwlXGgv/oe8U/9rqvN0he6jeVVRK50f6+meD86OcdHF3dCV9PNb zo5NzyyI7mrryxke4rh5nRTZUabdJ64djh7Lc0yvFIGEeR3PnvDEffqsHuuRp1an sl1FIGhIMlF5G24qLWbgKTaAw3xMBMRPCpNDQCli5pVlyS527eQLTb05NQARAQAB tDRTaGF5YW4gRG91c3QgKFBlcnNvbmFsIEVNQUlMKSA8aGVsbG9Ac2hheWFuZG91 c3QubWU+iQJOBBMBCgA4FiEEBAGoEKbyQwMeo5dZbX1EGRnQI5UFAl1v4u4CGw8F CwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQbX1EGRnQI5U5CQ/+JGeqU11TGMF/ iHXIyS0vYbN5EVmY919zUe0X9IuSoBo2AxyRkymCvsmB/hjMPho/QI+pfbOVeMCl 6YwMdDksbffK20uTQyZ6E9AjC/dZ142tg19kDkBilzhwYJzyBLp/m5xjEEz2GwRB ElRQ5AMHGOSZzuG4zWAdMIxESnNeRKUlYg2zFhlMYkEGbrBBLPHjDs7cijTbcxFq CSxP+lqvFN+m2NKyHYP8O/ZLHSrAjWY14RGjslQDhFbL7tm4bCaF2/atKsSevbfk JpKIw7NqPDhgydZTkKeclMSEAGycj9hJwBqBbSNhziiiJvN89fLTxfUPv6f2ot4R fWmu1H7dbSS+vF0CskLiNiB9eYlRXTIYY2+gCWqH3kmpNn45Itx6NNWnIzrO69Zl CTPEa8jPqmJgdMHuF9e7O+qpNqhkP8KB0pm/tUklsE2o7Lqla3fD68qy7xSVPyKn zwaN/3XNdRzPZ0dILgSddpMwnfMjLmDyIPMcB1wTI7bhp62micMG1cvcCBffoftF RBM/S/F3SuyDK87nMwHKNtw+H6ghcVEIgUirEqA9fagMmq9f7MDx7rLBIo3+Lszn t9vybYSMo61k6xqf07biMDp660IEHeT0FbzxB2zScPE7YJcG4o3AAZaoGnqWJ8gx rrlEyd9mhPEbBKwA5GIzJbr/O74pscSJAlEEEwEKADsCGw8FCwkIBwIGFQoJCAsC BBYCAwECHgECF4AWIQQEAagQpvJDAx6jl1ltfUQZGdAjlQUCXW/qwAIZAQAKCRBt fUQZGdAjlVRrD/9eNm/A/wEeucEZJ6XzdQSPshFd62uzA0JFXgE59bdG9gLFqa+Y lapTHaKu8pKb7fv9pY5q5ueVIpU7VMQZBDnrnRJMGr0LSZ7lgac7KSDeuYAwB0E+ TlVmtEIbLOwdxoyrfreydLe2DDWr++36FSGFIZa0ss4d3oex0DFZ90nVLFotXxjD 65w5JuJclB2F3INv4CBE/dV/K07lFVDGzh4oECyJ8zqKR8C2oGu17xK4RcU0w8LJ //i87BeG16vKgQWpQk0grQciHIgo8AbKn2mdqE4/w3nV9pBrieQDMMSZY93FL33Z 5Om8egywIUTvzFQ4WuI5aoXMEHa7u5GVekAlzdYPCnrZdeRg3sWVm4c71suGia0+ VsfQMnb+dKiTq959XP1JSSxwfgvfTYq+zr1o3ETtLP02mYvhn70SwZAhhgBjJYJ2 qFI9j2V3VIiBUw0MKGM5TzbRFw7q0znyGhlRcY4uSSBGqfPERzmmHyypr9Ew80m6 CLVBAw/V4s2nO/n4GbvmD0lUPgNuIwZBm6gBUjEHFOVzNMfX08fkSm4ArpAmwe9o wtAocgJFG8KzJfCUg6uiAHCtsm3XCjpVmzdinzrc3Ak56oIodzFLv75xhp9ogalj vl+cKOCaupvlAI11uxVDuktRGCWHF6n/ZdY7QF2ul6SlE8UrMbvirnjBh4kCUQQT AQgAOwIbDwULCQgHAgYVCgkICwIEFgIDAQIeAQIXgBYhBAQBqBCm8kMDHqOXWW19 RBkZ0COVBQJezaFgAhkBAAoJEG19RBkZ0COV6h0P/iv5KhIlyJoW2yRcJ846l/uL CmlglD9BF67IGujs/LrWeeZyc+qKfHvKDBBy+KLyuXnl9JtYpJ73v+jTWCh46jhw aTDARiJDO0upWukKiWcvK66lsGiaLenZCzfT5W9bMbi/15tghWIyvPUwuBC+/wgX +TryBKPvy+qAWWl4He/8yH1MaqORPwkSXvgLm6F3f9b3qfF6DM9BFAWCMtxichWC FhUF313HEzKMHSTLGrrI0AhHSHLqjmPPS44x3iBpW7VudR9dmyY4fzhNUSL8rgic QgvzSNPG5MtndhNVS+JvU+CnME1XxfY8dvANvK0YK42J7GneUGDIzakyM8HEkHig aoyT1NGzRFNl2Mv19t9vX+9Y+9QhKZUHYnFV8EGmJhOo1SAl3vhqi/P1apTz9iSC D4Jgbgl7ofPJJocFhTtZXgwRaRRyfBxMXL51yvx7jF/ER64kFYD/8pVnOHeg4nvH YOPXmApfullbJhujk3fSSRPi9jLGn7L/Vc7FxpMGwFdaFpX9h/yuEkqeVki/I5IM 6++WIDY913o0yhkIxxk/vL3h8G69K5QEHGfMs6n+w0ebZViF1CRQCJtD0OI9uCKf KCR6DQwnrkMtx0syBHpV0YGu4fdnm4beuWhzpEl2zJJbgUmBaIiBehNxUNJUTNvS 4ia6jYhbBhRaL7rM/wiTtEFTaGF5YW4gRG91c3QgKFVuaXZlcnNpdHkgRU1BSUwp IDxzLmRvdXN0QHN0dWRlbnQubGl2ZXJwb29sLmFjLnVrPokCTgQTAQoAOBYhBAQB qBCm8kMDHqOXWW19RBkZ0COVBQJdb+PUAhsPBQsJCAcCBhUKCQgLAgQWAgMBAh4B AheAAAoJEG19RBkZ0COVVMwQAJkpkGgA3lxC3z2p5D3A+40rVZSCGqUIlYj0C6WN usrWzLciuFt2mOUzAvumE36wMSO2+XScOqAiRRrSq3CQ48rK3D0tqG41MUFVhioI Jhuq1TP+wbfOKGVvYP+m9UnsVpDzLoqhipESoxw85FoeV2RpMG2sADrEWBhUvwkx tSjudVEk9UAByMlRRI0CQh4HgTKOvnRhNgCSB9a7Q4QX/cYtAJ1SAvWPEqTsebjy uMq6DRWYtZrnb4A/xtVy+Hv65MUh+t0JI9EPoOTMJEtXHLMYgx11mNcHhz1odkkD uUK+mlt3caUcD8M5yppQE8eJFYIkhoNLK93+LpMV+xWASyho7hTGbI+MXPDrxdrh 6xt3NmLQacHmcIPRN/Nb/DtL3t31UFzYTOcwAxfFcL4OonHlDYteyf1ziPA7/Llb 8vqCM4JwelJoonm5MFON+kEGhUf9YrHHEiOnYim1JjqEJjgz0/wWt3G197uyCpJ3 G5MraebW0xAf1SqBslO2TosTGgJpwaFlS+OBtXblU1+Vk3adWGgPJxGV5ZgYXNhg Pw0Z1K+tFWEwwaPLuEpx37KJryHmpyvAKJ5ZljOZFA/x7S/TEvYarJwrasZLNy9/ aQjs4jXeHyoZSgTIkktIxcu/BBUMTeX4wZtHgviRh74wgVmbGtzJ/BWWB6UysYj0 mGE/iQJOBBMBCAA4AhsPBQsJCAcCBhUKCQgLAgQWAgMBAh4BAheAFiEEBAGoEKby QwMeo5dZbX1EGRnQI5UFAl7NoWAACgkQbX1EGRnQI5UsTBAAuo1ldtf8WNrFl3NZ p/7hzuGb71SuvF49JYnv3F2bifkyqZZHA1sxdYTfRyycfhcew6OI6bUAB67MiRvd 2ALtcP9mlh3ULNKKGr4P74s5bL08VF3xaJnDVXFqtbab6j6MV5YMNsiXSjUDuPuD xKhF3hQJRPQyWmoGOT5oOCjD13oqbjxwDPkXkjYw1pQBKBcj5eNQ0PrfX3TVjZHA fZ5b3QS2I4uQs3k95DPg/eUoIhXWmSODkEZ+3BEYaYpJlAp9Iue71wtbf+6V/5q7 Fvd6LHBr2pJbtXm5w43uk82L/FdVLbo+CVFnYPGNiICMxO65zDMUgax21t6IMtKb tbOPUP7fHvZxVMPms7m7Hvm45JcYLEYYcRdaBDs499Gx2osVuCBf8795AIjLoY5S r0nb0WQ2prD4arXzyoGAPyZW1OKoT9myFkrqn/XeNUATa5tDnGaMsiD53PRSO6tA CSat1wpQX8LFLGLBoVhDwKYlxcxya9R15BPzotZyy+GUWG6JXBssj+SR+gIa6Tdq CsCQFKBA76eCgTFD/GOV05GfBR9j5jTZkh6SkDLgecRQulTOGiKipzrtReZPutTG 3ty1ieNSo0VagE5qyzTd+M1PgoCCkFMgVghiKnQSC2mCiHQ8m7gBES6/0oDBF3gV V7TjEb9vSp/Vq/mrXQPKapywdu0=3D =3DnylJ -----END PGP PUBLIC KEY BLOCK----- --------------0E90106794E3DAF5F3EC7206-- --JcCpw9ogvibv9U9k3CouQwrdBLnMQRHrC-- --8SILpxYyAfLjbaG434v55YsOJm4h4aXFj Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEBAGoEKbyQwMeo5dZbX1EGRnQI5UFAl7tFiMACgkQbX1EGRnQ I5Um7Q//Q79Sixn7RB/nZZB9OE6JspMnfV1IWjKha+LqTtXp8WXKbHIAnvAjvHbK jxRR3T0tZ6YX41FaUbZAH46xWAgcQoBB6qnRh2WAL+hw9BXu/JO76WcnYqbH4twz IxKLqNDUji1fFawr4qeu8wyJjo7TymE3S+cqN7FNx/zsJreLoLoBDhXi9DD/eSDY SpXxmQ87Tuph+Zx9Qh7X3QRRnF//oXvyWWmuGnNLJJ/tVIzEL0E7FcjDBBauYDb3 EK7iz652lUNfuYBKKndSgnT4KkYrgLMzG7gPCGbrQL1VrQWE13eW0cFJVNDXzURR QplNErxqc3z1Gx0nTekUBD9djEKfToOlz+24p0garEJFBQAHaGt1VkLfZqFwjK9f P9KKV1mt59D+EmbDxj98NH/C1cecyNdexGnWIu03zbxrKpFPmeG4pRsV6Gr2Cc51 HwqGavh/UjnCxto8Ucj83WfkfObLEH9iy5usG5HS4UYanCm5MlFwAJHJbuZm1A4S euullwgXDGb3LbZwdFHBb6SUrmeJ7+WJRxUgIdffzvzedksmjTX+v7KJ9gY9Y0MH ShKnhgnFuXCdnoIglNu96p8p/W7xxMwUfmR9gYYdvkytS/1Wmgh17tYCLi3LduCh EQJ4C6oJUAKwSuXS7rmaXoIbVmWTR01eFuAZAFZYDOnm7rPqZ0I= =QuuX -----END PGP SIGNATURE----- --8SILpxYyAfLjbaG434v55YsOJm4h4aXFj--