Path: csiph.com!aioe.org!bofh.it!news.nic.it!robomod From: Yaroslav Halchenko Newsgroups: linux.debian.maint.python Subject: Re: Challenges packaging Python for a Linux distro - at Python Language Summit Date: Thu, 13 May 2021 15:50:01 +0200 Message-ID: References: X-Mailbox-Line: From debian-python-request@lists.debian.org Thu May 13 13:43:40 2021 Old-Return-Path: X-Amavis-Spam-Status: No, score=-9.2 tagged_above=-10000 required=5.3 tests=[BAYES_00=-2, FOURLA=0.1, LDO_WHITELIST=-5, RCVD_IN_DNSWL_MED=-2.3] autolearn=ham autolearn_force=no MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline X-URL: http://www.onerussian.com X-Image-URL: http://www.onerussian.com/img/yoh.png X-PGP-Key: http://www.onerussian.com/gpg-yoh.asc X-Fingerprint: C5B9 05F0 E8D9 FD96 68FF 366F A2DE 2350 62DA 33FA X-Sa-Exim-Connect-IP: 76.24.253.1 X-Sa-Exim-Rcpt-To: debian-python@lists.debian.org X-Sa-Exim-Mail-From: yoh@onerussian.com X-Sa-Exim-Version: 4.2.1 (built Tue, 02 Aug 2016 21:08:31 +0000) X-Sa-Exim-Scanned: Yes (on smtp.onerussian.com) X-Mailing-List: archive/latest/19147 List-ID: List-URL: List-Archive: https://lists.debian.org/msgid-search/YJ0s+rrUdeOZw2jq@lena.dartmouth.edu Approved: robomod@news.nic.it Lines: 43 Organization: linux.* mail to news gateway Sender: robomod@news.nic.it X-Original-Date: Thu, 13 May 2021 09:43:22 -0400 X-Original-Message-ID: X-Original-References: <20210512212118.r37fau7lw5lbh72e@satie.tumbleweed.org.za> Xref: csiph.com linux.debian.maint.python:13360 FWIW, if might come handy in the future, my 4c: > * What do we provide for scientific / data scientist use cases? - https://snapshot.debian.org/ is the unique service allowing to "go back in time" or just "freeze" the environment given a date. Very handy for reproducibility, collab, etc. Not possible AFAIK on pypi or even conda unless researcher prepared a full exhaustive list of frozen package==version@build nd_freeze from neurodebian-freeze assists in making use of that feature. I just stick it at the top of my Dockerfile/Singularity file recipes to make container itself as reproducible as possible, so later on I could add another component less likely affecting already existing ones. - wider arch support for extensions and non-python libraries/tools. ppc64el is gaining some momentum AFAIK in sci computing - better guarantees to achieve desired installation goal. examples of pip/conda failing to resolve depends are more numerous AFAIK. - integration and downstream testing at package build time and via https://ci.debian.net/ anyone who cares to not only "get it running" but have some assurance of correct operation (not junk-in-junk-out) should appreciate that. pypi has no concerns on that at all. conda is doing quite good job and does allow for some downstream testing. But it remains "more fluid", unlike a clear cut releases of debian with better guarantees for correct operation -- Yaroslav O. Halchenko Center for Open Neuroscience http://centerforopenneuroscience.org Dartmouth College, 419 Moore Hall, Hinman Box 6207, Hanover, NH 03755 WWW: http://www.linkedin.com/in/yarik