Groups > linux.debian.maint.python > #14845

Re: Helping hands needed to upgrade scipy

Path	csiph.com!news.mixmin.net!aioe.org!bofh.it!news.nic.it!robomod
From	Drew Parsons <dparsons@debian.org>
Newsgroups	linux.debian.maint.python
Subject	Re: Helping hands needed to upgrade scipy
Date	Wed, 18 Jan 2023 02:50:01 +0100
Message-ID	<FP5Kp-1aBI-3@gated-at.bofh.it> (permalink)
References	<FOXMR-15JS-1@gated-at.bofh.it>
X-Original-To	Andreas Tille <andreas@an3as.eu>
X-Mailbox-Line	From debian-python-request@lists.debian.org Wed Jan 18 01:45:55 2023
Old-Return-Path	<dparsons@debian.org>
X-Amavis-Spam-Status	No, score=-7.68 tagged_above=-10000 required=5.3 tests=[BAYES_00=-2, LDO_WHITELIST=-5, MURPHY_DRUGS_REL8=0.02, RCVD_IN_DNSWL_LOW=-0.7] autolearn=ham autolearn_force=no
X-Policyd-Weight	NOT_IN_SBL_XBL_SPAMHAUS=-1.5 CL_IP_EQ_HELO_IP=-2 (check from: .debian. - helo: .relay5-d.mail.gandi. - helo-domain: .gandi.) FROM/MX_MATCHES_NOT_HELO(DOMAIN)=0; rate: -3.5
MIME-Version	1.0
Reply-To	dparsons@debian.org
Mail-Reply-To	dparsons@debian.org
X-Sender	dparsons@debian.org
Organization	The Debian Project
Content-Type	text/plain; charset=US-ASCII; format=flowed
Content-Transfer-Encoding	7bit
X-Mailing-List	<debian-python@lists.debian.org> archive/latest/20727
List-ID	<debian-python.lists.debian.org>
List-URL	<https://lists.debian.org/debian-python/>
List-Archive	https://lists.debian.org/msgid-search/e60944905eb133866bcdd348bd05e1de@debian.org
Approved	robomod@news.nic.it
Lines	43
Sender	robomod@news.nic.it
X-Original-Cc	Debian Python <debian-python@lists.debian.org>, Debian Science List <debian-science@lists.debian.org>, Jochen Sprickerhof <jspricke@debian.org>
X-Original-Date	Wed, 18 Jan 2023 02:45:31 +0100
X-Original-Message-ID	<e60944905eb133866bcdd348bd05e1de@debian.org>
X-Original-References	<Y8bXClA6032kcjsR@an3as.eu>
Xref	csiph.com linux.debian.maint.python:14845

Show key headers only | View raw

On 2023-01-17 18:12, Andreas Tille wrote:
> Hi,
> 
> I upgraded the experimental branch of scipy to contain the submodules
> upstream includes.  I'm *not* convinced that we need them all -
> hopefully we can get rid of boost (but upstream has some patches here)
> and scipy-mathjax.
> 
> For the moment I've tried to build the experimental branch and ended
> up with some issue where cython can't be found (should be cython3 for
> sure)[1].
> 
> Unfortunately my spare time is occupied now by other more urgent tasks.
> I'd be happy if someone else could review / pick up / continue from
> here.

The problem was not meson as such, but that upstream is only half using 
meson.  They must have decided they don't trust the way meson handles 
cython, and set up their own custom build tools for it, see 
https://github.com/scipy/scipy/pull/15407

That is, they hard-coded the cython executable name in 
scipy/_build_utils/cythoner.py

They actually did the same already in the old setuptools build 
(tools/cythonize.py), but we didn't notice since they had the breaking 
cython call wrapped in a try block which inspected a Cython class from 
inside python.  I raised an Issue about  whether cythoner.py should do 
the same in https://github.com/scipy/scipy/issues/17808
We could argue the fault is debian's for not providing a cython 
executable (it does have -2 and -3 options for choosing the python 
version to work with).

I figure also we should use python3-mesonpy, since it's what upstream 
uses. Best not to diverge too far from their build method I think.

I've pushed commits updating cythoner.py to point cythoner.py at 
cython3.  The main build now completes. Have to clean up test handling 
next: "FileNotFoundError: [Errno 2] No such file or directory: 
'/projects/python/build/scipy/.coveragerc'

Drew

Thread

Helping hands needed to upgrade scipy Andreas Tille <andreas@an3as.eu> - 2023-01-17 18:20 +0100
  Re: Helping hands needed to upgrade scipy Jerome Kieffer <Jerome.Kieffer@esrf.fr> - 2023-01-17 18:50 +0100
  Re: Helping hands needed to upgrade scipy Drew Parsons <dparsons@debian.org> - 2023-01-18 02:50 +0100
    Re: Helping hands needed to upgrade scipy Andreas Tille <tille@debian.org> - 2023-01-18 08:30 +0100

csiph-web