Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.debian.maint.python > #12543

Re: Python Wheel Related Policy Change

Path csiph.com!news.mixmin.net!aioe.org!bofh.it!news.nic.it!robomod
From Stefano Rivera <stefanor@debian.org>
Newsgroups linux.debian.maint.python
Subject Re: Python Wheel Related Policy Change
Date Thu, 30 Apr 2020 20:40:02 +0200
Message-ID <A1mgi-1nf-23@gated-at.bofh.it> (permalink)
References <A183E-11c-5@gated-at.bofh.it> <A1bNU-3jZ-5@gated-at.bofh.it> <A1e94-4Bw-13@gated-at.bofh.it> <A1kev-a3-37@gated-at.bofh.it>
X-Original-To Scott Kitterman <debian@kitterman.com>
X-Mailbox-Line From debian-python-request@lists.debian.org Thu Apr 30 18:33:02 2020
Old-Return-Path <stefano@rivera.za.net>
X-Amavis-Spam-Status No, score=-6.332 tagged_above=-10000 required=5.3 tests=[BAYES_00=-2, CAPINIT=0.5, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.249, LDO_WHITELIST=-5, MURPHY_DRUGS_REL8=0.02] autolearn=ham autolearn_force=no
X-Policyd-Weight NOT_IN_SBL_XBL_SPAMHAUS=-1.5 CL_IP_EQ_FROM_MX=-3.1; rate: -4.6
Dkim-Signature v=1; a=ed25519-sha256; c=relaxed/simple; d=debian.org; i=@debian.org; q=dns/txt; s=satie-ed25519.stefanor.user; t=1588271544; h=date : from : to : cc : subject : message-id : references : mime-version : content-type : in-reply-to : from; bh=oqoyyGeNTRI5I9HEsQUupif6M+7T/2+NvKdfIsrsIyw=; b=vbOT/6Ag3qXnOsieOuNx94vAuyop0Iy27X0Qe0zCP01tOVbBGTpPJ2PTEFx07IKNs2mXV NB0pr/IqbWy3q+mBw==
Dkim-Signature v=1; a=rsa-sha256; c=relaxed/simple; d=debian.org; i=@debian.org; q=dns/txt; s=satie-rsa.stefanor.user; t=1588271544; h=date : from : to : cc : subject : message-id : references : mime-version : content-type : in-reply-to : from; bh=oqoyyGeNTRI5I9HEsQUupif6M+7T/2+NvKdfIsrsIyw=; b=Tfhe+WvDCmwFrCb0ZPnbVdVdmJ1AzJKlPDre1KhQOIjBLwQq7W9wo02c0rcT8PMaCxIpJ XIZlp8xpVirLn8RsX1BYym4G1+cBgTrmrFV17q3CQ2QTmrHj0vwstfCLvrBC5jXozeJm0hl mHC+TLQf0iSYVNZ7ohbgpEOgFXGHJyv610Hid+nrwPK9XiQ8qbi80SUT5DjDDG0MEDx2lSa ebmZQ98isOxrn+H9WdAafsFR1vuzRm1mMpcDZenmZZifxysJ6lqie0iRaWXuvBhrLwisMtS eZ7G5K7lhjKQQH0kvEYfiCrPIrG+eUqoeWHSrEbuGc//YwTDS0JH23FR7b2w==
Mail-Followup-To Scott Kitterman <debian@kitterman.com>, debian-python@lists.debian.org
MIME-Version 1.0
Content-Type text/plain; charset=utf-8
Content-Disposition inline
X-Gpg-Public-Key http://www.rivera.za.net/stefano.gpg
User-Agent NeoMutt/20180716
X-Mailing-List <debian-python@lists.debian.org> archive/latest/18227
List-ID <debian-python.lists.debian.org>
List-URL <https://lists.debian.org/debian-python/>
List-Archive https://lists.debian.org/msgid-search/20200430183223.g72jzsvaqd32etae@satie.tumbleweed.org.za
Approved robomod@news.nic.it
Lines 65
Organization linux.* mail to news gateway
Sender robomod@news.nic.it
X-Original-Cc debian-python@lists.debian.org
X-Original-Date Thu, 30 Apr 2020 18:32:24 +0000
X-Original-Message-ID <20200430183223.g72jzsvaqd32etae@satie.tumbleweed.org.za>
X-Original-References <2045632.ZOD33WiUoI@sk-desktop> <dc1c7d9e-7a38-3963-cdff-bcdac03170d9@debian.org> <9F008A2F-1394-4F62-9EA2-A420CB1EDBCA@kitterman.com> <7982820.PtiXLErMFD@sk-desktop>
Xref csiph.com linux.debian.maint.python:12543

Show key headers only | View raw


Hi Scott (2020.04.30_16:23:41_+0000)
> Making dirtbike build a py3 wheel for setuptools (and pkg_resources), which is 
> technically accurate at this point since dirtbike can't build wheels from a 
> python2 package was trivial to do:
> 
>  dirtbike/__init__.py | 6 +++++-
>  1 file changed, 5 insertions(+), 1 deletion(-)
> 
> Three of the five insertions were comment.

That seems reasonable, although if we're going down that road, it
probably makes no sense for any of them to be universal.

> If someone wants to provide a patch to dirtbike so it can also build wheels 
> from python-setuptools and python-pkg-resources, then we could add then to 
> build-depends and provide both a set of py2 wheels and py3 wheels for as long 
> as they are in the archive.

The window for doing this is probably closing, too.

I hacked this in Ubuntu 20.04, just before release:
https://launchpadlibrarian.net/475592029/python-pip_20.0.2-5_20.0.2-5ubuntu1.diff.gz

As you can see, python-wheel is no longer available, and some of the
other libraries dirtbike uses are probably heading that way.

So, to make that approach work, we have to introduce more py2-only
libraries again, or allow dirtbike to build py2 wheels while running
under python3.

> It still needs the Python policy change since they aren't universal, but it 
> would allow setuptools to keep up for python3 in pip without dropping the 
> local wheels from python2.  We also have ipaddr back in the archive to support 
> wheeling it so pip will run with python2.

But, without the py2 setuptools wheels, I don't know much that buys us.

Long-term: pypy (2.7) is going to continue to be around, until rpython
moves to python3 (which is still officially never, but people are
starting to poke at it).
https://doc.pypy.org/en/latest/faq.html#how-long-will-pypy-support-python2

If we have a python 2 interpreter, it's really nice to have working
virtualenv for it. Makes it a lot more useful for users, esp. as we
don't have many debian libraries packaged for it.

So, the options are:
1. pin pip dependencies at versions that support py2, forever. Obviously
   this is a no-go.
2. Ship py2 and py3 wheels.
   2.1. package the py2 weels with dirtbike. This requires bringing back
        python-wheel, or more work on dirtbike.
   2.2. Ship static py2 wheels (like we did pre-dirtbike). It's not like
        upstream is continuing development...
3. Let virtualenv always download pip from pypi for py2. Only ship py3
   wheels.

The easy options here are 2.2 and 3.

SR

-- 
Stefano Rivera
  http://tumbleweed.org.za/
  +1 415 683 3272

Back to linux.debian.maint.python | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread


Thread

Python Wheel Related Policy Change Scott Kitterman <debian@kitterman.com> - 2020-04-30 05:30 +0200
  Re: Python Wheel Related Policy Change Matthias Klose <doko@debian.org> - 2020-04-30 09:30 +0200
    Re: Python Wheel Related Policy Change Scott Kitterman <debian@kitterman.com> - 2020-04-30 12:00 +0200
      Re: Python Wheel Related Policy Change Scott Kitterman <debian@kitterman.com> - 2020-04-30 18:30 +0200
        Re: Python Wheel Related Policy Change Stefano Rivera <stefanor@debian.org> - 2020-04-30 20:40 +0200
          Re: Python Wheel Related Policy Change Scott Kitterman <debian@kitterman.com> - 2020-04-30 22:40 +0200
            Re: Python Wheel Related Policy Change Stefano Rivera <stefanor@debian.org> - 2020-04-30 23:50 +0200
              Re: Python Wheel Related Policy Change Scott Kitterman <debian@kitterman.com> - 2020-05-01 00:30 +0200
                Re: Python Wheel Related Policy Change Scott Kitterman <debian@kitterman.com> - 2020-05-01 22:50 +0200
                Re: Python Wheel Related Policy Change Nicholas D Steeves <nsteeves@gmail.com> - 2020-05-01 23:10 +0200

csiph-web