Groups > linux.debian.maint.python > #13047

How to run unit tests?

Path	csiph.com!news.mixmin.net!aioe.org!bofh.it!news.nic.it!robomod
From	Peter Wienemann <fossdev@posteo.de>
Newsgroups	linux.debian.maint.python
Subject	How to run unit tests?
Date	Tue, 08 Dec 2020 21:40:02 +0100
Message-ID	<BjRWa-1Dl-11@gated-at.bofh.it> (permalink)
X-Original-To	Debian Python <debian-python@lists.debian.org>
X-Mailbox-Line	From debian-python-request@lists.debian.org Tue Dec 8 20:33:35 2020
Old-Return-Path	<fossdev@posteo.de>
X-Amavis-Spam-Status	No, score=-9.478 tagged_above=-10000 required=5.3 tests=[BAYES_00=-2, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, LDO_WHITELIST=-5, MURPHY_DRUGS_REL8=0.02, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001] autolearn=ham autolearn_force=no
X-Policyd-Weight	NOT_IN_SBL_XBL_SPAMHAUS=-1.5 CL_IP_EQ_HELO_IP=-2 (check from: .posteo. - helo: .mout02.posteo. - helo-domain: .posteo.) FROM/MX_MATCHES_HELO(DOMAIN)=-2; rate: -5.5
Dkim-Signature	v=1; a=rsa-sha256; c=relaxed/simple; d=posteo.de; s=2017; t=1607459593; bh=USwNeP0RwgXhGsTIKqdDc1zEHOEu30PbH0s0cf2Y/JI=; h=From:Subject:To:Date:From; b=VQLjyNtUTd2ebhqFoB9yJX2jz2ic/ne9OJWcLRr9KnC92mSMrJa63cZPW3ccUsTaE fftopOhtsdi3mANpvFfCQSSZzw3A6xdAz2kPgTpfV/kMKLZV+mUg/nVsNAHgVvpJdh HeHWyi7K4IxK5uVHSomF/+VGUKnhd9H0MLhoSirx3XdbXfgg87DwzTaIUte/K3CXE/ GNR+d2sAqYx1v0fgCgUCM5stlNxj3RaeiHD1YQQ4Wyfu6sxdW2s4pZi+D4jjb8ps5A gp53Xn5CbSY4BgMVX37qjXi+FU752KoV3hICa3D8bvp/jaztsj2ggp22xMaNMAgfF3 mpl7WkZAnA3PA==
User-Agent	Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.5.1
MIME-Version	1.0
Content-Type	text/plain; charset=utf-8; format=flowed
Content-Language	en-US
Content-Transfer-Encoding	7bit
X-Mailing-List	<debian-python@lists.debian.org> archive/latest/18815
List-ID	<debian-python.lists.debian.org>
List-URL	<https://lists.debian.org/debian-python/>
List-Archive	https://lists.debian.org/msgid-search/ca4e7355-7290-16a7-805f-66e952f99d9d@posteo.de
Approved	robomod@news.nic.it
Lines	32
Organization	linux.* mail to news gateway
Sender	robomod@news.nic.it
X-Original-Date	Tue, 8 Dec 2020 21:33:03 +0100
X-Original-Message-ID	<ca4e7355-7290-16a7-805f-66e952f99d9d@posteo.de>
Xref	csiph.com linux.debian.maint.python:13047

Show key headers only | View raw

Dear Python experts,

in trying to update the python-lark package [0] to the most recent 
upstream version, an interesting issue regarding unit tests showed up 
[1]. Depending on how one runs unit tests they either fail or not. Tried 
options are:

1. PYTHONWARNINGS=d pythonX -m unittest discover -v tests
2. pythonX setup.py test
3. pythonX -m tests

Upstream uses option 3 in its CI testing [2] and did not see any issues 
with lark release 0.11.1. dh_auto_test seems to use option 2 by default 
(for the pybuild build system). For autopkgtest I have chosen to use 
option 1. The latter two options both fail for version 0.11.1. After 
applying a patch provided by upstream [3], also option 2 works but 
option 1 still fails. Upstream suggested to change the way the 
(autopkgtest) tests are run [4].

I am reluctant to do this without a better understanding of the 
differences between the above three options. Can anybody shed some light 
on the differences between them? Is there something like a general 
recommendation on what is the best way to run Python unit tests?

Peter

[0] https://salsa.debian.org/python-team/packages/python-lark
[1] https://github.com/lark-parser/lark/issues/792
[2] 
https://github.com/lark-parser/lark/blob/0.11.1/.github/workflows/tests.yml#L28
[3] https://github.com/lark-parser/lark/pull/782
[4] https://github.com/lark-parser/lark/issues/792#issuecomment-739504664

Back to linux.debian.maint.python | Previous | Next — Next in thread | Find similar | Unroll thread

Thread

How to run unit tests? Peter Wienemann <fossdev@posteo.de> - 2020-12-08 21:40 +0100
  Re: How to run unit tests? Andrey Rahmatullin <wrar@debian.org> - 2020-12-08 21:50 +0100
    Re: How to run unit tests? Peter Wienemann <fossdev@posteo.de> - 2020-12-12 16:40 +0100

csiph-web