Groups > comp.lang.python.announce > #2156

Are you interested in distinguishing between assertion violations and other kinds of failures in test cases?

Path	csiph.com!fu-berlin.de!uni-berlin.de!not-for-mail
From	Venkatesh Prasad Ranganath <rvprasad@ksu.edu>
Newsgroups	comp.lang.python.announce
Subject	Are you interested in distinguishing between assertion violations and other kinds of failures in test cases?
Date	Mon, 30 May 2016 19:37:01 -0500
Lines	18
Sender	venkateshprasad.ranganath@gmail.com
Approved	python-announce-list@python.org
Message-ID	<mailman.49.1464701271.1839.python-announce-list@python.org> (permalink)
References	<CACYG_RWqFoinEXKmcJZsMqsUv=eir5s9hX_DEcZTy+gjwpWZ=g@mail.gmail.com>
Mime-Version	1.0
Content-Type	text/plain; charset=UTF-8
X-Trace	news.uni-berlin.de Ip/LfG0G1G/r6lqXMnOsRwYH69DLIa8kOzZPeIHLyUCw==
Return-Path	<venkateshprasad.ranganath@gmail.com>
X-Original-To	python-announce-list@python.org
Delivered-To	python-announce-list@mail.python.org
X-Spam-Status	OK 0.008
X-Spam-Evidence	'H': 0.98; 'S': 0.00; 'url:pypi': 0.03; 'pypi': 0.07; 'subject:test': 0.07; 'sfxlen:2': 0.10; '<>.': 0.11; 'exception': 0.13; 'subject: \n ': 0.15; '(f)': 0.16; 'pytest': 0.16; 'received:io': 0.16; 'received:psf.io': 0.16; 'subject:between': 0.16; 'subject:failures': 0.16; 'tested)': 0.16; 'sender:addr:gmail.com': 0.18; 'case.': 0.18; 'pfxlen:0': 0.18; 'changes': 0.20; 'to:21': 0.21; 'errors': 0.23; 'to:no real name:21': 0.27; 'message-id:@mail.gmail.com': 0.27; 'subject:skip:d 10': 0.27; 'skip:u 20': 0.28; 'currently,': 0.29; 'subject:other': 0.29; 'reporting': 0.29; 'url:python': 0.33; 'flags': 0.33; 'received:google.com': 0.35; 'execution': 0.35; 'skip:* 20': 0.35; 'there': 0.36; 'url:org': 0.36; 'received:209.85': 0.36; 'subject:?': 0.36; 'being': 0.37; 'received:209': 0.38; 'skip:p 20': 0.38; 'test': 0.39; 'to:addr:python.org': 0.40; 'hope': 0.61; '(that': 0.63; 'url:0': 0.63; 'url:me': 0.64; 'useful.': 0.72; 'plugin.': 0.84; 'subject:kinds': 0.84; 'subject:you': 0.85; 'subject:Are': 0.95
DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to; bh=8dg1XK8jp59/xvv4mqoKfU9eTrgdHel5ve+2dQzoA4o=; b=ipr0DQ1wPE6SyDQP4DFFxpWteD5i3bBpsxOtGbEH4PP9w1mpvm9fdyTGXyefbcn+da JC/Gew4Md1eNcgsc6t2LtsLboKlk6MxKQmc2fe00yNsTaR9XALMZJGB6kkzGNdS37zZ1 UGex+z03LoFsoqtQBIUmItn1MRHhiilMvONdk4Qtk6HU6Ilh1AYVpVA13m5rwVzmiMaE op1KDUlOozXvMp/Nuw/YpjDOC58lTryx3MOJi9LHqVF40MOAOhYDeNe1Dg/OWGTQqZBs LdFZZfEGW0HVBWlS2w65x0jaLqDCHd71LIbzkEro6AEuUS/SwYcsdd+hZS1pJKuawaPb 1Mlg==
X-Google-DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:date:message-id:subject:from :to; bh=8dg1XK8jp59/xvv4mqoKfU9eTrgdHel5ve+2dQzoA4o=; b=b6pZjxFF+VjsIHqNHVS5gcJCOpCGXvEG1oQNXMzMwXV0m8GI2Rc9V2z89Xr0gnQz9d q2TRZwM5dqwN8seIyz2Xu6hSLwiaXpG8wRhi2PO07tq049MQ7vAM0/j88xs5Y4VH2UQs hyZCUaWPSY4atSyFv76Oy2cvWe0rf8aKMYo08lmW0WmoxQspJmBei+VoySPogr0kKj2x RjiWM83aj/S+oDpCJalmlLgsMRVVPl930h4Vu5z6ay77Elyfzrf2vqPF18ES9o5b8dKA AXhSNIrxUZIEJZvXtv2TyFmr59FKUJK8J1NLoffPu4e7CQHYyekKSMlQuh99+/qLR2Ls Ccsg==
X-Gm-Message-State	ALyK8tLHomRGVPIjl83f0/bJPO1s9vA48jmS0155fOLWZYuaQ6ATFi21QnxoLFNhZLTDy5EtHlTcrxbWm/FSuQ==
X-Received	by 10.98.36.140 with SMTP id k12mr50523516pfk.118.1464655021938; Mon, 30 May 2016 17:37:01 -0700 (PDT)
X-Google-Sender-Auth	_MIYT9epUMmzROiHhVpldef4mSo
X-Mailman-Approved-At	Tue, 31 May 2016 09:27:50 -0400
X-Content-Filtered-By	Mailman/MimeDel 2.1.22
X-BeenThere	python-announce-list@python.org
X-Mailman-Version	2.1.22
Precedence	list
List-Id	Announcement-only list for the Python programming language <python-announce-list.python.org>
List-Unsubscribe	<https://mail.python.org/mailman/options/python-announce-list>, <mailto:python-announce-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-announce-list/>
List-Post	<mailto:python-announce-list@python.org>
List-Help	<mailto:python-announce-list-request@python.org?subject=help>
List-Subscribe	<https://mail.python.org/mailman/listinfo/python-announce-list>, <mailto:python-announce-list-request@python.org?subject=subscribe>
X-Mailman-Original-Message-ID	<CACYG_RWqFoinEXKmcJZsMqsUv=eir5s9hX_DEcZTy+gjwpWZ=g@mail.gmail.com>
Xref	csiph.com comp.lang.python.announce:2156

Show key headers only | View raw

Currently, pytest flags a test case as failed if there is either an
uncaught exception or an assertion violation during the execution of the
test case.  This conflates failures in the UUT or the test case (that do
not pertain to the property being tested) as violation of the property
being tested.

This issue is addressed by *pytest-finer-verdicts* plugin.  The plugin
changes the reporting scheme to report assertion violations as test
failures (F) and other kinds of failures as test errors (E).

The plugin is available on PyPI --
https://pypi.python.org/pypi/pytest-finer-verdicts/
<https://pypi.python.org/pypi/pytest-finer-verdicts/1.0>.

We hope you find the plugin useful.

Venkatesh-Prasad Ranganath
http://about.me/rvprasad

Back to comp.lang.python.announce | Previous | Next | Find similar | Unroll thread

Thread

Are you interested in distinguishing between assertion violations and other kinds of failures in test cases? Venkatesh Prasad Ranganath <rvprasad@ksu.edu> - 2016-05-30 19:37 -0500

csiph-web