Path: csiph.com!fu-berlin.de!uni-berlin.de!not-for-mail
From: Venkatesh Prasad Ranganath <rvprasad@ksu.edu>
Newsgroups: comp.lang.python.announce
Subject: Are you interested in distinguishing between assertion violations and other kinds of failures in test cases?
Date: Mon, 30 May 2016 19:37:01 -0500
Lines: 18
Sender: venkateshprasad.ranganath@gmail.com
Approved: python-announce-list@python.org
Message-ID: <mailman.49.1464701271.1839.python-announce-list@python.org>
References: <CACYG_RWqFoinEXKmcJZsMqsUv=eir5s9hX_DEcZTy+gjwpWZ=g@mail.gmail.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=UTF-8
X-Trace: news.uni-berlin.de Ip/LfG0G1G/r6lqXMnOsRwYH69DLIa8kOzZPeIHLyUCw==
Return-Path: <venkateshprasad.ranganath@gmail.com>
X-Original-To: python-announce-list@python.org
Delivered-To: python-announce-list@mail.python.org
X-Spam-Status: OK 0.008
X-Spam-Evidence: '*H*': 0.98; '*S*': 0.00; 'url:pypi': 0.03; 'pypi': 0.07; 'subject:test': 0.07; 'sfxlen:2': 0.10; '<>.': 0.11; 'exception': 0.13; 'subject: \n ': 0.15; '(f)': 0.16; 'pytest': 0.16; 'received:io': 0.16; 'received:psf.io': 0.16; 'subject:between': 0.16; 'subject:failures': 0.16; 'tested)': 0.16; 'sender:addr:gmail.com': 0.18; 'case.': 0.18; 'pfxlen:0': 0.18; 'changes': 0.20; 'to:2**1': 0.21; 'errors': 0.23; 'to:no real name:2**1': 0.27; 'message-id:@mail.gmail.com': 0.27; 'subject:skip:d 10': 0.27; 'skip:u 20': 0.28; 'currently,': 0.29; 'subject:other': 0.29; 'reporting': 0.29; 'url:python': 0.33; 'flags': 0.33; 'received:google.com': 0.35; 'execution': 0.35; 'skip:* 20': 0.35; 'there': 0.36; 'url:org': 0.36; 'received:209.85': 0.36; 'subject:?': 0.36; 'being': 0.37; 'received:209': 0.38; 'skip:p 20': 0.38; 'test': 0.39; 'to:addr:python.org': 0.40; 'hope': 0.61; '(that': 0.63; 'url:0': 0.63; 'url:me': 0.64; 'useful.': 0.72; 'plugin.': 0.84; 'subject:kinds': 0.84; 'subject:you': 0.85; 'subject:Are': 0.95
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to; bh=8dg1XK8jp59/xvv4mqoKfU9eTrgdHel5ve+2dQzoA4o=; b=ipr0DQ1wPE6SyDQP4DFFxpWteD5i3bBpsxOtGbEH4PP9w1mpvm9fdyTGXyefbcn+da JC/Gew4Md1eNcgsc6t2LtsLboKlk6MxKQmc2fe00yNsTaR9XALMZJGB6kkzGNdS37zZ1 UGex+z03LoFsoqtQBIUmItn1MRHhiilMvONdk4Qtk6HU6Ilh1AYVpVA13m5rwVzmiMaE op1KDUlOozXvMp/Nuw/YpjDOC58lTryx3MOJi9LHqVF40MOAOhYDeNe1Dg/OWGTQqZBs LdFZZfEGW0HVBWlS2w65x0jaLqDCHd71LIbzkEro6AEuUS/SwYcsdd+hZS1pJKuawaPb 1Mlg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:date:message-id:subject:from :to; bh=8dg1XK8jp59/xvv4mqoKfU9eTrgdHel5ve+2dQzoA4o=; b=b6pZjxFF+VjsIHqNHVS5gcJCOpCGXvEG1oQNXMzMwXV0m8GI2Rc9V2z89Xr0gnQz9d q2TRZwM5dqwN8seIyz2Xu6hSLwiaXpG8wRhi2PO07tq049MQ7vAM0/j88xs5Y4VH2UQs hyZCUaWPSY4atSyFv76Oy2cvWe0rf8aKMYo08lmW0WmoxQspJmBei+VoySPogr0kKj2x RjiWM83aj/S+oDpCJalmlLgsMRVVPl930h4Vu5z6ay77Elyfzrf2vqPF18ES9o5b8dKA AXhSNIrxUZIEJZvXtv2TyFmr59FKUJK8J1NLoffPu4e7CQHYyekKSMlQuh99+/qLR2Ls Ccsg==
X-Gm-Message-State: ALyK8tLHomRGVPIjl83f0/bJPO1s9vA48jmS0155fOLWZYuaQ6ATFi21QnxoLFNhZLTDy5EtHlTcrxbWm/FSuQ==
X-Received: by 10.98.36.140 with SMTP id k12mr50523516pfk.118.1464655021938; Mon, 30 May 2016 17:37:01 -0700 (PDT)
X-Google-Sender-Auth: _MIYT9epUMmzROiHhVpldef4mSo
X-Mailman-Approved-At: Tue, 31 May 2016 09:27:50 -0400
X-Content-Filtered-By: Mailman/MimeDel 2.1.22
X-BeenThere: python-announce-list@python.org
X-Mailman-Version: 2.1.22
Precedence: list
List-Id: Announcement-only list for the Python programming language <python-announce-list.python.org>
List-Unsubscribe: <https://mail.python.org/mailman/options/python-announce-list>, <mailto:python-announce-list-request@python.org?subject=unsubscribe>
List-Archive: <http://mail.python.org/pipermail/python-announce-list/>
List-Post: <mailto:python-announce-list@python.org>
List-Help: <mailto:python-announce-list-request@python.org?subject=help>
List-Subscribe: <https://mail.python.org/mailman/listinfo/python-announce-list>, <mailto:python-announce-list-request@python.org?subject=subscribe>
X-Mailman-Original-Message-ID: <CACYG_RWqFoinEXKmcJZsMqsUv=eir5s9hX_DEcZTy+gjwpWZ=g@mail.gmail.com>
Xref: csiph.com comp.lang.python.announce:2156

Currently, pytest flags a test case as failed if there is either an
uncaught exception or an assertion violation during the execution of the
test case.  This conflates failures in the UUT or the test case (that do
not pertain to the property being tested) as violation of the property
being tested.

This issue is addressed by *pytest-finer-verdicts* plugin.  The plugin
changes the reporting scheme to report assertion violations as test
failures (F) and other kinds of failures as test errors (E).

The plugin is available on PyPI --
https://pypi.python.org/pypi/pytest-finer-verdicts/
<https://pypi.python.org/pypi/pytest-finer-verdicts/1.0>.

We hope you find the plugin useful.

Venkatesh-Prasad Ranganath
http://about.me/rvprasad