Path: csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!newsfeed.datemas.de!rt.uk.eu.org!aioe.org!.POSTED!not-for-mail From: "Rod Pemberton" Newsgroups: comp.lang.forth Subject: Re: Hayes tester fails Date: Wed, 15 Jan 2014 02:40:28 -0500 Organization: Aioe.org NNTP Server Lines: 28 Message-ID: References: <2014Jan8.155803@mips.complang.tuwien.ac.at> <2014Jan9.135754@mips.complang.tuwien.ac.at> <2014Jan13.171841@mips.complang.tuwien.ac.at> NNTP-Posting-Host: CNsg4fVcCsvs3UaOgZtQCw.user.speranza.aioe.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit X-Complaints-To: abuse@aioe.org User-Agent: Opera Mail/12.16 (Linux) X-Notice: Filtered by postfilter v. 0.8.2 Xref: csiph.com comp.lang.forth:27907 On Tue, 14 Jan 2014 18:29:25 -0500, Ed wrote: > Anton Ertl wrote: >> "Ed" writes: >>> which will obviously show a positive outcome? >> >> What do you mean by that? > > What is says. You ask proposers to supply the tests and the cases to be > tested and you are expecting something other than a successful result? > This is no test but a fait accompli. I think you've assumed too much. A test may be successful by design for one group of proposers, and even another or another, but not necessarily succeed for some others. That could indicate an issue with 1) the implementation 2) the test or 3) undefined boundary conditions (etc). When implementing some of my "sanity" tests, I ran into differences in boundary issues in a number of Forths. Did that mean a Forth was incorrect or my test? I assumed the latter, although it could've been that Forth. If the issue is with the Forth, the author should have some way to encourage him/her/them to ask whether the behavior is correct or not. A set of tests can do that. Rod Pemberton