Checkins and test passing
simonmarhaskell at gmail.com
Mon Oct 23 08:52:02 EDT 2006
Malcolm Wallace wrote:
> Simon Marlow <simonmarhaskell at gmail.com> wrote:
>>the other meaning, that you were expecting, is
>> fail = "exits with a non-zero exit code"
>> expected = "exiting with non-zero exit code is the correct behaviour"
>>"desired" wouldn't be right - all failures are undesired.
> Not so. It is perfectly desired for a program to reject incorrect
> input, and this is certainly something for which one might wish to have
> a regression test.
Malcolm, you're misunderstanding the use of the term "fail" in this context. I
stated it in that message, but you cut off the quote:
fail = "exhibits incorrect behaviour"
expected = "we know about the bug and don't intend to fix it soon"
This makes perfect sense in the context of the result of a particular *test*.
You want to know whether the test demonstrated incorrect behaviour of the thing
you were testing; whether the thing returned a non-zero exit code or not is
beside the point.
All failures are undesired, because they demonstrate incorrect behaviour.
More information about the Cvs-ghc