Checkins and test passing

[Simon Marlow]

Malcolm Wallace wrote:
> Simon Marlow <simonmarhaskell at gmail.com> wrote:
> 
> 
>>the other meaning, that you were expecting, is
>>
>>    fail     = "exits with a non-zero exit code"
>>    expected = "exiting with non-zero exit code is the correct behaviour"
>>
>>"desired" wouldn't be right - all failures are undesired.
> 
> 
> Not so.  It is perfectly desired for a program to reject incorrect
> input, and this is certainly something for which one might wish to have
> a regression test.

Malcolm, you're misunderstanding the use of the term "fail" in this context.  I 
stated it in that message, but you cut off the quote:

    fail     = "exhibits incorrect behaviour"
    expected = "we know about the bug and don't intend to fix it soon"

This makes perfect sense in the context of the result of a particular *test*. 
You want to know whether the test demonstrated incorrect behaviour of the thing 
you were testing; whether the thing returned a non-zero exit code or not is 
beside the point.

All failures are undesired, because they demonstrate incorrect behaviour.

Cheers,
	Simon