Suggestions for summarizing buildbot test results

[Ian Lynagh]

Hi Thorkil,

On Wed, Apr 04, 2007 at 02:37:09PM +0200, Thorkil Naur wrote:
> 
>                       0123456789 Summary
>   tatd2 x86 OSX head
>   tatd2 x86 OSX 6.6         ++++ *
>   tatd2 PPC OSX head  .|.|.|.|.| |
>   tatd2 PPC OSX 6.6   ||--       *
>   tnaur PPC OSX 6.6   .-.-.-.-.- -
>   Summary             **** *****

I like the idea, but I'm not sure having it in the nightly e-mails would
work well. As the amount of information increases, I think people will
tend to just skip over it.

I think it would be better as a webpage, where you also have the ability
to use colour to show the information, and perhaps even to generate
images rather than text.

Also, Simon PJ suggested that the nightly e-mails could have both HTML
and text alternatives, so the HTML part could link to the webpage for
each of the failing tests.

> (It seems that something useful would result if the test results were somehow 
> easily accessible in a Haskell program, something that could very well be 
> easy to arrange.)

Perhaps storing them in some sort of database could be interesting, once
we have results for a year or two?


Thanks
Ian