Merge Request: LLVM Code Generator for GHC
Malcolm Wallace
Malcolm.Wallace at cs.york.ac.uk
Thu Feb 25 06:26:31 EST 2010
> The most interesting observation seems to be that the results are
> largely inconsistent (look at 'atom', for example). Even wheel-
> sieve1, where our numbers go in the same direction, varies between
> +10% and +22.7%. My numbers are from an older HEAD (as I had nofib
> handy there), but I'm still wondering where this difference comes
> from. Is it just that different processors are more or less
> sensible to TNTC?
There is a video of a Google Tech Talk on the topic of how
inconsistent and confusing benchmark results arise.
http://www.youtube.com/watch?v=DKVRkfXrBpg
Well worth investing 50 minutes of your time, if you ever do any kind
of performance benchmarking. Warning: you may be shocked at how easy
it is for unforeseen and uncontrolled factors to obfuscate your
measurements, to the point of indicating a gain instead of a loss, and
vice versa. Something as random as library link-order can flip the
sign...
Regards,
Malcolm
More information about the Cvs-ghc
mailing list