Personal tools

HaBench

From HaskellWiki

(Difference between revisions)
Jump to: navigation, search
(Ideas)
(added suggestions by JohhMeacam and ndm)
Line 1: Line 1:
= HaBench: The Haskell Benchmark Suite =
+
= Haskell Benchmark Suite =
   
 
Recent discussions have illustrated the need for an up-to-date Haskell benchmark suite. The goal would be to package a number of representative benchmarks, written in Haskell, which users can run on their machine. Gathering (and publishing) performance numbers for these benchmarks on a number of different machines will hopefully help in guiding future development of both Haskell compilers and programs.
 
Recent discussions have illustrated the need for an up-to-date Haskell benchmark suite. The goal would be to package a number of representative benchmarks, written in Haskell, which users can run on their machine. Gathering (and publishing) performance numbers for these benchmarks on a number of different machines will hopefully help in guiding future development of both Haskell compilers and programs.
Line 12: Line 12:
 
* '''Neil Mitchell''' - ''ndm on #haskell@FreeNode'' (suggestions/Yhc support/user)
 
* '''Neil Mitchell''' - ''ndm on #haskell@FreeNode'' (suggestions/Yhc support/user)
 
* <add '''your name''' here if you want to contribute!>
 
* <add '''your name''' here if you want to contribute!>
  +
  +
== Naming ==
  +
  +
* HaBench (intented to be '''the''' Haskell Benchmark Suite)
  +
* nofib/nofib 2.0 (follow-up of well-known nofib)
   
 
== Ideas ==
 
== Ideas ==
   
* start from the (out-of-date?) nofib benchmark suite (GHC-only, includes ghcisms) ([http://www.dcs.gla.ac.uk/fp/software/ghc/nofib.html website])
+
* start from the (out-of-date?) nofib benchmark suite (GHC-only, includes ghcisms, but very usefull programs (gzip in pure Haskell, a whole strictness analysis pass of a compiler, quantum mechanics simulator and other _real_ stuff (JohnMeacam)) ([http://www.dcs.gla.ac.uk/fp/software/ghc/nofib.html website])
 
* include Computer Language Shootout submissions ([http://shootout.alioth.debian.org/gp4/benchmark.php?test=all&lang=ghc&lang2=ghc website])
 
* include Computer Language Shootout submissions ([http://shootout.alioth.debian.org/gp4/benchmark.php?test=all&lang=ghc&lang2=ghc website])
 
* microbenchmarks for comparison with C (for example bytecopying) (dons)
 
* microbenchmarks for comparison with C (for example bytecopying) (dons)
Line 21: Line 26:
 
* multiple Haskell compilers (GHC, JHC, ...)
 
* multiple Haskell compilers (GHC, JHC, ...)
 
* maintain benchmark according to Hackage ([http://hackage.haskell.org/packages/archive/pkg-list.html Hackage list])
 
* maintain benchmark according to Hackage ([http://hackage.haskell.org/packages/archive/pkg-list.html Hackage list])
* Rename this project as nofib, otherwise it is like that people will have to run both this ''and'' nofib, because people will ask for the nofib results as well
+
* Rename this project as nofib, otherwise it is like that people will have to run both this ''and'' nofib, because people will ask for the nofib results as well (ndm)
 
* [http://haskell.org/haskellwiki/Libraries_and_tools Libraries and tools in Haskell]
 
* [http://haskell.org/haskellwiki/Libraries_and_tools Libraries and tools in Haskell]
   

Revision as of 12:30, 26 January 2007

Contents

1 Haskell Benchmark Suite

Recent discussions have illustrated the need for an up-to-date Haskell benchmark suite. The goal would be to package a number of representative benchmarks, written in Haskell, which users can run on their machine. Gathering (and publishing) performance numbers for these benchmarks on a number of different machines will hopefully help in guiding future development of both Haskell compilers and programs.

1.1 Contributors

  • Kenneth Hoste - boegel on #haskell@FreeNode (ideas/advice/Wiki page maintainer)
  • Donald Bruce Stewart - dons on #haskell@FreeNode (darcs repo maintainer (probably))
  • Andy Georges - Itkovian on #haskell@FreeNode (measurements/analysis/advice)
  • John Meacam - JohnMeacam on #haskell@FreeNode (advice/JHC support)
  • Arthur van Leeuwen - earthy on #haskell@FreeNode (Computer Language Shootout man-on-the-insde)
  • Neil Mitchell - ndm on #haskell@FreeNode (suggestions/Yhc support/user)
  • <add your name here if you want to contribute!>

1.2 Naming

 * HaBench (intented to be the Haskell Benchmark Suite)
 * nofib/nofib 2.0 (follow-up of well-known nofib)

1.3 Ideas

  • start from the (out-of-date?) nofib benchmark suite (GHC-only, includes ghcisms, but very usefull programs (gzip in pure Haskell, a whole strictness analysis pass of a compiler, quantum mechanics simulator and other _real_ stuff (JohnMeacam)) (website)
  • include Computer Language Shootout submissions (website)
  • microbenchmarks for comparison with C (for example bytecopying) (dons)
  • both a Haskell98 and Haskell'-only (sub)suite (JohnMeacam)
  • multiple Haskell compilers (GHC, JHC, ...)
  • maintain benchmark according to Hackage (Hackage list)
  • Rename this project as nofib, otherwise it is like that people will have to run both this and nofib, because people will ask for the nofib results as well (ndm)
  • Libraries and tools in Haskell

1.4 Notes

Random notes are below.

  • (JohnMeacham) Insert non-formatted text here pretty much every compiler has a mode similar to 'ghc --make', so just let the user specify an arbitrary command line for the compiler to use, like 'jhc -v -flint $< -o $@' or 'ghc --make $< -o $@'

1.5 More info?

1.6 Comments

Comments? Feel free to add them! Suggestions? Mail Kenneth at kenneth [dot] hoste [at] elis [dot] ugent [dot] be .