MapReduce with CloudHaskell
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.
Introduction
This is documentation of my work on developing a proof-of-concept demonstrator for MapReduce using CloudHaskell to provide a framewok for distributed applications, and the monadic approach to MapReduce described here.
Status
Storage
I have developed a very simple distributed storage service that provides what is needed to ship data to each processing node at the start of each round of processing, and then to assemble their outputs ready to form the input for the next round.
- Description of what I have done here
- A working application can be found at git://github.com/Julianporter/Distributed-Haskell.git
Code to be placed on Hackage when more robust.
Distributed job scheduler
Not yet started.
julianporter 18:20, 31 October 2011 (UTC)