Difference between revisions of "MapReduce with CloudHaskell"

From HaskellWiki
Jump to navigation Jump to search
 
Line 12: Line 12:
   
 
* Description of what I have done [http://jpembeddedsolutions.files.wordpress.com/2011/10/storage.pdf here]
 
* Description of what I have done [http://jpembeddedsolutions.files.wordpress.com/2011/10/storage.pdf here]
* A working application can be found at <span style="color:blue">git://github.com/Julianporter/Distributed-Haskell.git</span>
+
* A working application can be found at [http://github.com/Julianporter/Distributed-Haskell git://github.com/Julianporter/Distributed-Haskell.git]
   
 
Code to be placed on Hackage when more robust.
 
Code to be placed on Hackage when more robust.

Latest revision as of 16:31, 1 November 2011


Introduction

This is documentation of my work on developing a proof-of-concept demonstrator for MapReduce using CloudHaskell to provide a framewok for distributed applications, and the monadic approach to MapReduce described here.

Status

Storage

I have developed a very simple distributed storage service that provides what is needed to ship data to each processing node at the start of each round of processing, and then to assemble their outputs ready to form the input for the next round.

Code to be placed on Hackage when more robust.

Distributed job scheduler

Not yet started.

julianporter 18:20, 31 October 2011 (UTC)