Thanks Mike. I'll look at the pointers you've given.<div>Regards,</div><div>Kashyap<br><br><div class="gmail_quote">On Fri, Apr 30, 2010 at 8:01 PM, Mike Dillon <span dir="ltr"><<a href="mailto:mike@embody.org">mike@embody.org</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">I think you'll want to look at the Hadoop Streaming or Hadoop Pipes API.<br>
<br>
Further down the line, I think somebody will want to implement a Haskell<br>
library to deal with the Avro serialization protocol when it becomes<br>
possible to write non-JVM mappers and reducers directly. This JIRA issue<br>
covers the RPC part of the Avro-Hadoop integration work:<br>
<br>
<a href="https://issues.apache.org/jira/browse/HADOOP-6659" target="_blank">https://issues.apache.org/jira/browse/HADOOP-6659</a><br>
<br>
Looks like folks have already implemented support for Thrift and<br>
Protocol Buffers, so implementing a library for Avro would likely be<br>
pretty similar.<br>
<br>
-md<br>
<br>
begin C K Kashyap quotation:<br>
<div><div></div><div class="h5">> Dear Haskellers,<br>
><br>
> A big part of my new job requires tuning app's on Hadoop. I was wondering if<br>
> there is a way to push some Haskell code in the mix. I did some googling on<br>
> "Hadoop/Haskell" and came across Holumbus - but looks like that is parallel<br>
> to Hadoop.<br>
><br>
> I was thinking in the lines of doing a Haskell implementation that could run<br>
> in a Hadoop cluster - has anyone tried anything like that?<br>
><br>
> --<br>
> Regards,<br>
> Kashyap<br>
<br>
</div></div><div><div></div><div class="h5">> _______________________________________________<br>
> Haskell-Cafe mailing list<br>
> <a href="mailto:Haskell-Cafe@haskell.org">Haskell-Cafe@haskell.org</a><br>
> <a href="http://www.haskell.org/mailman/listinfo/haskell-cafe" target="_blank">http://www.haskell.org/mailman/listinfo/haskell-cafe</a><br>
<br>
</div></div></blockquote></div><br><br clear="all"><br>-- <br>Regards,<br>Kashyap<br>
</div>