search

forward / mandy

Easy Map/Reduce with Hadoop and Ruby. Also see http://github.com/forward/mandy-lab for examples.
mandyruby.pbworks.com
Other
45 stars 9 forks source link

combiner and partitioner? #3

Open tcurdt opened 12 years ago

tcurdt commented 12 years ago

I cannot seem to find how write a combiner and partitioner. No support yet?

andykent commented 12 years ago

Their isn't currently any built in support but I think it should be easy to add and patches would be welcomed.

tcurdt commented 12 years ago

Oh, wait - mandy uses streaming under the hood. While the combiner could be simulated through a pipe it's a no go for at least the partitioner. Darn, mandy looked promising. Off to evaluate the next framework :-/

andykent commented 12 years ago

You can find a JRuby fork at https://github.com/abhinay/jmandy if that's any help?

tcurdt commented 12 years ago

Uh. Interesting - thanks for the pointer!