search

twitter / summingbird

Streaming MapReduce with Scalding and Storm
https://twitter.com/summingbird
Apache License 2.0
2.14k stars 267 forks source link

Spark monad #607

Closed xudifsd closed 9 years ago

xudifsd commented 9 years ago

@isnotinvain #513 also bumped up spark version, 0.9.0-incubating is too old

johnynek commented 9 years ago

Thanks for doing this!

Hopefully we can get the spark platform be as well supported as the scalding platform.

xudifsd commented 9 years ago

@johnynek done, but I'm not sure why build failed, it's strange that it failed on summingbird-core, not summingbird-spark

johnynek commented 9 years ago

You got bit by #604. Restarted it. We need to figure out why that test fails occasionally. Is it a real issue with that platform or is it a deeper problem that the job itself is non-determinisitic in online summingbird fundamentally?

When this is green we can merge.

xudifsd commented 9 years ago

failed again..LOL, how to restart it?