search

twitter / summingbird

Streaming MapReduce with Scalding and Storm
https://twitter.com/summingbird
Apache License 2.0
2.14k stars 267 forks source link

Pg/force futures better #670

Closed pankajroark closed 8 years ago

pankajroark commented 8 years ago

Sending out early for review, will add tests soon.

johnynek commented 8 years ago

👍

merge when green.

Nice work working through this and measuring the improvement. Can you possibly think about adding a benchmarking system to the build so we can re-run those things (and maybe even thing about how to do a travis check of performance).

pankajroark commented 8 years ago

Yes, I ultimately plan to add benchmarks here. For now I'm working in our internal repo to refine/grow these benchmarks. We are woefully short of performance testing for online summingbird, want to fix that internally first and then contribute here.