Storm platfrom fails in case of two sumByKey`s over different semigroups and/or batchers and/or shards count

twitter / summingbird

Streaming MapReduce with Scalding and Storm

https://twitter.com/summingbird

Apache License 2.0

2.14k stars 267 forks source link

Storm platfrom fails in case of two sumByKey`s over different semigroups and/or batchers and/or shards count #733

Open ttim opened 7 years ago

ttim commented 7 years ago

In case of two parallel sumByKeys with different parameters we enable partial aggregation on flatMap with parameters of one of them, which is wrong.