search

twitter / summingbird

Streaming MapReduce with Scalding and Storm
https://twitter.com/summingbird
Apache License 2.0
2.14k stars 267 forks source link

infinite loop in Dependants (or DagOptimizer?) #646

Closed johnynek closed 8 years ago

johnynek commented 8 years ago

User hit this in ConcurrentMemoryPlatform (which uses the DagOptimizer):

scala.collection.immutable.List.flatMap(List.scala:327)
                    at com.twitter.summingbird.Dependants.dependantsAfterMerge(Dependants.scala:50)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:52)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:50)
                    at scala.collection.immutable.List.flatMap(List.scala:327)
                    at com.twitter.summingbird.Dependants.dependantsAfterMerge(Dependants.scala:50)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:52)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:50)
                    at scala.collection.immutable.List.flatMap(List.scala:327)
                    at com.twitter.summingbird.Dependants.dependantsAfterMerge(Dependants.scala:50)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:52)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:50)
                    at scala.collection.immutable.List.flatMap(List.scala:327)
                    at com.twitter.summingbird.Dependants.dependantsAfterMerge(Dependants.scala:50)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:52)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:50)
                    at scala.collection.immutable.List.flatMap(List.scala:327)
                    at com.twitter.summingbird.Dependants.dependantsAfterMerge(Dependants.scala:50)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:52)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:50)
                    at scala.collection.immutable.List.flatMap(List.scala:327)
                    at com.twitter.summingbird.Dependants.dependantsAfterMerge(Dependants.scala:50)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:52)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:50)
                    at scala.collection.immutable.List.flatMap(List.scala:327)
                    at com.twitter.summingbird.Dependants.dependantsAfterMerge(Dependants.scala:50)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:52)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:50)
                    at scala.collection.immutable.List.flatMap(List.scala:327)
                    at com.twitter.summingbird.Dependants.dependantsAfterMerge(Dependants.scala:50)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:52)
                    at com.twitter.summingbird.Dependants$$anonfun$dependantsAfterMerge$2.apply(Dependants.scala:50)