twitter / scalding

A Scala API for Cascading
http://twitter.com/scalding
Apache License 2.0
3.48k stars 703 forks source link

flakey test: writepartitionertest #1929

Open johnynek opened 4 years ago

johnynek commented 4 years ago
[info] WritePartitionerTest:

[info] - When we break at forks we have at most 2 + hashJoin steps *** FAILED ***

[info]   TestFailedException was thrown during property evaluation.

[info]     Message: 3 was not less than or equal to 2 optimized: WithDescriptionTypedPipe(MergedTypedPipe(FlatMapped(CoGroupedPipe(MapGroup(WithDescription(Pair(IdentityReduce(scala.math.Ordering$Int$@5dbe7988,MapValues(FlatMapped(IterablePipe(List(-2047340861, -1268371427)),<function1>),<function1>),None,List(),ReflexiveEquality()),IdentityReduce(scala.math.Ordering$Int$@5dbe7988,FlatMapped(SourcePipe(com.twitter.scalding.source.FixedTypedText(whxjhchxlleiunpBo)),<function1>),None,List(),ReflexiveEquality()),<function3>),org.scalacheck.Gen$R$class.map(Gen.scala:237)),<function2>)),<function1>),FlatMapped(ReduceStepPipe(IteratorMappedReduce(scala.math.Ordering$Int$@5dbe7988,WithDescriptionTypedPipe(Mapped(IterablePipe(List(0, -1, 1, 1, 1201395394, 1, 0, 0, -1647597064, 1)),<function1>),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true))),<function2>,None,List())),<function1>)),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true)))

[info]     Location: (WritePartitionerTest.scala:71)

[info]     Occurred when passed generated values (

[info]       arg0 = WithDescriptionTypedPipe(Mapped(WithDescriptionTypedPipe(FlatMapped(WithDescriptionTypedPipe(MergedTypedPipe(WithDescriptionTypedPipe(Mapped(WithDescriptionTypedPipe(Filter(WithDescriptionTypedPipe(Fork(WithDescriptionTypedPipe(Mapped(CoGroupedPipe(MapGroup(Pair(IdentityReduce(scala.math.Ordering$Int$@5dbe7988,WithDescriptionTypedPipe(WithDescriptionTypedPipe(MapValues(WithDescriptionTypedPipe(FlatMapped(IterablePipe(List(-2047340861, -1268371427)),<function1>),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true))),<function1>),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true))),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true))),None,List(),ReflexiveEquality()),IdentityReduce(scala.math.Ordering$Int$@5dbe7988,WithDescriptionTypedPipe(WithDescriptionTypedPipe(FlatMapped(SourcePipe(com.twitter.scalding.source.FixedTypedText(whxjhchxlleiunpBo)),<function1>),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true))),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true))),None,List(),ReflexiveEquality()),<function3>),<function2>)),<function1>),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true)))),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true))),<function1>),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true))),<function1>),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true))),WithDescriptionTypedPipe(FlatMapped(WithDescriptionTypedPipe(Mapped(ReduceStepPipe(IteratorMappedReduce(scala.math.Ordering$Int$@5dbe7988,WithDescriptionTypedPipe(WithDescriptionTypedPipe(Mapped(IterablePipe(List(0, -1, 1, 1, 1201395394, 1, 0, 0, -1647597064, 1)),<function1>),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true))),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true))),<function2>,None,List())),<function1>),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true))),<function1>),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true)))),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true))),<function1>),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true))),<function1>),List((org.scalacheck.Gen$R$class.map(Gen.scala:237),true)))

[info]     )