Open johnynek opened 7 years ago
In scalding, Reducer estimation runs in this code: https://github.com/twitter/scalding/blob/72ef68b465b17fcb56a29fc13ccb8b1013430b49/scalding-core/src/main/scala/com/twitter/scalding/ExecutionContext.scala#L91
but that code is not called in summingbird: https://github.com/twitter/summingbird/blob/5741c6570eef8292bc7956408b2a11da4e70ef88/summingbird-scalding/src/main/scala/com/twitter/summingbird/scalding/ScaldingPlatform.scala#L739
so, the options are ignored.
if we solved #710 this would probably just go away.
In scalding, Reducer estimation runs in this code: https://github.com/twitter/scalding/blob/72ef68b465b17fcb56a29fc13ccb8b1013430b49/scalding-core/src/main/scala/com/twitter/scalding/ExecutionContext.scala#L91
but that code is not called in summingbird: https://github.com/twitter/summingbird/blob/5741c6570eef8292bc7956408b2a11da4e70ef88/summingbird-scalding/src/main/scala/com/twitter/summingbird/scalding/ScaldingPlatform.scala#L739
so, the options are ignored.
if we solved #710 this would probably just go away.