twitter / scalding

A Scala API for Cascading
http://twitter.com/scalding
Apache License 2.0
3.49k stars 703 forks source link

Improve the WritePartition API so we can use it without FlowStateMap externally #1824

Closed johnynek closed 6 years ago

johnynek commented 6 years ago

in #1822 we made FlowStateMap private to prevent external users from depending on that mutable state.

Unfortunately, that left no way for an external user to convert a FlowDef to an Execution, which we need internally at Stripe since we are using the write partitioning to allow us to plan fast.

ianoc commented 6 years ago

lgtm