Add the Execution step id to the name

twitter / scalding

A Scala API for Cascading

http://twitter.com/scalding

Apache License 2.0

3.49k stars 703 forks source link

Closed johnynek closed 6 years ago

johnynek commented 6 years ago

close #1807

This makes it possible to distinguish one step from another with executions.

Unfortunately, this is not a reproducible number since steps can race (due to zip running in parallel), but it seems better than nothing.

It seems somewhat non-trivial to give a deterministic numbering to all the steps in the presence of flatMap on Execution. We may revisit it later.

ianoc commented 6 years ago

lgtm

cascading step numbers aren't stable anyway... so not any worse