Fixed https://github.com/NICTA/scoobi/issues/308: MR job numbering broken in HadoopMode for job plans with more than 1 layer

NICTA / scoobi

A Scala productivity framework for Hadoop.

http://nicta.github.com/scoobi/

482 stars 97 forks source link

Fixed https://github.com/NICTA/scoobi/issues/308: MR job numbering broken in HadoopMode for job plans with more than 1 layer #310

Closed ivmaykov closed 10 years ago

ivmaykov commented 10 years ago

Fixed by computing, at each layer, the total number of MSCRs in all previous layers, and plumbing that down to configureMscr, where the "Step X of Y" gets configured.