cgat-developers / ruffus

CGAT-ruffus is a lightweight python module for running computational pipelines
MIT License
173 stars 34 forks source link

@recombine #37

Open bunbun opened 9 years ago

bunbun commented 9 years ago

Like @collate but automatically regroups jobs which were a result of a previous @subdivide / @split (even after intervening @transform )

This is the only way job trickling can work without stalling the pipeline: We would know how many jobs were pending for each @recombine job and which jobs go together.