Add task batching example

nextflow-io / patterns

A curated collection of Nextflow implementation patterns

http://nextflow-io.github.io/patterns/

MIT License

332 stars 71 forks source link

Add task batching example #31

Closed bentsherman closed 2 years ago

bentsherman commented 2 years ago

This PR adds an example for refactoring a small process to execute in batches, in order to minimize job submission overhead. It is intended to demonstrate a partial solution to task grouping until we have a better native solution.