Improve performance of flatMap in ScatterGather

fulcrumgenomics / dagr

A scala based DSL and framework for writing and executing bioinformatics pipelines as Directed Acyclic GRaphs

MIT License

69 stars 15 forks source link

Improve performance of flatMap in ScatterGather #363

Open nh13 opened 5 years ago

nh13 commented 5 years ago

Currently, any downstream operations on the result of a flatMap requires all tasks depended on by flatMap to be completed successfully before the downstream operations are performed.