malariagen / pipelines

Pipelines for processing malaria parasite and mosquito genome sequence data.
MIT License
14 stars 13 forks source link

Add max retries runtime attribute #117

Closed ahernank closed 7 months ago

ahernank commented 7 months ago

During the haplotype phasing run for Ag3.9 we have encountered some issues during the statistical phasing where multiple shards have failed due to out of memory errors.

To avoid restarting the whole run (which re-computes all shards for the ShapeIt4 task even when they completed previously), we want to enable the use of the Retry with More Memory feature on this task, which requires specifying a max number of retries.