nf-core / configs

Config files used to define parameters specific to compute environments at different Institutions
https://nf-co.re/configs
MIT License
79 stars 260 forks source link

azurebatch config doesn't expose tokenDuration parameter, causing sadness #687

Open tanaes opened 1 month ago

tanaes commented 1 month ago

I recently discovered the existence of the azure.storage.tokenDuration parameter in the wrong way -- that is, by having a large and expensive workflow fail spectacularly 2/3 of way through compute due to token expiration. 🙃 The nature of this failure appears to be a particular bummer, as it seems to have interfered with cacheing, requiring me to bodge together a fix to prevent needless re-execution of most of the expensive steps.

I'd propose exposing this parameter in the configuration file!