search

LLNL / merlin

Machine Learning for HPC Workflows
MIT License
118 stars 26 forks source link

feature/retry_priority #468

Closed bgunnar5 closed 6 months ago

bgunnar5 commented 6 months ago

Added a new RETRY priority as the highest priority for Celery tasks so that they don't get stuck waiting in the queue with other merlin_step tasks that have yet to run. This was discussed in a teams thread.

bgunnar5 commented 6 months ago

I initially added the call to pip freeze so I could debug an issue with a dependency in the CI and forgot it was in here. We might want to leave it so we can easily see the versions of our requirements that the GitHub CI is using in case anything else goes awry. It doesn't modify the functionality of the CI at all, just adds additional logs.

bgunnar5 commented 6 months ago

Or we can wait for another PR/scrap it entirely. I don't mind too much whichever way we go here.