search

nf-core / deepmodeloptim

Stochastic Testing and Input Manipulation for Unbiased Learning Systems
https://nf-co.re/deepmodeloptim
MIT License
23 stars 9 forks source link

[fix] ray tune runs forever sometimes #143

Closed suzannejin closed 4 months ago

suzannejin commented 6 months ago

sometimes, ray tune stays forever in running mode for some samples, and then these samples don't progress. And stay in the same iteration forever.

alessiovignoli commented 6 months ago

this does not happen on github actions, i think is a cluster issue.

mathysgrapotte commented 5 months ago

Should be fix by using proper ressources declaration, see #154 @alessiovignoli

mathysgrapotte commented 5 months ago

Could also be linked to #155