DistributedScience / Distributed-CellProfiler

Run encapsulated docker containers with CellProfiler in the Amazon Web Services infrastructure.
https://distributedscience.github.io/Distributed-CellProfiler/
Other
37 stars 24 forks source link

Add ALWAYS_CONTINUE #169

Closed bethac07 closed 1 month ago

bethac07 commented 3 months ago

Code is done, still needs documentation (pending outcome of internal Slack discussion of if it's a good idea to expose this option or not, given it saves late stochastic failures but at the expense of perhaps not noticing early systemic failures)

ErinWeisbart commented 2 months ago

Added docs and a corresponding change to make JOB_RETRIES configurable from the config so that when ALWAYS_CONTINUE = True we can lower the number of JOB_RETRIES from the (now previously) hardcoded 10.