search

codalab / codabench

Codabench is a flexible, easy-to-use and reproducible benchmarking platform. Check our paper at Patterns Cell Press https://hubs.li/Q01fwRWB0
Apache License 2.0
63 stars 26 forks source link

Cancel running submissions #872

Open Didayolo opened 1 year ago

Didayolo commented 1 year ago

When we cancel a running submission, does it really get killed inside the worker? Or is it just a front-end move?

In CodaLab Competitions, we had this known that we can't kill running submissions from the interface. The only way is to go inside the compute workers and kill the submissions by hand using docker stop or docker kill.

Do we have the same limitation on Codabench? I guess the problem is not that simple because the worker stops listening to the queue once a job has started, and the platform has no possible actions on the worker.

Didayolo commented 1 year ago

Couldn't the code of the worker check for cancellation, say every 15 minutes? Or that would not make sense either?