Continue training from a killed process

[Oufattole]

We should make sure that if a job is killed, it can be continued from the most recent checkpoint without losing progress.

[Oufattole]

Done