dbader / schedule

Python job scheduling for humans.
https://schedule.readthedocs.io/
MIT License
11.71k stars 960 forks source link

Running scheduler in an ecs/k8 cluster #537

Closed redigaffi closed 2 years ago

redigaffi commented 2 years ago

So, pods are meant to have restarts frequently, my concern is that, scheduler has a state somewhere to keep track when was the last run of X task. When a pod restarts, this state will restart and the timer will restart I guess (?). Is there any way to retrieve that state and store it somewhere, like S3 ...

For example, when I say:

2 hours pass, the job will run in 2 hours, I restart the pod, now that state is lost and that job will again, take 4 hours to run.

redigaffi commented 2 years ago

Found an answer in this issue: https://github.com/dbader/schedule/issues/164, will close this one.