Local Queue - storing job status in dict may use a lot of memory in a long run

bartongroup / slivka

http://bartongroup.github.io/slivka/

Apache License 2.0

7 stars 3 forks source link

Closed warownia1 closed 4 years ago

warownia1 commented 4 years ago

Keep info on running jobs only and write "status" file in the working directory for the finished jobs
Keep track of the job's age and remove old jobs periodically resulting in status change to UNDEFINED
Use the database to store the job state (makes local-queue tied to the database as well)