move logging out of debug mode; add checkpointing - Githubissues

dr-joe-wirth / primerForge

software to identify primers that can distinguish genomes

Apache License 2.0

20 stars 4 forks source link

move logging out of debug mode; add checkpointing #9

Closed dr-joe-wirth closed 6 months ago

dr-joe-wirth commented 7 months ago

currently, logging only occurs when debugging. same goes for pickling intermediate data structures.

i want to change the behavior so that:

debug mode only logs additional information
the pickled files get saved when running in both normal and debug mode
pickled files are deleted after successfully running in normal mode, but not in debug mode
if a pickled file exists, then pick the workflow up there.
- need to come up with a clever way to check for the presence of the pickle that is furthest along in the workflow to avoid unnecessary unpickling of previous checkpoints.