Creates a DB object and an ORM (GlaicerSyncProgress) to track progress. An operator has to use extras.py:add_works_to_project to build the list of works
The GlacierSyncProgress ORM is updated by each step's successful completion (staging_utils:db_phase).
the dataset (underlying table is `drs.glacier_sync_progress) can be queried for time stamps of completed steps.
One shortcoming is that the DB needs to be pre-populated with the universe of work. It can't create records on demand. #25 is a request to fix this.
Fixes #19 Fixes #24
Creates a DB object and an ORM (GlaicerSyncProgress) to track progress. An operator has to use
extras.py:add_works_to_project
to build the list of worksThe GlacierSyncProgress ORM is updated by each step's successful completion (
staging_utils:db_phase
).the dataset (underlying table is `drs.glacier_sync_progress) can be queried for time stamps of completed steps.
One shortcoming is that the DB needs to be pre-populated with the universe of work. It can't create records on demand. #25 is a request to fix this.