Below are the tasks for a first stab at creating a generalized QA script for the PnP book processing and ingestion pipeline.
QA Script Pipeline Tasks
Master Script
[x] One Python script should be set up with arguments to run the various possible subprocesses of this QA process and output metadata on each QA run (time run, slurm log list for each sbatch call, etc.)
[x] An optional config file (i.e. yaml file) that includes directories and optionally a sequence of the QA subprocesses to run (i.e. clear old results, run new QA, gather results, analyze, etc.)
See: https://github.com/printprobability/qa-workflow/issues/3
Subprocesses
[x] Run test autocrop script with arguments across one or more given book directories
Below are the tasks for a first stab at creating a generalized QA script for the PnP book processing and ingestion pipeline.
QA Script Pipeline Tasks
Master Script
Subprocesses
Error Processing
Metadata Additions/Fixes
Asserts