Large-scale changes to improve standardization and make it easier to add new pipelines and share functionality across pipelines. We now have a generic Pipeline class, which keeps all the baseline functionality for managing file paths, temporary directories, and cross-pipeline functionality like data validation and pulling from cached raw files.
@isatotun and I have walked through these changes in detail together, but see the Loom video below for a more detailed overview:
Large-scale changes to improve standardization and make it easier to add new pipelines and share functionality across pipelines. We now have a generic
Pipelineclass, which keeps all the baseline functionality for managing file paths, temporary directories, and cross-pipeline functionality like data validation and pulling from cached raw files.@isatotun and I have walked through these changes in detail together, but see the Loom video below for a more detailed overview:
https://www.loom.com/share/cbe9ee63af094e6e90870a912322e5b6?sid=944625a6-ab28-4a25-8e65-8b481523a9dd
Closes: #33 #27 #22 #20 #16 Replaces: #34