Datavault-UK / automate-dv

A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
https://www.automate-dv.com
Apache License 2.0
478 stars 114 forks source link

Re-factor pipeline scripts into templates to reduce duplication #145

Closed DVAlexHiggs closed 1 year ago

DVAlexHiggs commented 1 year ago

Major Re-factor of Pipeline scripts

The scripts are going to get very hard to maintain now that we have more than two platforms running in ADP (2 was bad enough) this PR aims to get a running template which should reduce the code from 1200+ lines < 100!