Datavault-UK / automate-dv

A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
https://www.automate-dv.com
Apache License 2.0
513 stars 131 forks source link

Re-factor pipeline scripts into templates to reduce duplication #145

Closed DVAlexHiggs closed 2 years ago

DVAlexHiggs commented 2 years ago

Major Re-factor of Pipeline scripts

The scripts are going to get very hard to maintain now that we have more than two platforms running in ADP (2 was bad enough) this PR aims to get a running template which should reduce the code from 1200+ lines < 100!