issues
search
datapao
/
dlt-dev-with-dab
Demonstration of development lifecycle with Databricks Delta Live Tables and Databricks Asset Bundles
MIT License
0
stars
0
forks
source link
Move DLT pipeline integration test to Workflows
#6
Open
cs23andris
opened
3 months ago
cs23andris
commented
3 months ago
Each pipeline should have a corresponding integration test job with tasks: setup, run DLT pipeline, validate
The integration test job should be running on serverless
There should be a runner job that executes all integration test jobs
This runner job should be triggered by the build pipeline
In this case running the validate pipeline step is unnecessary as the whole pipeline is executed in the integration test