Azure-Samples / modern-data-warehouse-dataops

DataOps for Microsoft Data Platform technologies. https://aka.ms/dataops-repo

MIT License

591 stars 463 forks source link

fix: fixes to ADF pipelines and AzDO pipelines #865

Closed ydaponte closed 4 days ago

ydaponte commented 4 days ago

Type of PR

Code changes
CI-CD changes

Purpose

Fixing to point to latest REST API links so that the ADF pipeline is not failing
Upgrades debian to 12 and msodbcsql to18 for the integration testing task in the release pipeline
Fixing release pipeline definition for Databricks: update the Databricks CLI

Does this introduce a breaking change? If yes, details on what can break

Yes, but the previous version was already not working. This is the attempt to fix it

Author pre-publish checklist

[ ] Added test to prove my fix is effective or new feature works
[X] No PII in logs
[ ] Made corresponding changes to the documentation

Validation steps

Launch devcontainer
Deploy sample
Configure ADF source control
Run the deployed ADP pipeline
Make a change
You can comment the Integration Tests Step (it will fail because there will be no data in staging - fix coming soon)
Verify that the CI and CD pipelines run (specifically Databricks step)

Issues Closed or Referenced

References #856