Fix main deployment issues - Githubissues

Azure-Samples / modern-data-warehouse-dataops

DataOps for Microsoft Data Platform technologies. https://aka.ms/dataops-repo

MIT License

590 stars 462 forks source link

Fix main deployment issues #817

Closed ydaponte closed 1 week ago

ydaponte commented 1 week ago

As a Data Engineer, I want to be able to run the E2E Databricks + ADF sample with no errors so I can adapt the sample to my own requirements.

DoD

Dev container builds with no errors
Deployment script runs with no issues E2E
Databricks new CLI is upgraded and functionality is fixed to perform the same functionality as before

Ensure you've read the Contributing Guide (Microsoft Internal only.)

[x] Fix Dev container: #644
[x] Fix Dev container: #646
[x] Avoid break in main script when opening Databricks workspace: #630
[x] Fix bicep deployment Synapse dedicated pool: #778
[x] Upgrade Databricks CLI #763
[x] Ensure Databricks CLI is installed securely: #792