Azure-Samples / modern-data-warehouse-dataops

DataOps for Microsoft Data Platform technologies. https://aka.ms/dataops-repo

MIT License

588 stars 459 forks source link

Replace Open Data links, code improvement from REST to az cli #624

Closed ydaponte closed 1 year ago

ydaponte commented 1 year ago

Type of PR

Code changes

Purpose

Fixing ingestion pipeline to point to the new links from the Parking Sensors open data and replacing the REST API task by a HTTP task in the pipeline
Improving the code by replacing previous REST APIs calls for az CLI commands

Does this introduce a breaking change? If yes, details on what can break

The pipeline was not working at all.

Author pre-publish checklist

[X] Executed test to prove my fix is effective or new feature works
[X] No PII in logs

Validation steps

Deploy the sample
Run setup notebook
Run P_Ingest_MelbParkingData

Issues Closed or Referenced

Closes #622
References #570