Azure-Samples / modern-data-warehouse-dataops

DataOps for Microsoft Data Platform technologies. https://aka.ms/dataops-repo

MIT License

588 stars 459 forks source link

Add a sample for testing databricks notebook with imported custom python libraries #352

Closed swetha-sundar closed 3 years ago

swetha-sundar commented 3 years ago

Type of PR

Documentation changes
Code changes
Test changes
CI-CD changes

Purpose

Add a sample for testing databricks notebook with imported custom python libraries
Includes unit tests and integration tests
Includes a devops workflow with both CI and CD pipelines based on Azure DevOps

TODO/Pending

Nutter based integration test notebook needs to be updated.

Does this introduce a breaking change? If yes, details on what can break

No

Author pre-publish checklist

[x] Added test to prove my fix is effective or new feature works
[x] No PII in logs
[x] Made corresponding changes to the documentation

Validation steps

Refer to CI and CD Runs from this sample
CI: https://dev.azure.com/OneCSEWeek/DatabricksOps/_build/results?buildId=491&view=results
CD: https://dev.azure.com/OneCSEWeek/DatabricksOps/_build/results?buildId=493&view=results

Issues Closed

Closes #327

gary918 commented 3 years ago

@swetha-sundar If databricksWorkspaceOrgId is still needed, we should also mention it in README.md?