databricks / mlops-stacks

This repo provides a customizable stack for starting new ML projects on Databricks that follow production best-practices out of the box.
https://docs.databricks.com/en/dev-tools/bundles/mlops-stacks.html
Apache License 2.0
416 stars 141 forks source link

Lakehouse monitoring integration #156

Closed s-udhaya closed 2 months ago

s-udhaya commented 3 months ago

This PR integrates lakehouse monitoring, with automatic retraining component into mlops-stack.

RegaCaska commented 2 months ago

Where did you find documentation for creating monitors through asset bundles as demonstrated in this PR? I see no documentation in the databricks asset bundle configurations reference, nor the Lakehouse Monitoring page Is this due to the feature being in private preview?

arpitjasa-db commented 2 months ago

Where did you find documentation for creating monitors through asset bundles as demonstrated in this PR? I see no documentation in the databricks asset bundle configurations reference, nor the Lakehouse Monitoring page Is this due to the feature being in private preview?

@RegaCaska the DAB docs might still be generating, you can ask in the CLI GitHub, but if you'd like you can use the Terraform or SDK docs to configure it in DABs since it uses the same structure.