Adding Data Monitoring for Databricks

databricks / mlops-stacks

This repo provides a customizable stack for starting new ML projects on Databricks that follow production best-practices out of the box.

https://docs.databricks.com/en/dev-tools/bundles/mlops-stacks.html

Apache License 2.0

416 stars 141 forks source link

Adding Data Monitoring for Databricks #158

Closed rahuja23 closed 2 months ago

rahuja23 commented 3 months ago

Hi Firstly, thanks a lot for this detailed implementation. It definitely looks very interesting and also quite extensive. I was just curious are there any plans for integrating Data monitoring for this template. I am interested in understanding how this can be done at a template level and would love some insights from you regarding this.

arpitjasa-db commented 3 months ago

Hi @rahuja23 we're working on adding monitoring right now actually! You can follow this PR here: https://github.com/databricks/mlops-stacks/pull/156

NickWyq commented 3 months ago

Hi, this is a very interesting pattern, do you have the plan to support Gitlab as the CI/CD platform?

arpitjasa-db commented 3 months ago

Hi @NickWyq we don't have any immediate plans to support GitLab, but we encourage outside contributions for additional CI/CD platforms that people want. Feel free to make a PR and I can provide support as needed!