search

databricks / mlops-stacks

This repo provides a customizable stack for starting new ML projects on Databricks that follow production best-practices out of the box.
https://docs.databricks.com/en/dev-tools/bundles/mlops-stacks.html
Apache License 2.0
460 stars 156 forks source link

Add notebook for model validation and set up terraform job #41

Closed mingyu89 closed 1 year ago

mingyu89 commented 1 year ago

Signed-off-by: Mingyu Li mingyu.li@databricks.com

Add model validation notebook and terraform file Used the mlops-azure-cuj as example. PR in the example repo https://github.com/databricks/mlops-azure-cuj/pull/47

design doc https://docs.google.com/document/d/1zz5KEJpb8tgMfE__4NAn_jVmAokfbQjWJCQVNk6jQv4/edit#

Failed model validation

https://user-images.githubusercontent.com/12734110/215229317-1890129b-8a8a-4852-90aa-5d7265a0cb3d.mov

Successful model validation

https://user-images.githubusercontent.com/12734110/215229619-af43e15c-c4c1-4f7d-b297-e5d96b4e9f14.mov

docs

Screen Shot 2023-01-30 at 1 59 52 PM

How the notebook looks like in notebook view

Screen Shot 2023-01-27 at 4 38 22 PM Screen Shot 2023-01-27 at 4 38 32 PM Screen Shot 2023-01-27 at 4 38 46 PM Screen Shot 2023-01-27 at 4 39 10 PM Screen Shot 2023-01-27 at 4 39 16 PM
mingyu89 commented 1 year ago

@arpitjasa-db Feel free to take another look and leave comments. I'll address them in followup PRs.