databricks / mlops-stacks

This repo provides a customizable stack for starting new ML projects on Databricks that follow production best-practices out of the box.
https://docs.databricks.com/en/dev-tools/bundles/mlops-stacks.html
Apache License 2.0
429 stars 143 forks source link

Model validation improvements #65

Closed mingyu89 closed 1 year ago

mingyu89 commented 1 year ago

I kept all the example code in model validation. Because the project itself is based on MLflow recipe example.

The PR contains the following changes:

There will be followup PR to handle the the parameter that can be directly inferred from MLflow recipe.


test

Test 1 : Generate project without feature store, copy terraform files, validation.py and ModelValidation notebook to CUJ project and then run workflow. Test looks good. https://adb-3253686410953403.3.azuredatabricks.net/?o=3253686410953403#job/741125644266775/run/1675013

~Test 2 : Generate project with feature store, copy terraform files, validation.py and ModelValidation notebook to CUJ project and then run workflow.~ The test needs some followup.


Make the same change in example repo https://github.com/databricks/mlops-azure-cuj/commit/dd092f62e4a054fcfc21151690456fd4df43d7f6 Manually run the notebook

Screen Shot 2023-03-01 at 7 35 32 PM

Run training workflow

Screen Shot 2023-03-01 at 8 27 56 PM Screen Shot 2023-03-01 at 8 28 27 PM