mingyu89
commented
1 year ago @vladimirk-db Thanks. The testing in CUJ is still in progress. I'm adding two projects to CUJ repo : with fs and without fs
I went through several issues while setting up the monorepo.
- One is https://github.com/databricks/mlops-stack/pull/74,
- One is ML-30083.
- Another is the resource group, storage account name and key in terraform file provider.tf. I think we can skip this one since bundles will resolve it. Temporary fix in CUJ is to use the same resource group, storage account name as CUJ project and use a different key.
dbutils.secrets.getin TriggerModelDeploy should use the key from first project.
I've got the terraform deployed to staging and prod. https://github.com/databricks/mlops-azure-cuj/pull/79 Next step is to go through all workflows.
Followed option2 in doc https://docs.google.com/document/d/1PO49MfICLpDpCXk5jFq_tcuPbocutotkui30jxSXLXQ/edit#
Tested by adding two projects(receipes & fs) to CUJ repo to make it a monorepo. The staging and prod workspace workflows succeeded in training, validation, deploy.