liupeirong / MLOpsManufacturing

Demonstrate samples and good engineering practice for operationalizing machine learning solutions.
Other
21 stars 9 forks source link

Azure DevOps execution strategy per compute environment (dev, test, staing, prod) #47

Open liupeirong opened 3 years ago

h2floh commented 3 years ago

Glossary

Term Remark
compute environment the cloud infrastructure used for computation (e.g. AML pipeline run trigger) or targeted for deployment of MLOps artifacts (e.g. AML pipeline build) from within AzDO pipelines. The infrastructure boundaries what is dev, test, prod are very blurry in the MLOps space. e.g. the same AML workspace can be used for basically all stages but get executed on different AML compute targets, sometimes

Scenario or use case

Not duplicating code is a general software engineering practice. To avoid splitting up AzDO pipelines (yaml files) for each compute environment the project teams identified an elegant way of using different Variable Groups depending on the branch name the AzDO pipeline get's executed. In that Variable Groups the parameters for the different compute environment can be set and maintained.

Quick Win, if possible all teams should apply it to new samples

This is related or a sub-mechanism of #41

Acceptance criteria

Stretch Goal

h2floh commented 3 years ago

Not yet in documents nor in a sample would like to keep this open.