Azure / mlops-v2

Azure MLOps (v2) solution accelerators. Enterprise ready templates to deploy your machine learning models on the Azure Platform.
https://learn.microsoft.com/en-us/azure/machine-learning/concept-model-management-and-deployment
MIT License
502 stars 248 forks source link

Jenkins Pipeline #94

Closed MuMu2807 closed 1 year ago

MuMu2807 commented 1 year ago

Hi Team,

We were requested to use Jenkins pipeline instead of Azure devops pipeline for configuring Infra, Model training and Deployment. Here in Azure devops pipeline Yaml script, we are calling templates to execute a particular task. Whether this mlops v2 template based approach would be applicable via Jenkins pipelines also

setuc commented 1 year ago

Yes, they are certainlyy doable. You can make use of the CLI v2 / SDK to run through these pipelines. The key requirement of this is going to be working with Azure Service Principal. If you look at either of the getting started documentation with Azure DevOps (ADO) or GitHub Actions (GHA), you will notice that we use service principal to authenticate Link

Once you have authenticated, you can run any azure CLI command. We store the secret appropriately. Here is one example to deploy WebApp with Jenkins on Azure. so Instead of WebApp, you can deploy the training/deployment configurations on AzureML.

You can alternatively use Managed Identity for authentication while working with Python Code. You can follow numerous examples of authenticating with Azure Identity package. One such reference would cann be found here . Don't use InteractiveAuthentication in the MLOPs pipeline.