search

Azure / mlops-v2

Azure MLOps (v2) solution accelerators. Enterprise ready templates to deploy your machine learning models on the Azure Platform.
https://learn.microsoft.com/en-us/azure/machine-learning/concept-model-management-and-deployment
MIT License
478 stars 225 forks source link

how can i create inference clusters ? #63

Closed yogidosalwar closed 1 year ago

yogidosalwar commented 1 year ago

Hi @setuc , I want to create inference cluster, i.e. Deploy model to the Azure Kubernetes Service for large scale inferencing. How can I create a compute inference cluster?

Thank you

setuc commented 1 year ago

We have tackled the deployment to the AKS cluster and it is not planned for the upcoming release.

You can follow the docs to link AKS to azure ml workspace.

https://learn.microsoft.com/en-us/azure/machine-learning/how-to-attach-kubernetes-to-workspace

The deployment script can be modified to deploy the endpoint to AkS cluster.

To create a cluster you can use this

https://azure.github.io/AKS-Construction/