Azure / mlops-v2

Azure MLOps (v2) solution accelerators. Enterprise ready templates to deploy your machine learning models on the Azure Platform.
https://learn.microsoft.com/en-us/azure/machine-learning/concept-model-management-and-deployment
MIT License
478 stars 225 forks source link

Kubernetes issue - online deployment #62

Open MurugeswariMuthurajan opened 1 year ago

MurugeswariMuthurajan commented 1 year ago

Hi,

For taxi mlflow model usecase - online deployment, I tried using Kubernetes as compute resource

As per the Microsoft docs, created aks, configured extensions, attached in ml workspace. Then I tried online deployment via cli v2, where I am facing the below issues - "InferencingClientCallFailed"

image

When deploying via ui, for mlflow models also, it is asking to upload scoring script and environment [ which is not incase of managed instance]

image

So, whether we need to manually add / configure scoring script and environment details for mlflow models when we use Kubernetes?