Load testing of endpoint in Azure ML and data sanity tests

Azure / mlops-v2

Azure MLOps (v2) solution accelerators. Enterprise ready templates to deploy your machine learning models on the Azure Platform.

https://learn.microsoft.com/en-us/azure/machine-learning/concept-model-management-and-deployment

MIT License

503 stars 248 forks source link

Load testing of endpoint in Azure ML and data sanity tests #50

Open akgarg00 opened 2 years ago

akgarg00 commented 2 years ago

I wanted to load test a deployed model endpoint and add it to an MLOps v2 framework, so that new deployed models can go through load testing. I tried Azure load testing resource for web app but I think it is just for static content. Also, I saw a python package - locust which seems promising. Is there any other approach? Also, for data sanity and integration tests for deployed models - great_expectations is available package. Is there a Azure service or recommended package for the same?

setuc commented 2 years ago

We have planned for load testing of the APIs in the upcoming release. If there is an urgent need, reach out to me separately via LinkedIn and we can help you out.