Azure-Samples / openai-aca-lb

Smart load balancing for Azure OpenAI endpoints
MIT License
41 stars 17 forks source link