Azure-Samples / openai-aca-lb

Smart load balancing for Azure OpenAI endpoints
MIT License
40 stars 17 forks source link