Enable load-balancing using APIM

Azure-Samples / azure-search-openai-demo-csharp

A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure Cognitive Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.

MIT License

552 stars 345 forks source link

Enable load-balancing using APIM #279

Open luisquintanilla opened 4 months ago

luisquintanilla commented 4 months ago

https://techcommunity.microsoft.com/t5/fasttrack-for-azure/smart-load-balancing-for-openai-endpoints-using-containers/ba-p/4017550

https://github.com/andredewes/apim-aoai-smart-loadbalancing