Azure / enterprise-azureai

Unleash the power of Azure AI to your application developers in a secure & manageable way with Azure API Management and Azure Developer CLI.
MIT License
71 stars 32 forks source link

Add note / best practices with regards to Assistants API (preview) #56

Open iMicknl opened 4 months ago

iMicknl commented 4 months ago

https://techcommunity.microsoft.com/t5/ai-azure-ai-services-blog/azure-openai-service-announces-assistants-api-new-models-for/ba-p/4049940

Azure Assistants API is in preview, which is a stateful service. This will be a lot harder to incorporate in a centralized approach since everyone with access to the API and resource will be able to see other messages. Next to that, round-robin and load balancing won't work.

Let's see if we can figure out a clever way to include Azure Assistants API (with code interpreter); otherwise we should document that this is not supported.