search

Azure / enterprise-azureai

Unleash the power of Azure AI to your application developers in a secure & manageable way with Azure API Management and Azure Developer CLI.
MIT License
71 stars 32 forks source link

Feature/smartlb #39

Closed azureholic closed 5 months ago

azureholic commented 5 months ago

Proxy implementation extended with smart load balancing (priority based) so you can prioritize your PTU over PAYG or have a secondary region as a fallback (will retry if rate limiter of the service is hit). Proxy now uses AppInsights (OpenTelemetry), so dashboard application map should show the entire flow.

Updated bicep files to reflect this change (update on App Config with new proxyconfiguration structure)

Bicep Bugfixes for deployment of secondary Azure OpenAI instance - this now works again

included small changes that Mick came up with.

These are breaking changes - so if you have an environment, please remove it and redeploy everything again.

azureholic commented 5 months ago

resolved most of the comments - some "will not fix"

pascalvanderheiden commented 5 months ago

Approved