microsoft / azure-openai-service-proxy

The Azure AI proxy service facilitates easy access to Azure AI resources for workshops and hackathons. It offers a Playground-like interface and supports Azure AI SDKs. Access is granted through a time-limited API key and endpoint.
https://microsoft.github.io/azure-openai-service-proxy/
MIT License
58 stars 34 forks source link

Explore YARP for proxy #316

Open aaronpowell opened 2 months ago

aaronpowell commented 2 months ago

YARP is a reverse proxy written by the .NET team for use in ASP.NET apps.

Given that the Proxy component is essentially a reverse proxy over AOAI/AI Search/etc. and we've implemented the pass-through aspect, it would be worthwhile to explore if we can remove our custom reverse proxy code and use YARP instead.

Here's a walkthrough from a recent event.