microsoft / azure-openai-service-proxy

The Azure AI proxy service facilitates easy access to Azure AI resources for workshops and hackathons. It offers a Playground-like interface and supports Azure AI SDKs. Access is granted through a time-limited API key and endpoint.
https://microsoft.github.io/azure-openai-service-proxy/
MIT License
63 stars 37 forks source link

Proxy enhancements #275

Open gloveboxes opened 5 months ago

gloveboxes commented 5 months ago
### Tasks
- [ ] Extend model support: Mistral, Llama, gpt-4-vision
- [ ] Support for Assistant API
- [ ] Performance: Move metric logging to [FastAPI Background Task](https://fastapi.tiangolo.com/tutorial/background-tasks/)