[v1.7.0] Add the ability to create sequencial API calls

bricks-cloud / BricksLLM

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

https://trybricks.ai/

MIT License

863 stars 60 forks source link

[v1.7.0] Add the ability to create sequencial API calls #37

Closed spikelu2016 closed 8 months ago

spikelu2016 commented 8 months ago

Context

We want to add a feature that allows users to call OpenAI chat completion with the azure OpenAI as fallback

Tasks

[x] Refactor API keys to allow association with multiple set of provider settings
[x] Add new API endpoints for creating route configurations
[x] Add a new route API in the proxy server