search

bricks-cloud / BricksLLM

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
https://trybricks.ai/
MIT License
863 stars 60 forks source link

Allow selection of specific 'azure' provider for custom routes based on provider name #75

Open minhoryang opened 2 months ago

minhoryang commented 2 months ago

Allow selection of specific 'azure' provider for custom routes based on provider name

spikelu2016 commented 2 months ago

hey man, not sure if using name to select the desired provider setting is a good idea. this introduces side effects for the name field. the name field is only for human readability, and should not be used for selecting providers.

an alternative is to add a settingId field in step, and use settingId to select the desired provider