🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
I have heard at least 3 users ask for it
Issues:
Possible features:
gpt-4o
), for commercial LLM providers