🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
OpenTelemetry integration is also important for local installations. We're gradually moving over to OpenTelemetry to centralize metrics processing across all various services in our company.
Currently BricksLLM has a Datadog integration. We want to add OTEL integration that can provide compatibility with HyperDX.