bricks-cloud / BricksLLM

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
https://trybricks.ai/
MIT License
845 stars 58 forks source link

Add OTEL support for HyperDX integration #63

Open spikelu2016 opened 2 months ago

spikelu2016 commented 2 months ago

Currently BricksLLM has a Datadog integration. We want to add OTEL integration that can provide compatibility with HyperDX.

chemeris commented 1 month ago

OpenTelemetry integration is also important for local installations. We're gradually moving over to OpenTelemetry to centralize metrics processing across all various services in our company.

minhoryang commented 1 month ago

FYI, https://github.com/bricks-cloud/BricksLLM/issues/68#issuecomment-2175498263