More granular metrics - Githubissues

bricks-cloud / BricksLLM

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

https://trybricks.ai/

MIT License

901 stars 61 forks source link

More granular metrics #27

Closed CrazyPython closed 7 months ago

CrazyPython commented 10 months ago

Per-user ID (user parameter in OpenAI)
Per-model

spikelu2016 commented 7 months ago

we added support for these two fields which means that you can query data using userId and model as filters for /api/reporting/events API