search

EricLBuehler / mistral.rs

Blazingly fast LLM inference.
MIT License
4.4k stars 304 forks source link

OpenTelemetry Metrics for Server Runtime #831

Open nikolaydubina opened 4 weeks ago

nikolaydubina commented 4 weeks ago

Would be nice to have Prometheus metrics exported to OTEL (or at least basic /metrics). Useful for production.

https://crates.io/crates/runtime-otel-metrics

nikolaydubina commented 3 weeks ago

if nobody takes this, I will add this myself in coming days.