search

Emerging-AI / ENOVA

A deployment, monitoring and autoscaling service towards serverless LLM serving.
Apache License 2.0
158 stars 27 forks source link

fix: compatible with PrometheusStatLogger for vllm version 0.5.1 and … #30

Closed wenxinax closed 2 months ago

wenxinax commented 2 months ago

Fixes #29