search

Emerging-AI / ENOVA

A deployment, monitoring and autoscaling service towards serverless LLM serving.
Apache License 2.0
158 stars 27 forks source link

feature: v0.0.5 #31

Closed kyokagong closed 2 months ago

kyokagong commented 2 months ago

feature:

  1. Adapted for the latest vllm 0.5.4 version