Emerging-AI / ENOVA

A deployment, monitoring and autoscaling service towards serverless LLM serving.
Apache License 2.0
158 stars 27 forks source link

Feature/autoscale2 #9

Closed kyokagong closed 4 months ago

kyokagong commented 4 months ago

feature: modify enova-pilot to enova-escaler