search

kubeagi / arcadia

A diverse, simple, and secure one-stop LLMOps platform
http://www.kubeagi.com/
Apache License 2.0
64 stars 21 forks source link

upgrade vllm/ray to adapt vllm 0.4.0 #968

Closed bjwswang closed 3 months ago

bjwswang commented 3 months ago

https://github.com/vllm-project/vllm/releases/tag/v0.4.0

bjwswang commented 3 months ago

https://github.com/vllm-project/vllm/releases/tag/v0.4.0

Since v0.4.0 still has lots of bugs ,we can do this upgrade later.