search

kubeagi / arcadia

A diverse, simple, and secure one-stop LLMOps platform
http://www.kubeagi.com/
Apache License 2.0
63 stars 20 forks source link

fix: update vllm to v0.4.0 hotfix version #984

Closed nkwangleiGIT closed 2 months ago

nkwangleiGIT commented 2 months ago
  1. Update vllm to v0.4.0 hotfix version, remove --enforce-eager parameter
  2. Fix typo error
bjwswang commented 2 months ago

@0xff-dev Test failed due to README changed in https://modelscope.cn/models/qwen/Qwen1.5-0.5B/summary. Please remove the explicitly content check.