search

OpenBMB / MiniCPM

MiniCPM-2B: An end-side LLM outperforming Llama2-13B.
Apache License 2.0
4.38k stars 313 forks source link

那个版本的vllm支持2b-dpo-bf16啊 #113

Closed Liyu910228 closed 2 months ago

Liyu910228 commented 3 months ago
1711968124424 1711968052889

安装好几个版本vllm都不支持，哪位大佬看看

zRzRzRzRzRzRzR commented 2 months ago

应该是要用这个仓库里指定的吧，因为vllm没有注册minicpm？

zh-zheng commented 2 months ago

vllm v0.4.1已经支持了MiniCPM。