search

deepseek-ai / DeepSeek-V2

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
MIT License
3.6k stars 153 forks source link

docker for vllm. with deepseekv2 support merged #44

Open supdizh opened 5 months ago

supdizh commented 5 months ago

https://hub.docker.com/r/superdizh891/vllm042-dsv2 build a docker of vllm with https://github.com/vllm-project/vllm/pull/4650 merged

hope deepseek's PR could get merged, quite a pain to compile vllm for it

wulaoshi commented 3 weeks ago

u r my hero!

supdizh commented 3 weeks ago

u r my hero! 诶？大概2个月前 DS支持已经被vllm合入了哈，0.41 还是0.42就有了，可以用官方的