search

deepseek-ai / DeepSeek-V2

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
MIT License
3.69k stars 157 forks source link

doc: recommend SGLang for DeepSeek V2 inference #89

Closed zhyncs closed 2 months ago

zhyncs commented 2 months ago

blog: https://lmsys.org/blog/2024-09-04-sglang-v0-3/ slides: https://docs.google.com/presentation/d/1wB_Ul0LZwIDL47qFl64b8hVhH1_ya-1YPAPSSv0cKMs

cc @merrymercy @ying1123 @ispobock

soloice commented 2 months ago

Thanks for your contribution!