search

deepseek-ai / DeepSeek-V2

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
MIT License
3.6k stars 153 forks source link

doc: followup #89 add client demo for using SGLang #91

Closed Ying1123 closed 1 month ago

Ying1123 commented 1 month ago

This PR adds a client demo for using SGLang as the inference engine for DeepSeek V2, in addition to the previous PR:

blog: https://lmsys.org/blog/2024-09-04-sglang-v0-3/ slides: https://docs.google.com/presentation/d/1wB_Ul0LZwIDL47qFl64b8hVhH1_ya-1YPAPSSv0cKMs

zhyncs commented 1 month ago

cc @soloice