sgl-project / sglang

SGLang is a fast serving framework for large language models and vision language models.
https://sgl-project.github.io/
Apache License 2.0
6.27k stars 545 forks source link

[Bug] FusedMoE compatible with vllm 0.6.3.post1 #2160

Closed zhyncs closed 4 days ago

zhyncs commented 4 days ago

Checklist

Describe the bug

N/A

Reproduction

N/A

Environment

N/A