search

sgl-project / sglang

SGLang is a fast serving framework for large language models and vision language models.
https://sgl-project.github.io/
Apache License 2.0
6.22k stars 532 forks source link

Speculative EAGLE2. New PR #2150

Open yukavio opened 1 day ago

yukavio commented 1 day ago

Create a new PR for supporting speculative decoding with EAGLE2. The old one is https://github.com/sgl-project/sglang/pull/1498.