issues
search
sgl-project
/
sglang
SGLang is a fast serving framework for large language models and vision language models.
https://sgl-project.github.io/
Apache License 2.0
6.27k
stars
545
forks
source link
Improve sglang router
#2148
Closed
ByronHsu
closed
5 days ago
ByronHsu
commented
5 days ago
Motivation
To align with slightly older sglang used by @yichuan520030910320
Modifications
Checklist
[ ] Format your code according to the
Contributor Guide
.
[ ] Add unit tests as outlined in the
Contributor Guide
.
[ ] Update documentation as needed, including docstrings or example tutorials.
Motivation
To align with slightly older sglang used by @yichuan520030910320
Modifications
Checklist