sgl-project / sglang

SGLang is a fast serving framework for large language models and vision language models.
https://sglang.readthedocs.io/en/latest/
Apache License 2.0
5.36k stars 388 forks source link

111 #544

Closed ZackZeng999 closed 3 months ago