sgl-project / sglang

SGLang is a fast serving framework for large language models and vision language models.
https://sgl-project.github.io/
Apache License 2.0
6.22k stars 532 forks source link

fix: resolve bench_serving args #2139

Closed zhyncs closed 2 days ago

zhyncs commented 2 days ago

Motivation

Modifications

Checklist

zhyncs commented 2 days ago

fix https://github.com/sgl-project/sglang/pull/2136