Update CI threshold & Improve code style

sgl-project / sglang

SGLang is a fast serving framework for large language models and vision language models.

https://sgl-project.github.io/

Apache License 2.0

6.22k stars 532 forks source link

Closed merrymercy closed 1 day ago

merrymercy commented 1 day ago

Increase the threshold for the performance tests in CI because the perf is better now.
Improve the code style of ScheduleBatch