Increase the number of thread limitation for tp worker managers.

sgl-project / sglang

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

Apache License 2.0

2.75k stars 177 forks source link

Increase the number of thread limitation for tp worker managers. #567

Closed merrymercy closed 4 days ago

merrymercy commented 4 days ago