search

sgl-project / sglang

SGLang is a fast serving framework for large language models and vision language models.
https://sgl-project.github.io/
Apache License 2.0
6.22k stars 532 forks source link

feat: add should_use_tensor_cores #2179

Open zhyncs opened 12 hours ago

zhyncs commented 12 hours ago

Motivation

Modifications

Checklist

zhyncs commented 12 hours ago

follow-up https://github.com/sgl-project/sglang/pull/2169