sgl-project / sglang

SGLang is a fast serving framework for large language models and vision language models.
https://sglang.readthedocs.io/en/latest/
Apache License 2.0
5.39k stars 393 forks source link

Mac support? (vLLM) #508

Closed shiftbug closed 2 months ago

shiftbug commented 3 months ago

noob here, does this mean no mac support, "AssertionError: vLLM only supports Linux platform (including WSL)."

AdrianHsu commented 3 months ago

+1 on this

TensorKartDev commented 3 months ago

+1

zhyncs commented 2 months ago

Hi we currently have no plans. If you are interested, feel free to submit a PR. Thanks.