search

mneedham / LearnDataWithMark

Code and scripts behind the @LearnDataWithMark YouTube channel
https://learndatawithmark.com
108 stars 32 forks source link

[Content] - sglang #41

Open mneedham opened 7 months ago

mneedham commented 7 months ago

https://github.com/sgl-project/sglang

mneedham commented 7 months ago

I think this needs CUDA so maybe we can't use it:

OSError: CUDA_HOME environment variable is not set. Please set it to your CUDA install root.