search

mneedham / LearnDataWithMark

Code and scripts behind the @LearnDataWithMark YouTube channel
https://learndatawithmark.com
125 stars 37 forks source link

[Content] - sglang #41

Open mneedham opened 9 months ago

mneedham commented 9 months ago

https://github.com/sgl-project/sglang

mneedham commented 8 months ago

I think this needs CUDA so maybe we can't use it:

OSError: CUDA_HOME environment variable is not set. Please set it to your CUDA install root.