An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
36.56k
stars
4.51k
forks
source link
Update sglang_worker.py to fix #3372 error launching SGLand worker #3373
Closed
vikrantrathore closed 2 months ago
This commit fixes the issue #3372
Why are these changes needed?
While launching SGLang worker it resulted in an error
Related issue number (if applicable)
3372
Checks
format.sh
to lint the changes in this PR.