Add ENV to configure Sglang Server.

runpod-workers / worker-sglang

SGLang is fast serving framework for large language models and vision language models.

MIT License

9 stars 4 forks source link

Closed pandyamarut closed 2 months ago