[WIP] Testing Suite - Githubissues

runpod-workers / worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

MIT License

213 stars 81 forks source link

Closed alpayariyak closed 3 weeks ago