Add RoPE config to support that

runpod-workers / worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

MIT License

213 stars 82 forks source link

Closed nerdylive123 closed 1 month ago

nerdylive123 commented 1 month ago

im closing this, because alpay is gonna add support for other arguments