modified with sysprompt support

runpod-workers / worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

MIT License

220 stars 85 forks source link

modified with sysprompt support #7

Closed Reverendissimo closed 8 months ago

Reverendissimo commented 1 year ago

added sysprompt support (to be tested) fixed weird issue with setup.sh that had ^M instead of /n as string terminator causing error during docker build