search

runpod-workers / worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
MIT License
220 stars 85 forks source link

Rev llama worker runpod #6

Closed Reverendissimo closed 8 months ago

Reverendissimo commented 1 year ago

updated sysmsg

justinmerrell commented 1 year ago

@Jorghi12