issues
search
runpod-workers
/
worker-vllm
The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
MIT License
220
stars
85
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Update for vllm 0.2.0
#9
kenny019
closed
10 months ago
0
Could not build wheels for vllm
#8
Mr-Nobody1
closed
8 months ago
1
modified with sysprompt support
#7
Reverendissimo
closed
8 months ago
0
Rev llama worker runpod
#6
Reverendissimo
closed
8 months ago
2
Rev llama worker runpod
#5
Reverendissimo
closed
1 year ago
0
Fixed STREAMING environment variable not being interpreted as boolean.
#4
vladmihaisima
closed
1 year ago
0
Error while returning job result: Object of type coroutine is not JSON serializable
#3
winchesterdeeplay
closed
1 year ago
2
Repo Consolidation
#2
justinmerrell
closed
1 year ago
1
Update runpod package version
#1
github-actions[bot]
closed
9 months ago
0
Previous