runpod-workers / worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
MIT License
213 stars 82 forks source link

Fixed MODEL_REVISION environment variable #67

Closed mikljohansson closed 3 months ago

mikljohansson commented 3 months ago

It seems there was a typo in the Dockerfile, preventing $MODEL_REVISON from ever being set since the build-arg was called $MODEL_REVISON but the ENV instruction tried to read a non-existing $REVISION variable