runpod-workers / worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
MIT License
213 stars 82 forks source link

chore: update `REVISION` to `MODEL_REVISION` in dockerfile #59

Closed joennlae closed 2 weeks ago

joennlae commented 5 months ago

Thank you for this awesome repo 💯 .

While building a custom revision, I noticed this typo.

An incorrect model (main) gets downloaded in download_model.py

pandyamarut commented 2 weeks ago

Seems like this has been addressed.