search

runpod-workers / worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
MIT License
213 stars 82 forks source link

ImportError prepare_hf_model_weights method #73

Closed ArtyoMKos closed 3 months ago

ArtyoMKos commented 3 months ago

Since vLLM 0.4.1 added model_loader and did not added function. During docker building process model downloader module failed to import this function.

armenmkrt commented 3 months ago

Same problem!

alpayariyak commented 2 months ago

This was fixed!