search

runpod-workers / worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
MIT License
220 stars 85 forks source link

Set TOKENIZER to None instead of empty string if not provided #17

Closed ashleykleynhans closed 8 months ago

ashleykleynhans commented 9 months ago

Resolves https://github.com/runpod-workers/worker-vllm/issues/14

alpayariyak commented 8 months ago

Fixed in latest version