search

runpod-workers / worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
MIT License
213 stars 82 forks source link

Gemma-2 is not available in this docker image. #81

Open codingchild2424 opened 1 month ago

codingchild2424 commented 1 month ago

Please update for Gemma-2.