search

rh-aiservices-bu / llm-on-openshift

Resources, demos, recipes,... to work with LLMs on OpenShift with OpenShift AI or Open Data Hub.
Apache License 2.0
90 stars 86 forks source link

vLLM update to 0.4.2 #62

Closed guimou closed 4 months ago

guimou commented 4 months ago

Fixes #61 Fixes NCCL location issue