search

rh-aiservices-bu / llm-on-openshift

Resources, demos, recipes,... to work with LLMs on OpenShift with OpenShift AI or Open Data Hub.
Apache License 2.0
97 stars 102 forks source link

vLLM update to 0.4.2 #62

Closed guimou closed 6 months ago

guimou commented 6 months ago

Fixes #61 Fixes NCCL location issue