vLLM CPU and DeepSparse runtimes

rh-aiservices-bu / llm-on-openshift

Resources, demos, recipes,... to work with LLMs on OpenShift with OpenShift AI or Open Data Hub.

Apache License 2.0

74 stars 71 forks source link

Closed RHRolun closed 5 days ago

guimou commented 5 days ago

@RHRolun So ready to merge?

RHRolun commented 5 days ago

@guimou yup, all good from my side, feel free to complete the PR if the latest change looks good to you :)