search

rh-aiservices-bu / llm-on-openshift

Resources, demos, recipes,... to work with LLMs on OpenShift with OpenShift AI or Open Data Hub.
Apache License 2.0
90 stars 86 forks source link

Add hf_tgi_runtime #34

Closed dagrayvid closed 8 months ago

dagrayvid commented 8 months ago

@guimou as discussed here is a PR to add the HF TGI runtime.

I also renamed the directory with the HF TGI deployment for consistency.