redhat-et / foundation-models-for-documentation

Improve ROSA customer experience (and customer retention) by leveraging foundation models to do “gpt-chat” style search of Red Hat customer documentation assets.
Other
24 stars 11 forks source link

Add manifests for using ray serve with llama2 #64

Closed MichaelClifford closed 8 months ago

MichaelClifford commented 9 months ago

This PR Adds manifests for deploying llama2 with Ray serve. It also made a slight organizational change to the manifests dir and moved text-generation-webui work into its own sub directory along with the newly added ray-serve-llama dir.