Integration in Oobabooga webui?

petals-infra / chat.petals.dev

💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client

https://chat.petals.dev

305 stars 78 forks source link

Open Vincent-Stragier opened 1 year ago

Vincent-Stragier commented 1 year ago

Hello,

Do you think it would make sense to integrate petals somehow in the Oobabooga web UI?

Regards, Vincent

borzunov commented 1 year ago

Hi @Vincent-Stragier,

Sure, I'd be happy to see this happen!

Vincent-Stragier commented 1 year ago

For reference @Mathnerd314 is working on this issue (see his fork of Oobabooga's text generation webui), more information on Discord. You can already try his implementation using his Colab notebook.

P.S.: Thanks for the ping @borzunov

borzunov commented 1 year ago