search

dotneet / smart-chatbot-ui

An open source ChatGPT UI.
https://smart-chatbot-ui.vercel.app/
MIT License
471 stars 97 forks source link

feature request: connect to vLLM. #92

Open PaulConyngham opened 1 year ago

PaulConyngham commented 1 year ago

It would be great to be able to connect your fork of chatbot-UI to vLLM which supports an openai api like interface

PaulConyngham commented 1 year ago

any updates with this? It would be super cool to be able to connect to a local hosted model via a chatcompletions interface