search

mckaywrigley / chatbot-ui

AI chat for every model.
https://chatbotui.com
MIT License
27.99k stars 7.79k forks source link

Add Groq client support #1495

Closed mmahmad closed 5 months ago

mmahmad commented 6 months ago

I have a Groq API key that I'd like to be able to use for the models they support (see here).

Seems like their chat completion API interface is the same as OpenAI's (https://console.groq.com/docs/quickstart), with some exceptions.

spammenotinoz commented 5 months ago

Wow, thanks mmahmad these are super fast. How can I make this the default model for users? Do I need to run a SQL migration or front-end code that can be changed. I'll take a look myself also.

mmahmad commented 5 months ago

Thanks to fkesheh@ for the fast turnaround!

For changing the default model in the home and all other workspaces, I think you'd need to change at least the following 2 places: