Groq API implementation

Canner / WrenAI

Wren AI makes your database RAG-ready. Implement Text-to-SQL more accurately and securely.

https://getwren.ai

GNU Affero General Public License v3.0

1.36k stars 108 forks source link

Groq API implementation #475

Closed Namec999 closed 11 hours ago

Namec999 commented 2 days ago

Currently trying to use Groq as Open Ai compatible API provider

i am following the docs, but i think that i am missing something

can you show me the way to achieve this

cyyeh commented 2 days ago

@Namec999 hi, thanks for reaching out! It seems that Groq doesn't provide embedding models right? If so, currently Wren AI only supports embedding model and LLM using the same provider. We'll fix this in the next release.