search

TEN-framework / TEN-Agent

TEN Agent is a world-class multimodal AI agent integrated with the OpenAI Realtime API, RTC, and features weather checks, web search, vision, and RAG.
https://agent.theten.ai/
Apache License 2.0
1.72k stars 196 forks source link

Groq LLM #333

Open BenWeekes opened 1 month ago

BenWeekes commented 1 month ago

Please add an extension to use Groq LLM
https://groq.com/
Groq has the same interface as OAI and is faster and cheaper.

plutoless commented 1 month ago

Please add an extension to use Groq LLM https://groq.com/ Groq has the same interface as OAI and is faster and cheaper.

i think most of its api are openai compatible so you can really just use the openai extension, while changing the baseURL

https://console.groq.com/docs/openai

BenWeekes commented 1 month ago

Hi, yes that is true and we can set base_url in property.json so it would be possible to make a new graph now with groq e.g. deepgram.groq.cartesia which I understand is the fastest and cheapest cascading pipline possible today.