search

vocodedev / vocode-core

🤖 Build voice-based LLM agents. Modular + open source.
https://vocode.dev
MIT License
2.56k stars 430 forks source link

[Feature]: Add support for Groq (LLM) #516

Open spikecodes opened 4 months ago

spikecodes commented 4 months ago

Brief Description

Add support for using Groq as an LLM

Rationale

Groq has an OpenAI-compatible API that allows you to call Mixtral LLM generation on their specialized hardware known as LPUs (Language Processing Units) to get high quality output at 4x the speed of GPT 3.5.

Suggested Implementation

Create a new LLM

XIII-IIIX commented 4 months ago

This would be epic!

djjrock commented 4 months ago

+1

Arunprakaash commented 4 months ago

i have added support for groq #526