Add support for Groq LLM inference

OpenInterpreter / 01

The open-source language model computer

http://openinterpreter.com/01

GNU Affero General Public License v3.0

4.76k stars 469 forks source link

Open Vasanthengineer4949 opened 3 months ago

Vasanthengineer4949 commented 3 months ago

All of the OpenAI products are paid and Ollama can be slow so please try to provide integration for Groq API to run Mixtral.

achoozachooz commented 1 month ago

I tred to do that. but I'm getting a lot of error.

Merlinvt commented 1 month ago

have you tried setting GROQ_API_KEY locally and leaving it out of the arguments?