search

ILikeAI / AlwaysReddy

AlwaysReddy is a LLM voice assistant that is always just a hotkey away.
MIT License
523 stars 50 forks source link

Groq API? #52

Open jgbrwn opened 1 month ago

jgbrwn commented 1 month ago

Just stumbled upon this project and haven’t tried yet, but my first thought is, this would be awesome if could utilize Groq API for the LLM component. Currently the API is free and near instantaneous results.

https://groq.com

You can play around with it here and clicking the code button shows you the Python/curl API code examples:

https://console.groq.com/playground?model=llama3-70b-8192

ILikeAI commented 1 month ago

Great suggestion, id be keen to try this out. Should be very easy to integrate

jgbrwn commented 1 month ago

Very cool, if anything I figured you’d dig the speed of groq’s api/infra.