jgravelle / Groqqle

71 stars 31 forks source link

Where are the models available in Groq? #4

Closed suizideFloat closed 2 weeks ago

suizideFloat commented 2 weeks ago

Guys, nice project, but llama2 ? and mixtral only? There is Llama3.1 in different flavors and Llama3 availbale on groq. Please add that to the code.

jgravelle commented 2 weeks ago

When running on the Streamlit hosted site, that'll happen. The summaries can be unavailable as well. This doesn't happen when run locally.

It has to do with Streamlit's IPs getting flagged as potential D.O.S. agents due to the volume of traffic that comes from them. Please see the latest video.

Thanks for the feedback and your interest...!

suizideFloat commented 1 week ago

What do you mean by that? I run it locally (dockerized). And see the image to verify my claim. Screenshot

jgravelle commented 1 week ago

Pull down the latest version and try again ...