jgravelle / Groqqle

Groqqle is a powerful web search and content summarization tool built with Python, leveraging Groq's LLM API for advanced natural language processing. It offers customizable web and news searches, image analysis, and adaptive content summaries, making it ideal for researchers, developers, and anyone seeking enhanced information retrieval.
https://j.gravelle
109 stars 41 forks source link

Where are the models available in Groq? #4

Closed suizideFloat closed 2 months ago

suizideFloat commented 2 months ago

Guys, nice project, but llama2 ? and mixtral only? There is Llama3.1 in different flavors and Llama3 availbale on groq. Please add that to the code.

jgravelle commented 2 months ago

When running on the Streamlit hosted site, that'll happen. The summaries can be unavailable as well. This doesn't happen when run locally.

It has to do with Streamlit's IPs getting flagged as potential D.O.S. agents due to the volume of traffic that comes from them. Please see the latest video.

Thanks for the feedback and your interest...!

suizideFloat commented 2 months ago

What do you mean by that? I run it locally (dockerized). And see the image to verify my claim. Screenshot

jgravelle commented 2 months ago

Pull down the latest version and try again ...