Groq: llama-3.1-70b-versatile

JusticeRage / Gepetto

IDA plugin which queries uses language models to speed up reverse-engineering

GNU General Public License v3.0

2.81k stars 260 forks source link

Groq: llama-3.1-70b-versatile #42

Closed vanhauser-thc closed 1 month ago

vanhauser-thc commented 1 month ago

Groq has llama-3.1-70b-versatile now for some time and with way less rate limiting and token restrictions and better knowledge, so this should be the default --- if it would work. Dunno what the issue is but when I configure that Gepetto receives just nonsenes from Groq.

JusticeRage commented 1 month ago

I updated the model but could not reproduce your issue. I tested this on my machine and received perfectly fine data from Groq.