LLaMA2-70b-chat doesn't work

appleboy / CodeGPT

A CLI written in Go language that writes git commit messages or do a code review brief for you using ChatGPT AI (gpt-4o, gpt-4-turbo, gpt-3.5-turbo model) and automatically installs a git prepare-commit-msg hook.

MIT License

1.15k stars 100 forks source link

LLaMA2-70b-chat doesn't work #154

Closed khorark closed 2 months ago

khorark commented 2 months ago

Hello,

The 25.04 llama model doesn't seem to be working as expected, and I think it might be because groq disabled it.

Could you please update the model so we can use llama 3 instead?

Thanks!

appleboy commented 2 months ago

I will take it.

appleboy commented 2 months ago

New model list for groq: https://console.groq.com/docs/models

appleboy commented 2 months ago

@khorark try https://github.com/appleboy/CodeGPT/releases/tag/v0.11.1

khorark commented 2 months ago

Your efficiency is impressive. Thanks for getting that done so quickly!

It works, but only with model llama3-70b-8192

Model llama3-8b-8192 doesn't work and I have this error