[FEATURE] Make it work with Llama3 70b from Groq

EmergenceAI / Agent-E

Agent driven automation starting with the web. Discord: https://discord.gg/wgNfmFuqJF

MIT License

355 stars 50 forks source link

Closed nasko94 closed 2 months ago

nasko94 commented 2 months ago

Please add the functionallity to use LLama3 70b with the Groq API

nasko94 commented 2 months ago

I tried everything and nothing worked for me. Please someone help!

teaxio commented 2 months ago

Working on a pull request for this. Will get it out asap

teaxio commented 2 months ago

grab the latest code your .env needs to have:

AUTOGEN_MODEL_NAME=llama3-70b-8192
AUTOGEN_MODEL_BASE_URL=https://api.groq.com/openai/v1
AUTOGEN_MODEL_API_KEY=groq api key