search

Bin-Huang / chatbox

User-friendly Desktop Client App for AI Models/LLMs (GPT, Claude, Gemini, Ollama...)
https://chatboxai.app
GNU General Public License v3.0
21.67k stars 2.19k forks source link

[Feature] add llama3.1 support on groq API #1461

Open EnzoAndree opened 3 months ago

EnzoAndree commented 3 months ago

Problem Description We can not use the new llama3.1 models on the groq API.

Proposed Solution Add the model as an option, and maybe add a custom model name

Additional Context Llama 3.1 405B (Preview) Model ID: llama-3.1-405b-reasoning Developer: Meta Context Window: 131,072 tokens Model Card Llama 3.1 70B (Preview) Model ID: llama-3.1-70b-versatile Developer: Meta Context Window: 131,072 tokens Model Card Llama 3.1 8B (Preview) Model ID: llama-3.1-8b-instant Developer: Meta Context Window: 131,072 tokens Model Card

ouening commented 3 months ago

Same feature request!

ricklei2777 commented 3 months ago

ME TOO!

hidenmaskvip commented 3 months ago

+1 Hope to customize the model name

jeevan900929 commented 3 months ago

Please add this feature!