Open zinwelzl opened 3 months ago
👋 Hi @zinwelzl, Issues is only for reporting a bug/feature request. Please read documentation before raising an issue https://rengine.wiki For very limited support, questions, and discussions, please join reNgine Discord channel: https://discord.gg/azv6fzhNCE Please include all the requested and relevant information when opening a bug report. Improper reports will be closed without any response.
Sure, I agree running any models locally is super slow. I will look at groq today
Google AI Studio model free
Is there an existing feature or issue for this?
Expected feature
ollama is very slow on VPS, no GPU.
Can you add Groq API?
https://console.groq.com/docs/models https://console.groq.com/docs/api-reference#chat
It is free for now, only need registration.
Alternative solutions
No response
Anything else?
No response