search

clevaway / J.A.R.V.I.S

Jarvis model: A Fine-tune of llama2, works 100% offline with Ollama
MIT License
68 stars 12 forks source link

JARVIS GROQ endpoints Option #11

Open Rivelyn opened 2 months ago

Rivelyn commented 2 months ago

Can you modify JARVIS to call GROQ endpoints? For those of us without GPUs GROQ is an incredibly low cost and highspeed option for inference. Even for people with GPUs GROQ can outperform a GPU for inference.