-
Hi, can you please provide a guide or support to use local llm models like Ollama lama3.1 8b or 70b
-
Hi, thanks for building and opening Savvy!
Is there any way I can configure it to use a locally-running LLM? With OpenAI-compatible API or otherwise.
Thanks!
-
Hello,
so I am about to try the Graph Builder for the first time. With Ollama.
I need my data (PDFs etc.) te be kept private and to use the tool totally offline.
Newby question: is the OPENAI_API_K…
-
Is it possible to use a local LLM via Ollama. If, what's the setup and what's the requirement for which LLM I can use (guessing it has to use openai api syntax)?
-
### Feature request
The provided HfEngine class uses the inference API under the hood, this makes using agents simple. However, it would be good to support local inference in a similarly simple way.
…
swtb3 updated
23 hours ago
-
What about custom/private LLMs. Will there be an option to use some of longchain local features like llama.cpp?
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I am trying to use a local LLM in the evaluate function., whe…
-
Do you guys have some notes on the settings for local llm configs?
Do we leave API key blank?
Assuming we use the local Ollama URL in both configs?
This is running on an M3 Mac.
Here's wh…
-
Hey just getting back from vacation and checking out the new version, which looks amazing! Love all the options for alternative LLM providers, particularly the OpenRouter integration.
One thing I'm…
-
### ⚠️ Please check that this feature request hasn't been suggested before.
- [X] I searched previous [Ideas in Discussions](https://github.com/reworkd/AgentGPT/discussions/categories/ideas) didn't f…