Mintplex-Labs / anything-llm

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.
https://anythingllm.com
MIT License
26.07k stars 2.61k forks source link

[BUG]: Failed to Save LLMs #918

Closed hittle2015 closed 7 months ago

hittle2015 commented 7 months ago

How are you running AnythingLLM?

Docker (local)

What happened?

When model selected, click save changes only to get the failed to save LLMs error.

Are there known steps to reproduce?

  1. pull a docker
  2. run with the suggested command, adding two more --add-host=host.docker.internal:host-gateway --net=host
  3. docker container error logs (see below) [TELEMETRY ENABLED] Anonymous Telemetry enabled. Telemetry helps Mintplex Labs Inc improve AnythingLLM. prisma:info Starting a sqlite pool with 21 connections. fatal: not a git repository (or any of the parent directories): .git getGitVersion Command failed: git rev-parse HEAD fatal: not a git repository (or any of the parent directories): .git

[TELEMETRY SENT] { event: 'server_boot', distinctId: 'bad38249-92b4-4bc4-9ef3-65431751adda', properties: { commit: '--', runtime: 'docker' } } Primary server in HTTP mode listening on port 3001 [Event Logged] - update_llm_provider [Event Logged] - update_llm_provider [Event Logged] - update_llm_provider [Event Logged] - update_llm_provider

timothycarambat commented 7 months ago

I do not see an error log in those logs, only that the event for update was stored in the DB. There should be an error message in addition to Failed to Save LLM Settings. What LLM are you attempting to connect to?

hittle2015 commented 7 months ago

llama2

timothycarambat commented 7 months ago

@hittle2015 Using which provider? LMStudio, LocalAi, Ollama, etc etc

timothycarambat commented 7 months ago

closed as stale