An error occurred: Direct chat failed: Chat request failed: Connection error.

severian42 / GraphRAG-Local-UI

GraphRAG using Local LLMs - Features robust API and multiple apps for Indexing/Prompt Tuning/Query/Chat/Visualizing/Etc. This is meant to be the ultimate GraphRAG/KG local LLM app.

MIT License

1.69k stars 198 forks source link

An error occurred: Direct chat failed: Chat request failed: Connection error. #37

Closed Essence9999 closed 3 months ago

Essence9999 commented 3 months ago

The lastest version

severian42 commented 3 months ago

Hmmmm I'm not sure why you wouldn't be able to connect. The provider routing is using the OpenAI framework and exposing it for OpenAI compatibility, so it should be able to connect you to any base URL. I've really only tested it using local LLM set-ups though myself

Essence9999 commented 3 months ago

sudo ufw allow 11434 solved my problem