Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network.
GNU General Public License v3.0
535
stars
64
forks
source link
Docs for locally running ollama integration doesn't work #63
Describe the BugSetup doc where it suggests using extra_hosts: 'host.docker.internal:host-gateway' is not working for Docker version 27.0.3, build 7d4bcd8. The container fails to connect to ollama running on the host.
How To Reproduce
Following the setup doc with docker version 27.
Expected Behavior
Connection to the ollama service should be seamless.
Proposed Solution
Directly using network_mode: "host" works out of the box just fine.
Describe the Bug Setup doc where it suggests using
extra_hosts: 'host.docker.internal:host-gateway'is not working forDocker version 27.0.3, build 7d4bcd8. The container fails to connect to ollama running on the host.How To Reproduce Following the setup doc with docker version 27.
Expected Behavior Connection to the ollama service should be seamless.
Proposed Solution Directly using
network_mode: "host"works out of the box just fine.