Ollama share models between host and container

[shenhai-ran]

Hello, I notice that ~/.ollama on host is mounted to /root/.ollama in the container, however from container I can't access the models have been downloaded by the host, is that on purpose?

Anything I can do to reuse the models from the host?

Thanks!

[av]

Hi, the idea is definitely to share the models with the host, the current default location is from the Ollama's defaults on MacOS

The path is configurable and you can point it to your actual cache path like this:

harbor config set ollama.cache /usr/share/ollama/.ollama

# Test: 
# start ollama
harbor up
# check models
harbor ollama ls

Edit: updated Ollama service docs to be more explicit about this

[shenhai-ran]

Thanks! It works on Linux