search

sammcj / gollama

Go manage your Ollama models
https://smcleod.net
MIT License
369 stars 26 forks source link

What is this environment variable OLLAMA_RUNNERS_DIR ? #75

Closed arafatx closed 2 months ago

arafatx commented 2 months ago

When I run one of the models I will get ERROR before the model loaded:

2024/07/15 09:05:59 ERROR unable to locate llm runner directory. Set OLLAMA_RUNNERS_DIR to the location of 'ollama_runners'

But after the message, the model had successfully loaded without issue, and I can continue chatting with it.

1) Type in gollama in terminal 2) run any model by pressing enter 3) an error message will appear before the model is loaded:

"2024/07/15 09:05:59 ERROR unable to locate llm runner directory. Set OLLAMA_RUNNERS_DIR to the location of 'ollama_runners'"

Screenshot:

image

If applicable, add screenshots to help explain your problem.

Question is where actually the llm runner directory is located. Thank you.

sammcj commented 2 months ago

Hey @arafatx,

Thanks for logging the issue.

I can see you're running Windows, Gollama as it's designed for Linux/macOS.

Happy to consider a PR to resolve this issue for Windows if anyone has one, however I'm not planning on adding Windows support.

Sorry about that!