search

valiantlynx / ollama-docker

Welcome to the Ollama Docker Compose Setup! This project simplifies the deployment of Ollama using Docker Compose, making it easy to run Ollama with all its dependencies in a containerized environment
https://ollama-docker.azurewebsites.net/
Other
455 stars 93 forks source link

docker-compose-ollama-gpu.yaml configuration failing #1

Closed mdrewry closed 6 months ago

mdrewry commented 7 months ago

When I attempt to run the docker compose file with gpu support, ollama exits with the following error:

Error: unknown flag: --gpus

valiantlynx commented 6 months ago

ill check it out. and fix that

valiantlynx commented 6 months ago

i didnt really test the gpu one cause i dont have one. you can fork the project and try to fix it too. of course me too. @mdrewry

valiantlynx commented 6 months ago

i've merged the fix. at least for nvidia gpus. the fix is similar for other gpus but of course you have to read your gpus docs if it conflicts. @mdrewry