Closed mdrewry closed 6 months ago
ill check it out. and fix that
i didnt really test the gpu one cause i dont have one. you can fork the project and try to fix it too. of course me too. @mdrewry
i've merged the fix. at least for nvidia gpus. the fix is similar for other gpus but of course you have to read your gpus docs if it conflicts. @mdrewry
When I attempt to run the docker compose file with gpu support, ollama exits with the following error: