Closed roblem closed 6 months ago
This is due to selinux. You need to set correct permissions on the various docker files or temporarily disable.
To fix it, append :z
to the volume mounts in the compose files:
volumes:
- './models:/models:z'
- './api:/api:z'
Then you don't have to disable selinux.
Building the container using either
run.sh --model 7b
(it doesn't matter what model you specify, the issue exists), ordocker-compose -f docker-compose-gguf.yml up --build
results in
The script continually tries to run
/api/run.sh
in the container and the permission issue persists. You have to control-c the build as it never finishes.