Volumes not updating from hosts from versions > 4.32

[eamon-straughn]

Description

We can make changes to code on versions <= 4.32 but when we upgrade to any of the new versions no changes occur because the volume is not syncing with the host.

Reproduce

here’s my script for creating volumes docker volume create --driver local --opt type=none --opt device=/var/www --opt o=bind www docker volume create --driver local --opt type=none --opt device=/var/pgsql --opt o=bind pgsql sudo chown -R $USER:wheel /var/www sudo chown -R $USER:wheel /var/pgsql

here’s some of my composer file volumes: www: external: true pgsql: external: true

services: php-fpm: container_name: php-fpm restart: always build: context: . dockerfile: ./php/DockerFile ports:

• “9000:9000” volumes:
• type: volume source: www target: /var/www volume: nocopy: true extra_hosts:
• “myaccount.systemportals.org:10.10.10.50”

httpd: container_name: httpd restart: always build: context: . dockerfile: ./httpd/DockerFile ipc: host privileged: true volumes:

• type: volume source: www target: /var/www volume: nocopy: true
• ./logs:/usr/local/apache2/logs:consistent ports:
• “80:80”
• “443:443” depends_on:
• php-fpm

Expected behavior

Should work like previous versions where you can make changes on the host and it updates on the container

docker version

Client:
 Version:           27.2.0
 API version:       1.47
 Go version:        go1.21.13
 Git commit:        3ab4256
 Built:             Tue Aug 27 14:14:45 2024
 OS/Arch:           darwin/arm64
 Context:           desktop-linux

Server: Docker Desktop 4.34.0 (165256)
 Engine:
  Version:          27.2.0
  API version:      1.47 (minimum version 1.24)
  Go version:       go1.21.13
  Git commit:       3ab5c7d
  Built:            Tue Aug 27 14:15:41 2024
  OS/Arch:          linux/arm64
  Experimental:     false
 containerd:
  Version:          1.7.20
  GitCommit:        8fc6bcff51318944179630522a095cc9dbf9f353
 runc:
  Version:          1.1.13
  GitCommit:        v1.1.13-0-g58aa920
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0

docker info

Client:
 Version:    27.2.0
 Context:    desktop-linux
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.16.2-desktop.1
    Path:     /Users/eamon.straughn/.docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v2.29.2-desktop.2
    Path:     /Users/eamon.straughn/.docker/cli-plugins/docker-compose
  debug: Get a shell into any image or container (Docker Inc.)
    Version:  0.0.34
    Path:     /Users/eamon.straughn/.docker/cli-plugins/docker-debug
  desktop: Docker Desktop commands (Alpha) (Docker Inc.)
    Version:  v0.0.15
    Path:     /Users/eamon.straughn/.docker/cli-plugins/docker-desktop
  dev: Docker Dev Environments (Docker Inc.)
    Version:  v0.1.2
    Path:     /Users/eamon.straughn/.docker/cli-plugins/docker-dev
  extension: Manages Docker extensions (Docker Inc.)
    Version:  v0.2.25
    Path:     /Users/eamon.straughn/.docker/cli-plugins/docker-extension
  feedback: Provide feedback, right in your terminal! (Docker Inc.)
    Version:  v1.0.5
    Path:     /Users/eamon.straughn/.docker/cli-plugins/docker-feedback
  init: Creates Docker-related starter files for your project (Docker Inc.)
    Version:  v1.3.0
    Path:     /Users/eamon.straughn/.docker/cli-plugins/docker-init
  sbom: View the packaged-based Software Bill Of Materials (SBOM) for an image (Anchore Inc.)
    Version:  0.6.0
    Path:     /Users/eamon.straughn/.docker/cli-plugins/docker-sbom
  scout: Docker Scout (Docker Inc.)
    Version:  v1.13.0
    Path:     /Users/eamon.straughn/.docker/cli-plugins/docker-scout

Server:
 Containers: 9
  Running: 8
  Paused: 0
  Stopped: 1
 Images: 30
 Server Version: 27.2.0
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
 Swarm: inactive
 Runtimes: runc io.containerd.runc.v2
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 8fc6bcff51318944179630522a095cc9dbf9f353
 runc version: v1.1.13-0-g58aa920
 init version: de40ad0
 Security Options:
  seccomp
   Profile: unconfined
  cgroupns
 Kernel Version: 6.10.4-linuxkit
 Operating System: Docker Desktop
 OSType: linux
 Architecture: aarch64
 CPUs: 10
 Total Memory: 15.6GiB
 Name: docker-desktop
 ID: 5c7b8fec-8175-440b-859d-1385455a10e3
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 HTTP Proxy: http.docker.internal:3128
 HTTPS Proxy: http.docker.internal:3128
 No Proxy: hubproxy.docker.internal
 Labels:
  com.docker.desktop.address=unix:///Users/eamon.straughn/Library/Containers/com.docker.docker/Data/docker-cli.sock
 Experimental: false
 Insecure Registries:
  hubproxy.docker.internal:5555
  127.0.0.0/8
 Live Restore Enabled: false

WARNING: daemon is not using the default seccomp profile

Diagnostics ID

29CD53F1-757D-4C7A-9A73-BB455ED91723/20240912114209

Additional Info

4.32 and previous works perfectlt

[hendrikbehncke]

I experience the same issues in docker desktop since >= 4.33 on my Mac with M1 cpu and it seems to be related to symlinks as far as my tests went.

Reproduce

The compose.yml looks like this

services:
  mount:
    image: alpine
    environment:
      - TZ=Europe/Berlin
    volumes:
      - /Users/hendrik/Webserver/test:/var/www/html:consistent
    tty: true

I have a single text file in this folder

/var/www/html # ls
test.txt
/var/www/html # cat test.txt 
1234

Then I created a symlink on the host system to this file and can access it inside the container ln -s test.txt link

/var/www/html # ls
link      test.txt
/var/www/html # cat link
1234

I then deleted the symlink on the host system. Inside the container it looks like the symlink is not available anymore but can still be accessed

/var/www/html # ls
test.txt
/var/www/html # cat link
1234

Also I tried to create the file named link from within the container. There is no error but the file is also not created

/var/www/html # touch link
/var/www/html # ls
test.txt

Expected Behaviour

When Docker Desktop is downgraded to 4.32.0 the above tests work as expected. If the symlink file is deleted or changed on the host system it reflects immediately in the container.

/var/www/html # ls
test.txt
/var/www/html # cat link
cat: can't open 'link': No such file or directory