[Bug]: can't mount volumes with external drivers in compose files

[RayBB]

Description

When I try to mount a volume from an external driver (rclone in this case) it doesn't work. It just shows an empty folder.

more info at https://rclone.org/docker/

Minimal Reproduction (if possible, example repository)

sudo mkdir -p /var/lib/docker-plugins/rclone/config
sudo mkdir -p /var/lib/docker-plugins/rclone/cache

ln -s ~/.config/rclone/rclone.conf /var/lib/docker-plugins/rclone/config

## Choose the right tag here for your machine
docker plugin install rclone/docker-volume-rclone:arm64 \
  --alias rclone \
  --grant-all-permissions \
  args="-v --allow-other"
docker plugin enable rclone

docker volume create rclone-http -d rclone -o type=http -o http-url=https://beta.rclone.org/test/

# See it working by opening that folder in filebrowser locally without coolify
docker run --rm \
  -v rclone-http:/srv/httptesting \
  -p 8888:80 \
  -e FB_NOAUTH=noauth \
  --name filebrowser filebrowser/filebrowser:latest

However, it doesn't work when we use a compose file in coolify

services:
  filebrowser:
    image: 'filebrowser/filebrowser:latest'
    environment:
      - SERVICE_FQDN_FILEBROWSER2
      - PUID=1000
      - PGID=1000
      - FB_NOAUTH=noauth
    volumes:
      - 'rclone-http:/srv/httptesting'
volumes:
  rclone-http:
    external: true

I just get an empty folder.

I think this is a bug.

Exception or Error

No response

Version

v4.0.0-beta.323

Cloud?

• [ ] Yes
• [X] No

[RayBB]

Actually, I think it's just that external volumes aren't supported in general.

If I try to inline the external part like so:

services:
  filebrowser:
    image: 'filebrowser/filebrowser:latest'
    environment:
      - SERVICE_FQDN_FILEBROWSER2
      - PUID=1000
      - PGID=1000
      - FB_NOAUTH=noauth
    volumes:
      - type: volume
        source: rclone-http
        target: /srv/httptesting
        external: true

I get this error:

validating /data/coolify/services/c88wks0cgc0kgwcooo8sscgg/docker-compose.yml: services.app.volumes.2 Additional property external is not allowed

[kmbuthia]

I just ran into volume mount issues as well. This used to work...but as of version 4.0.0-beta.331 there seems to be issues with volume mounts. In my case, using Coolify version 4.0.0-beta.331 no longer allows me to do a file mount.

docker-compose.yml snippet below

volumes:
  - './path/to/file:/path/to/file/in/image'

The above no longer works as of version 4.0.0-beta.331

My current workaround: Downgraded back to version 4.0.0-beta.323 FYI @andrasbacsai

[brandnewx]

Docker Compose deployment is broken in different places since 324. Dev(s) should look at this more carefully because each fix only introduces another bug. Probably need a test unit here.

[RayBB]

Tagging @peaklabs-dev with this as I hope we could get it fixed before stable. If not fixed at a minimum a warning in the UI would be great.

If this is fixed I'll happily add docs for how to use this. I think it's a really great fit with the mission of coolify because it's easy to have a cheap VPS but when your storage is limited that can be quite a pain. Being able to use external storages with rclone let's you mount S3 or Google drive or Dropbox or whatever for a scrappy solution that can give you a few TB of storage easily :)

[renatoaraujoc]

Volumes in 4.360 are completely broken.

• You can't used pre-defined volumes created with docker volume create
• Coolify does it best to append the service's uuid on the volumes even if you try hard to avoid it

The issue here is that Coolify is trying to be "too automatic" and is messing things up big time.

In my use case, I have several zfs pools with datasets configured specifically for each sort of service, they're outside the root file-system (where docker runs), so I need to create volumes on different mountpoints and have compose to point to these volumes, its impossible today.

I don't know what to do.

[cankanoa]

I have the same issue. I'm trying to mount a file like this './volumes/logs/vector.yml:/etc/vector/vector.yml:ro' but it mounts as a directory and wont work.