jlesage / docker-cloudberry-backup

Docker container for CloudBerry Backup (Linux Edition)
MIT License
37 stars 7 forks source link

Unable to select local folders to backup. #4

Open cloudymark opened 6 years ago

cloudymark commented 6 years ago

When I go to select the backup folders, all I see is the below. Any ideas?

I have a folder /storage that I've mapped to the container folder /storage and have validated that this works by browsing to it via console.

image

jlesage commented 6 years ago

How did you created the container? Could you also provide the output of the following commands:

cloudymark commented 6 years ago

I created it using the following:

docker run -d \ --name=cloudberry-backup \ -p 5800:5800 \ -v /docker/containers/cloudberry-backup/config:/config:rw \ -v /storage:/storage:ro \ -e USER_ID=1000 -e GROUP_ID=1004 \ --restart=always \ -e TZ="TZ=Europe/London" \ --network=media \ jlesage/cloudberry-backup

Outputs attached.

Thanks for helping. I have worked around it by adding a symlink into the config folder to my storage folder, but its a strange issue.

Mark.


From: Jocelyn Le Sage notifications@github.com Sent: Friday, August 31, 2018 2:43:07 PM To: jlesage/docker-cloudberry-backup Cc: cloudymark; Author Subject: Re: [jlesage/docker-cloudberry-backup] Unable to select local folders to backup. (#4)

How did you created the container? Could you also provide the output of the following commands:

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/jlesage/docker-cloudberry-backup/issues/4#issuecomment-417668274, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AZsLI2Y_r0r32k4sHMQPJzQ9yDmS7zjzks5uWT1rgaJpZM4WVLsw.

root@media:/tmp# docker exec cloudberry-backup df -h Filesystem Size Used Available Use% Mounted on overlay 29.4G 19.4G 8.5G 70% / tmpfs 64.0M 0 64.0M 0% /dev tmpfs 2.9G 0 2.9G 0% /sys/fs/cgroup /dev/sda2 29.4G 19.4G 8.5G 70% /config mergerfsPool 4.5T 1012.3G 3.3T 23% /storage /dev/sda2 29.4G 19.4G 8.5G 70% /etc/resolv.conf /dev/sda2 29.4G 19.4G 8.5G 70% /etc/hostname /dev/sda2 29.4G 19.4G 8.5G 70% /etc/hosts shm 64.0M 0 64.0M 0% /dev/shm tmpfs 2.9G 0 2.9G 0% /proc/acpi tmpfs 64.0M 0 64.0M 0% /proc/kcore tmpfs 64.0M 0 64.0M 0% /proc/keys tmpfs 64.0M 0 64.0M 0% /proc/timer_list tmpfs 64.0M 0 64.0M 0% /proc/sched_debug tmpfs 2.9G 0 2.9G 0% /proc/scsi tmpfs 2.9G 0 2.9G 0% /sys/firmware

[ { "Id": "81bc0982e97d295a92dce6bb9553261949d49e2c69a1991888d1dca41ae61203", "Created": "2018-08-31T13:45:28.211306719Z", "Path": "/init", "Args": [], "State": { "Status": "running", "Running": true, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 8055, "ExitCode": 0, "Error": "", "StartedAt": "2018-08-31T13:45:29.252210847Z", "FinishedAt": "0001-01-01T00:00:00Z" }, "Image": "sha256:ac0439efdc1d3da475886f99ff9b38f97f9fc036f2754a2fdbecc44dc6d05673", "ResolvConfPath": "/var/lib/docker/containers/81bc0982e97d295a92dce6bb9553261949d49e2c69a1991888d1dca41ae61203/resolv.conf", "HostnamePath": "/var/lib/docker/containers/81bc0982e97d295a92dce6bb9553261949d49e2c69a1991888d1dca41ae61203/hostname", "HostsPath": "/var/lib/docker/containers/81bc0982e97d295a92dce6bb9553261949d49e2c69a1991888d1dca41ae61203/hosts", "LogPath": "/var/lib/docker/containers/81bc0982e97d295a92dce6bb9553261949d49e2c69a1991888d1dca41ae61203/81bc0982e97d295a92dce6bb9553261949d49e2c69a1991888d1dca41ae61203-json.log", "Name": "/cloudberry-backup", "RestartCount": 0, "Driver": "overlay2", "Platform": "linux", "MountLabel": "", "ProcessLabel": "", "AppArmorProfile": "docker-default", "ExecIDs": null, "HostConfig": { "Binds": [ "/docker/containers/cloudberry-backup/config:/config:rw", "/storage:/storage:ro" ], "ContainerIDFile": "", "LogConfig": { "Type": "json-file", "Config": {} }, "NetworkMode": "media", "PortBindings": { "5800/tcp": [ { "HostIp": "", "HostPort": "5800" } ] }, "RestartPolicy": { "Name": "always", "MaximumRetryCount": 0 }, "AutoRemove": false, "VolumeDriver": "", "VolumesFrom": null, "CapAdd": null, "CapDrop": null, "Dns": [], "DnsOptions": [], "DnsSearch": [], "ExtraHosts": null, "GroupAdd": null, "IpcMode": "shareable", "Cgroup": "", "Links": null, "OomScoreAdj": 0, "PidMode": "", "Privileged": false, "PublishAllPorts": false, "ReadonlyRootfs": false, "SecurityOpt": null, "UTSMode": "", "UsernsMode": "", "ShmSize": 67108864, "Runtime": "runc", "ConsoleSize": [ 0, 0 ], "Isolation": "", "CpuShares": 0, "Memory": 0, "NanoCpus": 0, "CgroupParent": "", "BlkioWeight": 0, "BlkioWeightDevice": [], "BlkioDeviceReadBps": null, "BlkioDeviceWriteBps": null, "BlkioDeviceReadIOps": null, "BlkioDeviceWriteIOps": null, "CpuPeriod": 0, "CpuQuota": 0, "CpuRealtimePeriod": 0, "CpuRealtimeRuntime": 0, "CpusetCpus": "", "CpusetMems": "", "Devices": [], "DeviceCgroupRules": null, "DiskQuota": 0, "KernelMemory": 0, "MemoryReservation": 0, "MemorySwap": 0, "MemorySwappiness": null, "OomKillDisable": false, "PidsLimit": 0, "Ulimits": null, "CpuCount": 0, "CpuPercent": 0, "IOMaximumIOps": 0, "IOMaximumBandwidth": 0, "MaskedPaths": [ "/proc/acpi", "/proc/kcore", "/proc/keys", "/proc/latency_stats", "/proc/timer_list", "/proc/timer_stats", "/proc/sched_debug", "/proc/scsi", "/sys/firmware" ], "ReadonlyPaths": [ "/proc/asound", "/proc/bus", "/proc/fs", "/proc/irq", "/proc/sys", "/proc/sysrq-trigger" ] }, "GraphDriver": { "Data": { "LowerDir": "/var/lib/docker/overlay2/113ebf8662fd466d30e782c1e35bca45e54269cadcd2ffc6b62bcff64f35b711-init/diff:/var/lib/docker/overlay2/46502fa70c03bca4e751c7505731f882ac736f9b424baecd35a4917c5a3c74f4/diff:/var/lib/docker/overlay2/a557a382538554b68b89d46ded5f07ef52c52fd2f4daf096640bcc044ca81fc0/diff:/var/lib/docker/overlay2/f45b8956e97550dee63f27cd0f2b1ff9307feb7a0d26b948f55902d4e148fae2/diff:/var/lib/docker/overlay2/8f63d2a82017e973933fb92e8230a684d2a86655ab74ad18f16a5d60c3cab0de/diff:/var/lib/docker/overlay2/fb3addc6fe532db2e9b8dcaaea674ab536f29c6ebb2a3bfbabb7a0110016c229/diff:/var/lib/docker/overlay2/17de3fba4cba06aa9d0f5db17e8ce122e76b74aaedabf65425878345bef028f2/diff:/var/lib/docker/overlay2/f94a383fa6c6c1b811b5a6eee888484e560e9f57764e5c25579a6e855fa35824/diff:/var/lib/docker/overlay2/07fde89d8a66aec1dc6169156367c056ff3ec3ddbb9fa949f9a331bfa9805e48/diff:/var/lib/docker/overlay2/afe2411f8ea913aac77ad8fe81fbadd4a57cc429c45748ebccc5f492a408e434/diff:/var/lib/docker/overlay2/26bece2475b6447668411cc9520ea70375d96b8bca677975053432235cf1bcac/diff:/var/lib/docker/overlay2/78d7b3fbce7cee4858af2017bf30e846e204b052d60cd34dbcb9e8ea789e2a0c/diff:/var/lib/docker/overlay2/9033f6da810ba56125950f0973e9a88817e0968468229a96ff8633850c643497/diff:/var/lib/docker/overlay2/34462b672ee77383fad85af9928c8907c8b5484b5981578149fe7c4944343dd4/diff:/var/lib/docker/overlay2/15e6f8490a6596a522547e52a781ac3862297f9e86a21c2dcd52aa32f797a974/diff:/var/lib/docker/overlay2/6f1ecd1d0fc2592869e8748b7e7fea609ec0bc712df2736506d5575249cacd16/diff:/var/lib/docker/overlay2/89304b8b1108b9818219e692f9c1f0952da3a16a7256c53f70d846ecef55c7f4/diff:/var/lib/docker/overlay2/eb549e58738d864c9a4a53d588248e63dcd5825b37f968696dcb29946e18bef3/diff:/var/lib/docker/overlay2/ac6ce7721ab2e902fb75379afa61759839bc71cad01be462493dd67d7d9672b1/diff:/var/lib/docker/overlay2/4cc63c03b1276c79ac58a7ea6bad6e780e78172777e15498e10c05c72f3e66da/diff:/var/lib/docker/overlay2/f75dfe3e4a62ac3686dc49cd57f4482ba0bfb536ded69cefc8ffed2367060cce/diff", "MergedDir": "/var/lib/docker/overlay2/113ebf8662fd466d30e782c1e35bca45e54269cadcd2ffc6b62bcff64f35b711/merged", "UpperDir": "/var/lib/docker/overlay2/113ebf8662fd466d30e782c1e35bca45e54269cadcd2ffc6b62bcff64f35b711/diff", "WorkDir": "/var/lib/docker/overlay2/113ebf8662fd466d30e782c1e35bca45e54269cadcd2ffc6b62bcff64f35b711/work" }, "Name": "overlay2" }, "Mounts": [ { "Type": "bind", "Source": "/docker/containers/cloudberry-backup/config", "Destination": "/config", "Mode": "rw", "RW": true, "Propagation": "rprivate" }, { "Type": "bind", "Source": "/storage", "Destination": "/storage", "Mode": "ro", "RW": false, "Propagation": "rprivate" } ], "Config": { "Hostname": "81bc0982e97d", "Domainname": "", "User": "", "AttachStdin": false, "AttachStdout": false, "AttachStderr": false, "ExposedPorts": { "43210/tcp": {}, "43211/tcp": {}, "5800/tcp": {}, "5900/tcp": {} }, "Tty": false, "OpenStdin": false, "StdinOnce": false, "Env": [ "USER_ID=1000", "GROUP_ID=1004", "TZ=TZ=Europe/London", "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin", "LANG=en_US.UTF-8", "S6_BEHAVIOUR_IF_STAGE2_FAILS=3", "S6_SERVICE_DEPS=1", "APP_NAME=CloudBerry Backup", "APP_USER=app", "XDG_DATA_HOME=/config/xdg/data", "XDG_CONFIG_HOME=/config/xdg/config", "XDG_CACHE_HOME=/config/xdg/cache", "XDG_RUNTIME_DIR=/tmp/run/user/app", "DISPLAY=:0", "DISPLAY_WIDTH=1280", "DISPLAY_HEIGHT=768", "CBB_WEB_INTERFACE_USER=", "CBB_WEB_INTERFACE_PASSWORD=" ], "Cmd": [ "/init" ], "ArgsEscaped": true, "Image": "jlesage/cloudberry-backup", "Volumes": { "/config": {}, "/storage": {} }, "WorkingDir": "/tmp", "Entrypoint": null, "OnBuild": null, "Labels": { "org.label-schema.description": "Docker container for CloudBerry Backup", "org.label-schema.name": "cloudberry-backup", "org.label-schema.schema-version": "1.0", "org.label-schema.vcs-url": "https://github.com/jlesage/docker-cloudberry-backup", "org.label-schema.version": "0.1.0" } }, "NetworkSettings": { "Bridge": "", "SandboxID": "5998daa5d76bd9636419f14d19caa14f6404a4ca129257c140aa252a0645b545", "HairpinMode": false, "LinkLocalIPv6Address": "", "LinkLocalIPv6PrefixLen": 0, "Ports": { "43210/tcp": null, "43211/tcp": null, "5800/tcp": [ { "HostIp": "0.0.0.0", "HostPort": "5800" } ], "5900/tcp": null }, "SandboxKey": "/var/run/docker/netns/5998daa5d76b", "SecondaryIPAddresses": null, "SecondaryIPv6Addresses": null, "EndpointID": "", "Gateway": "", "GlobalIPv6Address": "", "GlobalIPv6PrefixLen": 0, "IPAddress": "", "IPPrefixLen": 0, "IPv6Gateway": "", "MacAddress": "", "Networks": { "media": { "IPAMConfig": null, "Links": null, "Aliases": [ "81bc0982e97d" ], "NetworkID": "e2a3efb09ed4b7f81668e3a2d37cb4af5d542cadddfdb79d43f6148d615c019a", "EndpointID": "084dcb54bb5041fcab93db3e40bc2870a72d367565262fcabb63bcf5e761c009", "Gateway": "172.20.0.1", "IPAddress": "172.20.0.7", "IPPrefixLen": 16, "IPv6Gateway": "", "GlobalIPv6Address": "", "GlobalIPv6PrefixLen": 0, "MacAddress": "02:42:ac:14:00:07", "DriverOpts": null } } } } ] root@media:/tmp# docker exec cloudberry-backup ls -l total 12 drwxr-xr-x 2 root root 4096 Aug 31 13:45 CloudBerry Backup drwxr-xr-x 7 root root 4096 Aug 31 13:45 nginx drwxr-xr-x 3 root root 4096 Aug 31 13:45 run

jlesage commented 6 years ago

Sorry your attachment is missing. You need to attach files using the github web interface.

cloudymark commented 6 years ago

Apologies. df.txt inspect.txt ls.txt

jlesage commented 6 years ago

My guess is that the software doesn't display the folder because of its filesystem:

mergerfsPool              4.5T   1012.3G      3.3T  23% /storage

I will try to contact CloudBerry team to see if this can be fixed.

cloudymark commented 6 years ago

Well that was my assumption, but when I added a link in the config folder to storage, i am able to browse to it fine and then select it for backup.

Also, why do I not see the local files system within the docker image? Or is that by design?

jlesage commented 6 years ago

Well that was my assumption, but when I added a link in the config folder to storage, i am able to browse to it fine and then select it for backup.

Yes so it's in fact just a UI bug. The /storage folder is not shown even if it exists and accessible.

Also, why do I not see the local files system within the docker image? Or is that by design?

What do you mean exactly be the "local files system" ?

cloudymark commented 6 years ago

The file system in the docker image itself. It doesn't even show those folders. It just targets the config folder and some other random files.

jlesage commented 6 years ago

I think it's because of the same issue: the root / is mounted with an overlay filesystem, something probable not recognized by the UI.

KevinColbert3 commented 5 years ago

Any update on this issue? I have the same problem. My /storage docker volume is mapped to a ZFS pool on the host. When I start this docker image, I can see /storage and browse it and see all my files within the ZFS pool. However when trying to setup a backup, this storage folder does not exist in the UI. Even if I place a symbolic link in the config folder to /storage, it still doesn't show up. Any ideas?

jlesage commented 5 years ago

Unfortunately I didn't get answers yet from CloudBerry about this issue. I pinged them again yesterday.

To document unsupported filesystems, can you post the output of docker exec [container name] df -h?

sneakernuts commented 3 years ago

Having the same issue as well all of a sudden. The GUI was still working two weeks ago, then after a reboot of the host I'm not seeing the paths anymore. However, since the configuration is still in tact, I can still perform backups using the same backup plan. Unable to make any changes to it though.

jlesage commented 3 years ago

Looks like an issue where the mounts on the host were not ready at the time the container was started. Did you try to restart the container again to see if you still get the issue ?

sneakernuts commented 3 years ago

Looks like an issue where the mounts on the host were not ready at the time the container was started. Did you try to restart the container again to see if you still get the issue ?

I have tried restarting and still get the issue.