Closed dsrtusr88 closed 1 year ago
Are you using a Synology NAS ?
@jlesage no, QNAP. initial set up was on container station, have since recreated using portainer and getting the same result
Ok, I know that Synology has trouble with environment variables without value.
So for QNAP, are you saying that it configured by default the SUP_GROUP_IDS
variable with the value ""
?
This was the log when I had SUP__GROUP_IDS
set to ""
`[init ] container is starting...
[cont-env ] loading container environment variables...
[cont-env ] APP_NAME: loading...
[cont-env ] APP_VERSION: loading...
[cont-env ] DISPLAY: executing...
[cont-env ] DISPLAY: terminated successfully.
[cont-env ] DISPLAY: loading...
[cont-env ] DOCKER_IMAGE_PLATFORM: loading...
[cont-env ] DOCKER_IMAGE_VERSION: loading...
[cont-env ] GTK_THEME: executing...
[cont-env ] GTK_THEME: terminated successfully.
[cont-env ] GTK_THEME: loading...
[cont-env ] HOME: loading...
[cont-env ] QT_STYLE_OVERRIDE: executing...
[cont-env ] QT_STYLE_OVERRIDE: terminated successfully.
[cont-env ] QT_STYLE_OVERRIDE: loading...
[cont-env ] TAKE_CONFIG_OWNERSHIP: loading...
[cont-env ] XDG_CACHE_HOME: loading...
[cont-env ] XDG_CONFIG_HOME: loading...
[cont-env ] XDG_DATA_HOME: loading...
[cont-env ] XDG_RUNTIME_DIR: loading...
[cont-env ] XDG_STATE_HOME: loading...
[cont-env ] container environment variables initialized.
[cont-secrets] loading container secrets...
[cont-secrets] container secrets loaded.
[cont-init ] executing container initialization scripts...
[cont-init ] 10-certs.sh: executing...
[cont-init ] 10-certs.sh: terminated successfully.
[cont-init ] 10-check-app-niceness.sh: executing...
[cont-init ] 10-check-app-niceness.sh: terminated successfully.
[cont-init ] 10-cjk-font.sh: executing...
[cont-init ] 10-cjk-font.sh: terminated successfully.
[cont-init ] 10-clean-logmonitor-states.sh: executing...
[cont-init ] 10-clean-logmonitor-states.sh: terminated successfully.
[cont-init ] 10-clean-tmp-dir.sh: executing...
[cont-init ] 10-clean-tmp-dir.sh: terminated successfully.
[cont-init ] 10-init-users.sh: executing...
[cont-init ] 10-init-users.sh: ERROR: SUP_GROUP_IDS contains invalid groupd ID '""'.
[cont-init ] 10-init-users.sh: terminated with error 1.
`
my first log dump is when I set SUP_GROUP_IDS
to no-value which is how it is set up in firefox (Which works fine)
Could you provide the output of docker inspect <container name>
in this situation ? That would be useful for me.
I deleted "" to match with how I have your firefox container set up
Do you mean that you only removed the value, or the environment variable itself ?
[~] # docker inspect video-duplicate-finder-1
[
{
"Id": "469658d77d7f98066c76bed13f2b1df988c9010df7318a21da57c468575b1e02" ,
"Created": "2023-02-05T14:37:16.265218309Z",
"Path": "/init",
"Args": [],
"State": {
"Status": "exited",
"Running": false,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 0,
"ExitCode": 1,
"Error": "",
"StartedAt": "2023-02-05T14:37:21.010566968Z",
"FinishedAt": "2023-02-05T14:37:23.390423167Z"
},
"Image": "sha256:e224938442e8147e2ead90c5319c7457bd66c8cd33535912b0f2932 81788f801",
"ResolvConfPath": "/share/CACHEDEV1_DATA/Container/container-station-dat a/lib/docker/containers/469658d77d7f98066c76bed13f2b1df988c9010df7318a21da57c468 575b1e02/resolv.conf",
"HostnamePath": "/share/CACHEDEV1_DATA/Container/container-station-data/ lib/docker/containers/469658d77d7f98066c76bed13f2b1df988c9010df7318a21da57c46857 5b1e02/hostname",
"HostsPath": "/share/CACHEDEV1_DATA/Container/container-station-data/lib /docker/containers/469658d77d7f98066c76bed13f2b1df988c9010df7318a21da57c468575b1 e02/hosts",
"LogPath": "/share/CACHEDEV1_DATA/Container/container-station-data/lib/d ocker/containers/469658d77d7f98066c76bed13f2b1df988c9010df7318a21da57c468575b1e0 2/469658d77d7f98066c76bed13f2b1df988c9010df7318a21da57c468575b1e02-json.log",
"Name": "/video-duplicate-finder-1",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"vdf_config:/config",
"/share/CACHEDEV1_DATA/.qpkg/NVIDIA_GPU_DRV/usr:/usr/local/nvidi a",
"/share/Media:/media",
"/share/MediaVJBOD:/mediavjbod",
"vdf_storage:/storage"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-file": "10",
"max-size": "10m"
}
},
"NetworkMode": "bridge",
"PortBindings": {
"5800/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "32765"
}
]
},
"RestartPolicy": {
"Name": "",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": [],
"CapAdd": [
"AUDIT_WRITE",
"CHOWN",
"DAC_OVERRIDE",
"FOWNER",
"FSETID",
"KILL",
"MKNOD",
"NET_BIND_SERVICE",
"NET_RAW",
"SETFCAP",
"SETGID",
"SETPCAP",
"SETUID",
"SYS_CHROOT"
],
"CapDrop": [
"AUDIT_CONTROL",
"BLOCK_SUSPEND",
"DAC_READ_SEARCH",
"IPC_LOCK",
"IPC_OWNER",
"LEASE",
"LINUX_IMMUTABLE",
"MAC_ADMIN",
"MAC_OVERRIDE",
"NET_ADMIN",
"NET_BROADCAST",
"SYSLOG",
"SYS_ADMIN",
"SYS_BOOT",
"SYS_MODULE",
"SYS_NICE",
"SYS_PACCT",
"SYS_PTRACE",
"SYS_RAWIO",
"SYS_RESOURCE",
"SYS_TIME",
"SYS_TTY_CONFIG",
"WAKE_ALARM"
],
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": null,
"DnsSearch": null,
"ExtraHosts": [],
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": false,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": null,
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 0,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": null,
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 100000,
"CpuQuota": -1,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [
{
"PathOnHost": "/dev/nvidia0",
"PathInContainer": "/dev/nvidia0",
"CgroupPermissions": "rwm"
},
{
"PathOnHost": "/dev/nvidiactl",
"PathInContainer": "/dev/nvidiactl",
"CgroupPermissions": "rwm"
},
{
"PathOnHost": "/dev/nvidia-uvm",
"PathInContainer": "/dev/nvidia-uvm",
"CgroupPermissions": "rwm"
}
],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 0,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [
{
"Name": "nofile",
"Hard": 65535,
"Soft": 65535
}
],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": [
"/proc/asound",
"/proc/acpi",
"/proc/kcore",
"/proc/keys",
"/proc/latency_stats",
"/proc/timer_list",
"/proc/timer_stats",
"/proc/sched_debug",
"/proc/scsi",
"/sys/firmware"
],
"ReadonlyPaths": [
"/proc/bus",
"/proc/fs",
"/proc/irq",
"/proc/sys",
"/proc/sysrq-trigger"
]
},
"GraphDriver": {
"Data": {
"LowerDir": "/share/CACHEDEV1_DATA/Container/container-station-d ata/lib/docker/overlay2/8b706638ebb7adb8cd6692cb2a7ff2f5d6e2afa594ea11e42a13376c 63984186-init/diff:/share/CACHEDEV1_DATA/Container/container-station-data/lib/do cker/overlay2/4e43dad319c2fd2b48ccf0b6a03de1032f1f2d71d6fa13c37337cce9f0110e35/d iff:/share/CACHEDEV1_DATA/Container/container-station-data/lib/docker/overlay2/e 037e34ffdb2ef2f04161dacdfecc908fe0050349847196352e8b9288ea355d8/diff:/share/CACH EDEV1_DATA/Container/container-station-data/lib/docker/overlay2/616605328fcdf543 5573fcd2da0f0b3dfe195fa47d82134fd8f5dfeb7e2b5876/diff:/share/CACHEDEV1_DATA/Cont ainer/container-station-data/lib/docker/overlay2/e3f26962391cfed95547b9268780419 d7dc91ae2d06f938b5d6edd7092d42c90/diff:/share/CACHEDEV1_DATA/Container/container -station-data/lib/docker/overlay2/d62de51146070a8357be2acf27ddcb576de466acbd9a2d 3656855831fc9fc3ce/diff:/share/CACHEDEV1_DATA/Container/container-station-data/l ib/docker/overlay2/0dcbfed8024d062258595f67093897f6a91e9dfa3067fb07f0202d78e63cf 6c2/diff:/share/CACHEDEV1_DATA/Container/container-station-data/lib/docker/overl ay2/8fba3bd4e2ca2f196e2cd34d95c0a47d1a039f7911beda300612b3347a7f27e4/diff:/share /CACHEDEV1_DATA/Container/container-station-data/lib/docker/overlay2/f5d616f5c74 a71ff5461e7d8a9f3b017d7cbd05ed5a4436c839d50589bb96e57/diff:/share/CACHEDEV1_DATA /Container/container-station-data/lib/docker/overlay2/15b8b33a2a2347a4ece840cd3f bdaf47e3cab5051b857fc5236ef65f64d20666/diff:/share/CACHEDEV1_DATA/Container/cont ainer-station-data/lib/docker/overlay2/8fd18bcdaab220288b09f44ae8bdcd9cbad2bccf1 3ae18194c07774cf13e4128/diff:/share/CACHEDEV1_DATA/Container/container-station-d ata/lib/docker/overlay2/c0826cfd2d951aee77b0b61df80528132a11f426f424180758b2ba22 49d6893c/diff:/share/CACHEDEV1_DATA/Container/container-station-data/lib/docker/ overlay2/b3d37e7bef409be63c36a86370d61cbe681e29788db112b8d986c7dfde62424b/diff:/ share/CACHEDEV1_DATA/Container/container-station-data/lib/docker/overlay2/577064 cc8f1d981a98c13c3c6c184589bb62dbbdfc66480642cbacbc2f0a1214/diff:/share/CACHEDEV1 _DATA/Container/container-station-data/lib/docker/overlay2/e9f4840f37e52274fa185 334ebc18d82bcc7f2464baabe0652e145c2fcb3b4b2/diff:/share/CACHEDEV1_DATA/Container /container-station-data/lib/docker/overlay2/b0af45d9d438fbd32743667954e0aec8d5ba 467d97242a264be8293c1f44f57e/diff:/share/CACHEDEV1_DATA/Container/container-stat ion-data/lib/docker/overlay2/5f5227a14ecddb5834bbe13fd5fc36c85379705081673b25948 52b8f87caac35/diff:/share/CACHEDEV1_DATA/Container/container-station-data/lib/do cker/overlay2/04b7972e77371fa5b79bf740c20e0c5dfa3ce6dd4857e138cdaf67a3c1133aa1/d iff:/share/CACHEDEV1_DATA/Container/container-station-data/lib/docker/overlay2/8 d561049c2cb799e53eab661ec38700e9a70aa61dadbf558313c48b06e245229/diff:/share/CACH EDEV1_DATA/Container/container-station-data/lib/docker/overlay2/5951e5f5e74de814 19a20f3d4ff07c8fcf02a7dda5fbb6970051b9bb991d37a0/diff:/share/CACHEDEV1_DATA/Cont ainer/container-station-data/lib/docker/overlay2/2c6d8b03944bd25031968e30504a720 ab01c5c5c427a0a7bf1762598fd96445e/diff:/share/CACHEDEV1_DATA/Container/container -station-data/lib/docker/overlay2/1d3bc1207c45f41d2720a33569f4b71fe83068aa40b46a 39c5feffa99085eec8/diff:/share/CACHEDEV1_DATA/Container/container-station-data/l ib/docker/overlay2/b2e4ea0df862e938cd777a5f671cbd430d68da4288895cb60455296cae1a2 dcf/diff:/share/CACHEDEV1_DATA/Container/container-station-data/lib/docker/overl ay2/4c8df32a8ffd4e2c3af6f0f04f7fc601d08e5c1328fa5399af5fd8a6f7e5f895/diff:/share /CACHEDEV1_DATA/Container/container-station-data/lib/docker/overlay2/ce7e95f59c5 c575a305bcfdecf2ed4d33f7562b6f7db1e75b068ef4fdfb581f3/diff:/share/CACHEDEV1_DATA /Container/container-station-data/lib/docker/overlay2/e20d00fefd0f2f222fdc8fcf8a c6f1b2343b52216bc281ede8561c0352e64c67/diff:/share/CACHEDEV1_DATA/Container/cont ainer-station-data/lib/docker/overlay2/c7e28a8b3eb6f3e29bf9ff0277bfec89d6752faff f11080f95596836a4995561/diff:/share/CACHEDEV1_DATA/Container/container-station-d ata/lib/docker/overlay2/72473ee60dc74bfddaf0b01234c7f88030acaf5fbafd1e227661f0ed bf564e2e/diff:/share/CACHEDEV1_DATA/Container/container-station-data/lib/docker/ overlay2/5b0db0c3ee71088c76c96a7b94521384753a6c871641470d73360443eb6107cd/diff:/ share/CACHEDEV1_DATA/Container/container-station-data/lib/docker/overlay2/20f81e 5ac02e706cbca4dcd8dd88b44c12c5550df30718b580ac8b5fa8ee166b/diff:/share/CACHEDEV1 _DATA/Container/container-station-data/lib/docker/overlay2/9c7f39a5b40c0f8c91b7c bf5ee140e8ee1bfa4804adc735af0798301963af690/diff:/share/CACHEDEV1_DATA/Container /container-station-data/lib/docker/overlay2/c74452e42bba99c74c4572549c28b8b0cee9 4330d235e9a98ff46984c200b29a/diff:/share/CACHEDEV1_DATA/Container/container-stat ion-data/lib/docker/overlay2/65711a1e41d310db8c6e87db59ed14f0d489e3877bd7b968da3 0a2761bcb21cd/diff:/share/CACHEDEV1_DATA/Container/container-station-data/lib/do cker/overlay2/00f6007aa177b261d4fc8faef6271143fe38725bf834b49d8aa2868c54c59418/d iff:/share/CACHEDEV1_DATA/Container/container-station-data/lib/docker/overlay2/4 0bee2fbf6c62f79c11cad55dc787b624d1913d9a7aa07928c594441b7ab1c52/diff",
"MergedDir": "/share/CACHEDEV1_DATA/Container/container-station- data/lib/docker/overlay2/8b706638ebb7adb8cd6692cb2a7ff2f5d6e2afa594ea11e42a13376 c63984186/merged",
"UpperDir": "/share/CACHEDEV1_DATA/Container/container-station-d ata/lib/docker/overlay2/8b706638ebb7adb8cd6692cb2a7ff2f5d6e2afa594ea11e42a13376c 63984186/diff",
"WorkDir": "/share/CACHEDEV1_DATA/Container/container-station-da ta/lib/docker/overlay2/8b706638ebb7adb8cd6692cb2a7ff2f5d6e2afa594ea11e42a13376c6 3984186/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/share/Media",
"Destination": "/media",
"Mode": "",
"RW": true,
"Propagation": "rprivate"
},
{
"Type": "bind",
"Source": "/share/MediaVJBOD",
"Destination": "/mediavjbod",
"Mode": "",
"RW": true,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "vdf_storage",
"Source": "/share/CACHEDEV1_DATA/Container/container-station-dat a/lib/docker/volumes/vdf_storage/_data",
"Destination": "/storage",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "volume",
"Name": "vdf_config",
"Source": "/share/CACHEDEV1_DATA/Container/container-station-dat a/lib/docker/volumes/vdf_config/_data",
"Destination": "/config",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/share/CACHEDEV1_DATA/.qpkg/NVIDIA_GPU_DRV/usr",
"Destination": "/usr/local/nvidia",
"Mode": "",
"RW": true,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "03e20661e921",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"5800/tcp": {},
"5900/tcp": {}
},
"Tty": true,
"OpenStdin": true,
"StdinOnce": false,
"Env": [
"APP_NICENESS=0",
"CONTAINER_DEBUG=0",
"DARK_MODE=0",
"DISPLAY_HEIGHT=1080",
"DISPLAY_WIDTH=1920",
"ENABLE_CJK_FONT=0",
"ENV=/root/.docker_rc",
"KEEP_APP_RUNNING=0",
"LANG=en_US.UTF-8",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/b in:/opt/base/sbin:/opt/base/bin",
"SECURE_CONNECTION=0",
"SECURE_CONNECTION_CERTS_CHECK_INTERVAL=60",
"SECURE_CONNECTION_VNC_METHOD=SSL",
"SUP_GROUP_IDS=\"\"",
"TZ=Etc/UTC",
"UMASK=0022",
"WEB_LISTENING_PORT=5800",
"LD_LIBRARY_PATH=/usr/lib:/usr/local/nvidia/lib:/usr/local/nvidi a/lib64",
"LIBVA_DRIVERS_PATH=/usr/lib/x86_64-linux-gnu/dri",
"NVIDIA_DRIVER_CAPABILITIES=compute,video,utility",
"INSTALL_PACKAGES=",
"VNC_LISTENING_PORT=5900",
"VNC_PASSWORD=",
"USER_ID=1000",
"GROUP_ID=1000"
],
"Cmd": [
"/init"
],
"Image": "jlesage/video-duplicate-finder:latest",
"Volumes": {
"/config": {},
"/media": {},
"/mediavjbod": {},
"/storage": {},
"/usr/local/nvidia": {}
},
"WorkingDir": "/tmp",
"Entrypoint": null,
"OnBuild": null,
"Labels": {
"com.qnap.qcs.gpu": "True",
"com.qnap.qcs.network.mode": "nat",
"org.label-schema.description": "Docker container for Video Dupl icate Finder",
"org.label-schema.name": "video-duplicate-finder",
"org.label-schema.schema-version": "1.0",
"org.label-schema.vcs-url": "https://github.com/jlesage/docker-v ideo-duplicate-finder",
"org.label-schema.version": "23.02.1"
}
},
"NetworkSettings": {
"Bridge": "lxcbr0",
"SandboxID": "f8110032bb3b4afe707231ebdd2c2d4a86e1e6d3352ddb7c11cec6 7c8944a0db",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {},
"SandboxKey": "/var/run/docker/netns/f8110032bb3b",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"bridge": {
"IPAMConfig": {},
"Links": null,
"Aliases": null,
"NetworkID": "b27f83049eea5d786fcfcecf53cb8a8723e2695f7a6880 e99d517c6835960189",
"EndpointID": "",
"Gateway": "",
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "",
"DriverOpts": null
}
}
}
}
]
I deleted "" to match with how I have your firefox container set up
Do you mean that you only removed the value, or the environment variable itself ?
just removed the value
And this value was automatically set by the container station ?
And this value was automatically set by the container station ?
@jlesage Container Station wouldn't let me deploy with a 'null' value, portainer does though. the env config between this and firefox is identical where they have shared variables
Ok I see. But it didn't complain about INSTALL_PACKAGES
and VNC_PASSWORD
, which are also variables without value?
Ok I see. But it didn't complain about
INSTALL_PACKAGES
andVNC_PASSWORD
, which are also variables without value?
i deleted those
This is basically the same problem as Synology: they force environment variable to have a value. I don't know why it's like this, because it's perfectly legal to have a variable set to an empty value. In some cases, it can even be necessary!
i deleted those
This is the way to go. In fact people should keep only variables that are needed. If you don't change the default value of a variable, it means that you can remove it.
@jlesage configuring in portainer is my new default. unfortunately I'm still using qnap's container station to deploy GPU resources until portainer fixes their bug for deploying a gpu resource. but in this case, container station or portainer (just a docker cli gui) deployment yields the same result.
container station or portainer (just a docker cli gui) deployment yields the same result.
The difference is that portainer let you have a variables with an empty value, but not container station. So I guess a first deployment with portainer have better chance to succeed (if you don't remove variables)?
@jlesage correct, the first log dump at the very top is my deployment on portainer without those variables in play. No clue where the error is that is shutting it down
Ah sorry, I thought the whole issue was about the SUP_GROUP_IDS
variable. Sorry, didn't realized that in your first log dump the application was crashing.
Can you try to disable the GPU ressource ? I see that this sets the LD_LIBRARY_PATH
, which might cause issue if some directories are missing (it's value seems truncated in the output you provided).
okay, I deleted the LD_LIBRARY_PATH
variable and it booted just fine, will test and see if I'm able to use hw acceleration with cuda
I can tell it will probably won't work, since Nvidia doesn't support Alpine Linux and their libraries are not open source.
okay, this resolved my issue. if there's a way to support hw accel in the future with gpu options that would be desired as through duplicate finding on large libraries is a sapper on resources
Yes, I'm always keeping an eye on this, since other containers I created would also benefit from GPU acceleration.
Unable to start. It was hanging on the
SUP_GROUP_IDS
with just""
and I deleted""
to match with how I have your firefox container set up. Not sure what's tripping it up now though.