ualex73 / monitor_docker

Monitor Docker containers from Home Assistant
Apache License 2.0
267 stars 34 forks source link

"Cannot determine network-available?" (portainer_agent) #92

Closed boehser-enkel closed 1 month ago

boehser-enkel commented 2 years ago

Hi there,

getting this error for the portainer agent (https://docs.portainer.io/v/ce-2.9/start/install/agent/docker/linux) The network is set to bridged

greetz

ualex73 commented 2 years ago

Can you share a bit more debug logging? Also what does the output of " docker inspect " name say?

boehser-enkel commented 2 years ago

Docker inspect: [ { "Id": "9b9bae98c8e3d7f13e0dea868c650705f8e29eb707095300bf4abeb20816561e", "Created": "2022-01-12T09:18:13.906875603Z", "Path": "./agent", "Args": [], "State": { "Status": "running", "Running": true, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 1764, "ExitCode": 0, "Error": "", "StartedAt": "2022-01-14T06:32:26.524739448Z", "FinishedAt": "2022-01-14T06:31:07.446588683Z" }, "Image": "sha256:76d4e53fa5833f0b07db15617ec7ca1f4bc9849d04bc2733627c3bd9bb5a7658", "ResolvConfPath": "/var/lib/docker/containers/9b9bae98c8e3d7f13e0dea868c650705f8e29eb707095300bf4abeb20816561e/resolv.conf", "HostnamePath": "/var/lib/docker/containers/9b9bae98c8e3d7f13e0dea868c650705f8e29eb707095300bf4abeb20816561e/hostname", "HostsPath": "/var/lib/docker/containers/9b9bae98c8e3d7f13e0dea868c650705f8e29eb707095300bf4abeb20816561e/hosts", "LogPath": "/var/lib/docker/containers/9b9bae98c8e3d7f13e0dea868c650705f8e29eb707095300bf4abeb20816561e/9b9bae98c8e3d7f13e0dea868c650705f8e29eb707095300bf4abeb20816561e-json.log", "Name": "/portainer_agent", "RestartCount": 0, "Driver": "overlay2", "Platform": "linux", "MountLabel": "", "ProcessLabel": "", "AppArmorProfile": "", "ExecIDs": null, "HostConfig": { "Binds": [ "/var/run/docker.sock:/var/run/docker.sock", "/var/lib/docker/volumes:/var/lib/docker/volumes" ], "ContainerIDFile": "", "LogConfig": { "Type": "json-file", "Config": {} }, "NetworkMode": "default", "PortBindings": { "9001/tcp": [ { "HostIp": "", "HostPort": "9001" } ] }, "RestartPolicy": { "Name": "always", "MaximumRetryCount": 0 }, "AutoRemove": false, "VolumeDriver": "", "VolumesFrom": null, "CapAdd": null, "CapDrop": null, "CgroupnsMode": "host", "Dns": [], "DnsOptions": [], "DnsSearch": [], "ExtraHosts": null, "GroupAdd": null, "IpcMode": "private", "Cgroup": "", "Links": null, "OomScoreAdj": 0, "PidMode": "", "Privileged": false, "PublishAllPorts": false, "ReadonlyRootfs": false, "SecurityOpt": null, "UTSMode": "", "UsernsMode": "", "ShmSize": 67108864, "Runtime": "runc", "ConsoleSize": [ 0, 0 ], "Isolation": "", "CpuShares": 0, "Memory": 0, "NanoCpus": 0, "CgroupParent": "", "BlkioWeight": 0, "BlkioWeightDevice": [], "BlkioDeviceReadBps": null, "BlkioDeviceWriteBps": null, "BlkioDeviceReadIOps": null, "BlkioDeviceWriteIOps": null, "CpuPeriod": 0, "CpuQuota": 0, "CpuRealtimePeriod": 0, "CpuRealtimeRuntime": 0, "CpusetCpus": "", "CpusetMems": "", "Devices": [], "DeviceCgroupRules": null, "DeviceRequests": null, "KernelMemory": 0, "KernelMemoryTCP": 0, "MemoryReservation": 0, "MemorySwap": 0, "MemorySwappiness": null, "OomKillDisable": null, "PidsLimit": null, "Ulimits": null, "CpuCount": 0, "CpuPercent": 0, "IOMaximumIOps": 0, "IOMaximumBandwidth": 0, "MaskedPaths": [ "/proc/asound", "/proc/acpi", "/proc/kcore", "/proc/keys", "/proc/latency_stats", "/proc/timer_list", "/proc/timer_stats", "/proc/sched_debug", "/proc/scsi", "/sys/firmware" ], "ReadonlyPaths": [ "/proc/bus", "/proc/fs", "/proc/irq", "/proc/sys", "/proc/sysrq-trigger" ] }, "GraphDriver": { "Data": { "LowerDir": "/var/lib/docker/overlay2/1aa9e7a39ff8ae64a552ec464d7a3df40cd9dd917f3f9e04eb12f560b4959d5b-init/diff:/var/lib/docker/overlay2/8c619207eec4dcb3722fc5d3e9a6b5f8f631 4113b017fbad220b32ab398d22da/diff:/var/lib/docker/overlay2/f4990b572e3bd05b6e6719a258eb652e3fa4395511d3f3fe6774f7bc35a3a48d/diff:/var/lib/docker/overlay2/72e1582a706c57cb44b4bb002e239fe6f7e5 1bfc6990b810e4c1d466aa8ba60c/diff:/var/lib/docker/overlay2/a6951c5fbb021004f4e2ac4cb76ad41a5793b6927ce1cd81c25600082c328fd7/diff:/var/lib/docker/overlay2/77f0edca0a26c414885e0cbdfefd5eb2b48b 2fd5865139060dedbab4c160067e/diff", "MergedDir": "/var/lib/docker/overlay2/1aa9e7a39ff8ae64a552ec464d7a3df40cd9dd917f3f9e04eb12f560b4959d5b/merged", "UpperDir": "/var/lib/docker/overlay2/1aa9e7a39ff8ae64a552ec464d7a3df40cd9dd917f3f9e04eb12f560b4959d5b/diff", "WorkDir": "/var/lib/docker/overlay2/1aa9e7a39ff8ae64a552ec464d7a3df40cd9dd917f3f9e04eb12f560b4959d5b/work" }, "Name": "overlay2" }, "Mounts": [ { "Type": "bind", "Source": "/var/lib/docker/volumes", "Destination": "/var/lib/docker/volumes", "Mode": "", "RW": true, "Propagation": "rslave" }, { "Type": "bind", "Source": "/var/run/docker.sock", "Destination": "/var/run/docker.sock", "Mode": "", "RW": true, "Propagation": "rprivate" } ], "Config": { "Hostname": "9b9bae98c8e3", "Domainname": "", "User": "", "AttachStdin": false, "AttachStdout": false, "AttachStderr": false, "ExposedPorts": { "9001/tcp": {} }, "Tty": false, "OpenStdin": false, "StdinOnce": false, "Env": [ "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin" ], "Cmd": null, "Image": "cr.portainer.io/portainer/agent:2.9.3", "Volumes": null, "WorkingDir": "/app", "Entrypoint": [ "./agent" ], "OnBuild": null, "Labels": {} }, "NetworkSettings": { "Bridge": "", "SandboxID": "f06938bb8479a540132a8c785ea1034a038d835412eda1709e64d29f20ee7877", "HairpinMode": false, "LinkLocalIPv6Address": "", "LinkLocalIPv6PrefixLen": 0, "Ports": { "9001/tcp": [ { "HostIp": "0.0.0.0", "HostPort": "9001" }, { "HostIp": "::", "HostPort": "9001" } ] }, "SandboxKey": "/var/run/docker/netns/f06938bb8479", "SecondaryIPAddresses": null, "SecondaryIPv6Addresses": null, "EndpointID": "c9c7df0da1b4dc4b163c3be6290e2e0db3cbe6502eebc2ec70ea6ecb97c0eaeb", "Gateway": "172.17.0.1", "GlobalIPv6Address": "", "GlobalIPv6PrefixLen": 0, "IPAddress": "172.17.0.2", "IPPrefixLen": 16, "IPv6Gateway": "", "MacAddress": "02:42:ac:11:00:02", "Networks": { "bridge": { "IPAMConfig": null, "Links": null, "Aliases": null, "NetworkID": "64e5969cbf3d38c738c2769a4a5b6123457032749550dc5de55962e84c77640e", "EndpointID": "c9c7df0da1b4dc4b163c3be6290e2e0db3cbe6502eebc2ec70ea6ecb97c0eaeb", "Gateway": "172.17.0.1", "IPAddress": "172.17.0.2", "IPPrefixLen": 16, "IPv6Gateway": "", "GlobalIPv6Address": "", "GlobalIPv6PrefixLen": 0, "MacAddress": "02:42:ac:11:00:02", "DriverOpts": null } } } } ]

This is the only message in the log. Do i have to activate debug logging?

boehser-enkel commented 2 years ago

I am also getting this right now for more container. These are on another pi. I just recently installed docker and dockerproxy there.

boehser-enkel commented 2 years ago

Debug Log: Seems normale and then it just says removing sensor and no container set up?

2022-01-28 09:27:17 DEBUG (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] glances: Received callback for: Memory (percent) 2022-01-28 09:27:17 DEBUG (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] glances: Received callback for: 1CPU 2022-01-28 09:27:17 DEBUG (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] tvheadend: Received callback for: Memory (percent) 2022-01-28 09:27:17 DEBUG (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] tvheadend: Received callback for: 1CPU 2022-01-28 09:27:19 DEBUG (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] cloudflare-ddns: Received callback for: Memory (percent) 2022-01-28 09:27:19 DEBUG (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] cloudflare-ddns: Received callback for: 1CPU 2022-01-28 09:27:19 DEBUG (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] portainer_agent: Received callback for: Memory (percent) 2022-01-28 09:27:19 DEBUG (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] portainer_agent: Received callback for: 1CPU 2022-01-28 09:27:27 DEBUG (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] Dockerproxy: Received callback for: Memory (percent) 2022-01-28 09:27:27 DEBUG (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] Dockerproxy: Received callback for: 1CPU 2022-01-28 09:27:28 DEBUG (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] homebridge: Received callback for: Memory (percent) 2022-01-28 09:27:28 DEBUG (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] homebridge: Received callback for: 1CPU 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] Dockerproxy: Removing sensor entity: memory_percentage 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] Dockerproxy: Removing sensor entity: 1cpu_percentage 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.switch] [Docker1] Dockerproxy: Removing switch entity 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] glances: Removing sensor entity: memory_percentage 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] glances: Removing sensor entity: 1cpu_percentage 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.switch] [Docker1] glances: Removing switch entity 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] homebridge: Removing sensor entity: memory_percentage 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] homebridge: Removing sensor entity: 1cpu_percentage 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.switch] [Docker1] homebridge: Removing switch entity 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] tvheadend: Removing sensor entity: memory_percentage 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] tvheadend: Removing sensor entity: 1cpu_percentage 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.switch] [Docker1] tvheadend: Removing switch entity 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] cloudflare-ddns: Removing sensor entity: memory_percentage 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] cloudflare-ddns: Removing sensor entity: 1cpu_percentage 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.switch] [Docker1] cloudflare-ddns: Removing switch entity 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] portainer_agent: Removing sensor entity: memory_percentage 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.sensor] [Docker1] portainer_agent: Removing sensor entity: 1cpu_percentage 2022-01-28 09:27:28 INFO (Thread-3) [custom_components.monitor_docker.switch] [Docker1] portainer_agent: Removing switch entity 2022-01-28 09:27:34 DEBUG (MainThread) [custom_components.monitor_docker.sensor] [Docker1]: Setting up sensor(s) 2022-01-28 09:27:34 DEBUG (MainThread) [custom_components.monitor_docker.switch] [Docker1]: Setting up switch(es) 2022-01-28 09:27:34 INFO (MainThread) [custom_components.monitor_docker.switch] [Docker1]: No containers set-up

ualex73 commented 2 years ago

Can anybody show me the output of the following command: curl --unix-socket /var/run/docker.sock http://localhost/containers/<containername>/json | jq ' .HostConfig.NetworkMode'

Please replace "" with your container name.

boehser-enkel commented 2 years ago

Here is the output for portainer_agent. But this error appears for all container on this (remote) machine on the same time and sporadically. So i don't think thats it's a problem with a container. Rather with the machine and or communication?

% Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 5464 0 5464 0 0 2667k 0 --:--:-- --:--:-- --:--:-- 2667k "default"

boehser-enkel commented 2 years ago

Any update on this? Same error even with the newest version (of everything)

ualex73 commented 1 month ago

This issue still persists?

ualex73 commented 1 month ago

I will close this one, if it happens again, please raise a new issue.