Open viveklanjekar opened 6 years ago
For the record: some problem zbx_docker_dir_detect():
7:20171214:074845.478 In zbx_docker_dir_detect()
7:20171214:074845.479 Cannot detect used docker driver
any suggestions, what Iam doing wrong? how would I make it work?
is this something related to permissions?
No, the problem is in the source code.
ok thanks
Could you provide outputs of these commands, please?
docker run --rm \
--net=host \
--privileged \
-v /:/rootfs \
-v /var/run:/var/run \
-ti ubuntu:16.04 \
bash -c "cat /proc/mounts | grep 'cpuset cgroup'"
docker run --rm \
--net=host \
--privileged \
-v /:/rootfs \
-v /var/run:/var/run \
-ti ubuntu:16.04 \
bash -c "cat /proc/mounts | grep 'cpuset cgroup' | grep -E '^[^[:blank:]]+[[:blank:]]+(/[^[:blank:]]+/)[^[:blank:]]+[[:blank:]]+cgroup[[:blank:]]+.*$'"
sorry for late response
below is out of command
[root@jira02 ~]# docker run --rm --net=host --privileged -v /:/rootfs -v /var/run:/var/run -ti ubuntu:16.04 bash -c "cat /proc/mounts | grep 'cpuset cgroup'"`
cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0
cgroup /rootfs/var/lib/docker/overlay2/aab5e773827dd2b811ef4da5c797e3218f8bac0a5b95a633007af1631e9db81d/merged/sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0
cgroup /rootfs/cgroup/cpuset cgroup rw,relatime,cpuset 0 0
[root@jira02 ~]# docker run --rm --net=host --privileged -v /:/rootfs -v /var/run:/var/run -ti ubuntu:16.04 bash -c "cat /proc/mounts | grep 'cpuset cgroup' | grep -E '^[^[:blank:]]+[[:blank:]]+(/[^[:blank:]]+/)[^[:blank:]]+[[:blank:]]+cgroup[[:blank:]]+.*$'"
cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0
cgroup /rootfs/var/lib/docker/overlay2/c321de5e9c6d8d2e55477b1f7b4d720e6b1046fb5ea46ad289bc5f00f72cde2c/merged/sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0
cgroup /rootfs/cgroup/cpuset cgroup rw,relatime,cpuset 0 0
Any update on this? I got the same error.
Debug output (without --net=host)
root@host1:~# docker run --log-driver json-file --log-opt max-size=500k --name=dockbix-agent-xxl --privileged --restart=unless-stopped --userns=host --hostname=host1 -p 10050:10050 -v /:/rootfs -v /var/run:/var/run -v zabbix-data:/etc/zabbix/zabbix_agentd.d/ --env="ZABBIX_SERVER=10.206.3.98" --env="ZA_ServerActive=10.206.3.98" --env="ZA_Include=/etc/zabbix/zabbix_agentd.d/*.conf" --env="ZA_DebugLevel=5" -d monitoringartist/dockbix-agent-xxl:latest && docker logs -f dockbix-agent-xxl
10:20180125:143511.481 Starting Zabbix Agent [host1]. Zabbix 3.4.2 Dockbix Agent XXL (2017-10-03) (revision 72885).
10:20180125:143511.481 **** Enabled features ****
10:20180125:143511.481 IPv6 support: YES
10:20180125:143511.481 TLS support: YES
10:20180125:143511.481 **************************
10:20180125:143511.481 using configuration file: /etc/zabbix/zabbix_agentd.conf
10:20180125:143511.481 In zbx_load_modules()
10:20180125:143511.481 loading module "/var/lib/zabbix/modules/zabbix_module_docker.so"
10:20180125:143511.481 In zbx_module_api_version()
10:20180125:143511.481 In zbx_module_init()
10:20180125:143511.481 zabbix_module_docker v0.6.8, compilation time: Oct 3 2017 16:55:38
10:20180125:143511.481 In zbx_docker_dir_detect()
10:20180125:143511.482 Detected used docker driver dir: docker/
10:20180125:143511.482 Detected JoinController cpu,cpuacct
10:20180125:143511.482 In zbx_docker_api_detect()
10:20180125:143511.482 In zbx_module_docker_socket_query()
10:20180125:143511.482 Docker's socket query: GET /_ping HTTP/1.0
10:20180125:143511.482 Docker's socket response: OK
10:20180125:143511.482 Docker's socket works - extended docker metrics are available
10:20180125:143511.482 In zbx_module_item_list()
10:20180125:143511.482 In zbx_module_item_timeout()
10:20180125:143511.482 cannot find "zbx_module_history_write_cbs()" function in module "zabbix_module_docker.so": /var/lib/zabbix/modules/zabbix_module_docker.so: undefined symbol: zbx_module_history_write_cbs
10:20180125:143511.482 loading module "/var/lib/zabbix/modules/zabbix_module_stress.so"
10:20180125:143511.482 cannot find "zbx_module_history_write_cbs()" function in module "zabbix_module_stress.so": /var/lib/zabbix/modules/zabbix_module_stress.so: undefined symbol: zbx_module_history_write_cbs
10:20180125:143511.482 loading module "/var/lib/zabbix/modules/zabbix_module_systemd.so"
10:20180125:143511.483 [systemd] starting v3.4.2, compiled: Oct 3 2017 16:55:06
10:20180125:143511.483 [systemd] in cgroup_dir_detect()
10:20180125:143511.483 [systemd] detected cgroup mount directory: /rootfs/sys/fs/cgroup/
10:20180125:143511.483 [systemd] cpu_cgroup is JoinController cpu,cpuacct
10:20180125:143511.483 [systemd] set timeout to 3000ms
10:20180125:143511.483 cannot find "zbx_module_history_write_cbs()" function in module "zabbix_module_systemd.so": /var/lib/zabbix/modules/zabbix_module_systemd.so: undefined symbol: zbx_module_history_write_cbs
10:20180125:143511.483 loading module "/var/lib/zabbix/modules/zabbix_module_sockets.so"
10:20180125:143511.483 [sockets] starting v3.4.2
10:20180125:143511.483 [sockets] set timeout to 3000ms
10:20180125:143511.483 cannot find "zbx_module_history_write_cbs()" function in module "zabbix_module_sockets.so": /var/lib/zabbix/modules/zabbix_module_sockets.so: undefined symbol: zbx_module_history_write_cbs
10:20180125:143511.483 loaded modules: zabbix_module_docker.so, zabbix_module_stress.so, zabbix_module_systemd.so, zabbix_module_sockets.so
Docker info:
root@host1:~# docker info
Containers: 3
Running: 2
Paused: 0
Stopped: 1
Images: 3
Server Version: 1.12.6
Storage Driver: aufs
Root Dir: /var/lib/docker/aufs
Backing Filesystem: extfs
Dirs: 52
Dirperm1 Supported: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
Volume: local
Network: null bridge host overlay
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Security Options: apparmor seccomp
Kernel Version: 4.4.0-75-generic
Operating System: Ubuntu 16.04.2 LTS
OSType: linux
Architecture: x86_64
CPUs: 4
Total Memory: 3.859 GiB
Name: host1
ID: OY4J:4NWQ:UF7A:5EWP:TGY7:6V3G:RHLC:LA3I:DDEP:3YSG:JNH6:YPPA
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Username: XXXXXXX
Registry: https://index.docker.io/v1/
WARNING: No swap limit support
Insecure Registries:
127.0.0.0/8
cat /proc/mounts
root@host1:~# docker run --rm --net=host --privileged -v /:/rootfs -v /var/run:/var/run -ti ubuntu:16.04 bash -c "cat /proc/mounts | grep 'cpuset cgroup'"
cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0
cgroup /rootfs/sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0
cgroup /rootfs/var/lib/docker/aufs/mnt/5cbb3edc744866e09739f94a39ca84919c415aa2dec4c1c435dadf99c1cb323e/sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0
cat /proc/mounts | grep
root@host1:~# docker run --rm --net=host --privileged -v /:/rootfs -v /var/run:/var/run -ti ubuntu:16.04 bash -c "cat /proc/mounts | grep 'cpuset cgroup' | grep -E '^[^[:blank:]]+[[:blank:]]+(/[^[:blank:]]+/)[^[:blank:]]+[[:blank:]]+cgroup[[:blank:]]+.*$'"
cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0
cgroup /rootfs/sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0
cgroup /rootfs/var/lib/docker/aufs/mnt/2f7d7ba5f2a372dd54631fccaff3f62621c2cbbad291acb3d356321fd8a0bd81/sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0
@eskogh for now iam using older version of agent, it works
@viveklanjekar do you wanna share what version you're using so can I verify that?
@eskogh use this version docker pull monitoringartist/dockbix-agent-xxl-limited:3.2-2
below are info from logs
the above logs are from debug level 5
also please find the logs From normal logging
docker info output
OS we are using is AWS linux
further debugging output
help would be appreciated