Open mbseid opened 1 year ago
Hi @mbseid, Could you send some logs?
Please ssh into the manager (newman
) and send the output of these commands:
docker service ps homelab_cadvisor
docker exec -it homelab_cadvisor<tab> sh
curl -sS http://localhost:8080/metrics | grep memory_
The above log will contain your services' name & image. If you don't want to send those, use these commands instead:
docker service ps homelab_cadvisor
ID
of the current task running in the newman
server.docker exec -it homelab_cadvisor<tab> sh
curl -sS http://localhost:8080/metrics | grep -E 'memory_.*<the_copied_id>'
In my case I use PATH_PREFIX=/swarm-visualizer and I get
curl -v https://trajano.net/swarm-visualizer/metrics
as a 404
@trajano
Swarm Dashboard does not export any mertics.
I meant cadvisor
's metrics in my comment (localhost after exec
ing into cadvisor
container).
cadvisor doesn't have an ARM build at least not the latest tag https://github.com/hetznercloud/apps/issues/98
@trajano Swarm Dashboard does not export any mertics. I meant
cadvisor
's metrics in my comment (localhost afterexec
ing intocadvisor
container).
So are you saying cadvisor has to be exposed to the Internet? Oh wait no it doesn't but there's no curl
inside cadvisor
So are you saying cadvisor has to be exposed to the Internet?
No! Swarm Dashboard reads conatiners' metrics from /metrics exposed locally by cadvisor.
there's no
curl
inside cadvisor
Some images have curl installed (mine does). If it's not, we can install it with apk
or apt
for example.
Anyway, mbseid encuntered some issue with memory usage report, and that's why I asked if he could send some logs to better investigate the issue.
@mohsenasm Thanks for the fast response. I'm new to docker swarm, so I couldn't figure out how what the right ID from the docker service ps command. I SSHed into the the machine and got this from the response. Sorry for the SUPER long logs, it's unfiltered grep on cadvisor.
/ # wget -q -S -O - http://localhost:8080/metrics | grep -E 'cadvisor'
HTTP/1.1 200 OK
Content-Type: text/plain; version=0.0.4; charset=utf-8
Date: Mon, 30 Oct 2023 01:45:09 GMT
Connection: close
Transfer-Encoding: chunked
# HELP cadvisor_version_info A metric with a constant '1' value labeled by kernel version, OS version, docker version, cadvisor version & cadvisor revision.
# TYPE cadvisor_version_info gauge
cadvisor_version_info{cadvisorRevision="30515557",cadvisorVersion="v0.38.6",dockerVersion="24.0.6",kernelVersion="5.15.0-87-generic",osVersion="Alpine Linux v3.12"} 1
container_cpu_load_average_10s{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_cpu_system_seconds_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 7186.052781 1698630308622
container_cpu_usage_seconds_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",cpu="total",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 21686.785235 1698630308622
container_cpu_user_seconds_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 14500.732454 1698630308622
container_fs_inodes_free{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_inodes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 11 1698630308622
container_fs_io_current{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_io_time_seconds_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_io_time_weighted_seconds_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_limit_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 6.520010752e+10 1698630308622
container_fs_read_seconds_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_reads_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/dm-0",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_reads_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/sda",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_reads_merged_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_reads_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_sector_reads_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_sector_writes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_usage_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 2.99008e+06 1698630308622
container_fs_write_seconds_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_writes_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/dm-0",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_writes_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/sda",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_writes_merged_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_writes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_last_seen{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 1.698630309e+09 1698630309443
container_memory_cache{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_memory_failcnt{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_memory_failures_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",failure_type="pgfault",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",scope="container"} 9.425465e+06 1698630308622
container_memory_failures_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",failure_type="pgfault",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",scope="hierarchy"} 9.425465e+06 1698630308622
container_memory_failures_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",failure_type="pgmajfault",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",scope="container"} 220 1698630308622
container_memory_failures_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",failure_type="pgmajfault",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",scope="hierarchy"} 220 1698630308622
container_memory_mapped_file{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_memory_max_usage_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_memory_rss{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_memory_swap{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_memory_usage_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 9.9475456e+07 1698630308622
container_memory_working_set_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 1.8644992e+07 1698630308622
container_network_receive_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 2.658521764e+09 1698630308622
container_network_receive_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 7894 1698630308622
container_network_receive_errors_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_receive_errors_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_receive_packets_dropped_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_receive_packets_dropped_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_receive_packets_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 4.0200904e+07 1698630308622
container_network_receive_packets_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 115 1698630308622
container_network_transmit_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 1.93616254677e+11 1698630308622
container_network_transmit_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_transmit_errors_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_transmit_errors_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_transmit_packets_dropped_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_transmit_packets_dropped_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_transmit_packets_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 4.2738414e+07 1698630308622
container_network_transmit_packets_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_spec_cpu_period{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0
container_spec_cpu_shares{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0
container_spec_memory_limit_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 1.0423386112e+10
container_spec_memory_reservation_limit_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0
container_spec_memory_swap_limit_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0
container_start_time_seconds{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 1.698294452e+09
container_tasks_state{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",state="iowaiting"} 0 1698630308622
container_tasks_state{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",state="running"} 0 1698630308622
container_tasks_state{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",state="sleeping"} 0 1698630308622
container_tasks_state{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",state="stopped"} 0 1698630308622
container_tasks_state{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",state="uninterruptible"} 0 1698630308622
Thanks @mbseid.
The problem is the container_memory_rss
metric, which is reported as 0
incorrectly (you can see the end of the line).
Please use the newest version of cadvisor in your compose.yml
file. According to this issue, the latest
tag is not the newest version! So, specify the version like this:
image: gcr.io/cadvisor/cadvisor:v0.47.2
If updating the image tag didn't solve the issue, please send some info about your environment:
docker version
command)Hi @mbseid,
for Version v0.47.2 as well as for the newest v0.49.1 exists architecture specific images.
Have a look: https://github.com/google/cadvisor/releases/tag/v0.47.2 or https://github.com/google/cadvisor/releases/tag/v0.49.1
Sorry, commented on the wrong issue, but maybe it helps you?
First, great project. Thank you!
I set up the dashboard on a new swarm cluster and it's not showing the memory usage. CPU usage is being captured. Picture attached:
I checked the websocket information and it's sending 0 on the wire. It may not be collecting it properly.
Additional context:
There is a two node cluster. It's running a few levels of virtualization (which shouldn't be the cause). Proxmox => Ubuntu => Docker Swarm
Thanks for the help!