google / cadvisor

Analyzes resource usage and performance characteristics of running containers.
Other
16.6k stars 2.29k forks source link

Without container info after host reboot. #3531

Open hidakafinzelz opened 1 month ago

hidakafinzelz commented 1 month ago

My host was reboot for somereson, and then cadvisor container restart. But when I get the metrics from api. it get lots of value without container info like tag name

docker info

Client: Debug Mode: false Server: Containers: 30 Running: 30 Paused: 0 Stopped: 0 Images: 71 Server Version: 19.03.15 Storage Driver: overlay2 Backing Filesystem: f2fs Supports d_type: true Native Overlay Diff: true Logging Driver: json-file Cgroup Driver: cgroupfs Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog Swarm: inactive Runtimes: runc Default Runtime: runc Init Binary: docker-init containerd version: 269548fa27e0089a8b8278fc4fc781d7f65a939b runc version: ff819c7e9184c13b7c2607fe6c30ae19403a7aff init version: fec3683 Security Options: seccomp Profile: default Kernel Version: 4.4.194-g58370c8ad45d Operating System: Ubuntu 20.04.1 LTS OSType: linux Architecture: aarch64 CPUs: 6 Total Memory: 3.756GiB ID: ZHZJ:IVGI:45GF:QJJN:C3D3:FHWZ:O6LO:J7V7:VN5X:PMSY:ZXIP:SIKP Docker Root Dir: /home/mydocker/docker Debug Mode: false Registry: https://index.docker.io/v1/ Labels: Experimental: false Insecure Registries: 127.0.0.0/8 Live Restore Enabled: false

`

cadvisor image `

version: "3" services: cadvisor: image: {{ .Values.image }} container_name: {{ .Values.name }} ports:

  • 18081:8080 privileged: true restart: always volumes:
  • /:/rootfs:ro
  • /var/run:/var/run:rw
  • /sys:/sys:ro
  • /var/lib/docker/:/var/lib/docker:ro

zcube/cadvisor:v0.39.3 `

host uname -a Linux 4.4.194-g58370c8ad45d #81 SMP Sat May 6 16:21:52 CST 2023 aarch64 aarch64 aarch64 GNU/Linux

metircs ` container_fs_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/sys/fs/cgroup",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-40",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-41",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-42",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-43",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-44",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-45",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-46",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-47",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-48",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-49",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-50",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-51",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-52",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-53",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-54",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-55",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-56",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-57",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-58",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-59",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-60",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-61",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-62",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-63",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-64",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-65",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-66",id="/"} 0 1716432781348 container_fs_reads_total{device="overlay_0-67",id="/"} 0 1716432781348

HELP container_fs_sector_reads_total Cumulative count of sector reads completed

TYPE container_fs_sector_reads_total counter

container_fs_sector_reads_total{device="/dev",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/dev/sda1",id="/"} 963712 1716432781348 container_fs_sector_reads_total{device="/dev/shm",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/rootfs/dev/shm",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev/shm",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/sys/fs/cgroup",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/rootfs/run",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/rootfs/run/lock",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/rootfs/run/user/1000",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/rootfs/run/user/112",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/rootfs/sys/fs/cgroup",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/rootfs/tmp",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/run",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/run/lock",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/run/user/1000",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/run/user/112",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/sys/fs/cgroup",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev/shm",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/dev/shm",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev/shm",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/sys/fs/cgroup",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/run",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/run/lock",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/run/user/1000",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/run/user/112",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/sys/fs/cgroup",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/rootfs/tmp",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/run",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/run/lock",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/run/user/1000",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/run/user/112",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="/var/lib/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/sys/fs/cgroup",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-40",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-41",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-42",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-43",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-44",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-45",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-46",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-47",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-48",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-49",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-50",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-51",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-52",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-53",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-54",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-55",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-56",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-57",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-58",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-59",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-60",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-61",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-62",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-63",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-64",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-65",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-66",id="/"} 0 1716432781348 container_fs_sector_reads_total{device="overlay_0-67",id="/"} 0 1716432781348

HELP container_fs_sector_writes_total Cumulative count of sector writes completed

TYPE container_fs_sector_writes_total counter

container_fs_sector_writes_total{device="/dev",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/dev/sda1",id="/"} 570376 1716432781348 container_fs_sector_writes_total{device="/dev/shm",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/rootfs/dev/shm",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/dev/shm",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/rootfs/home/mydocker/docker/overlay2/c31ba17b013f7947795d82964b7062a154d3506ab5c760815077605b38a732bf/merged/sys/fs/cgroup",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/rootfs/run",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/rootfs/run/lock",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/rootfs/run/user/1000",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/rootfs/run/user/112",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/rootfs/sys/fs/cgroup",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/rootfs/tmp",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/run",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/run/lock",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/run/user/1000",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/run/user/112",id="/"} 0 1716432781348 container_fs_sector_writes_total{device="/sys/fs/cgroup",id="/"} 0 1716432781348 ` image