lisaac / luci-app-dockerman

Docker Manager interface for LuCI
GNU Affero General Public License v3.0
823 stars 233 forks source link

容器资源状态获取异常 `NaN undefined / NaN undefined (0%)` #175

Closed devioa closed 10 months ago

devioa commented 11 months ago

问题描述 image 和这个问题一样 #163 重启或者重刷固件都无用

版本信息:

lisaac commented 11 months ago

请提供下是什么镜像?

devioa commented 11 months ago

请提供下是什么镜像?

容器镜像吗?但我这不是只有一个容器或者某个镜像出了问题,而是所有容器点进去查看都无法获取资源状态

devioa commented 11 months ago

我自己翻了下也没看到任何可能和这个问题相关的日志,我也不好判断这个到底是什么原因了

devioa commented 11 months ago

因为docker和容器啥的都是运行正常的,就只是获取不到这个资源状态

devioa commented 11 months ago

系统日志里找了两段可能相关的日志,其它真找不出有啥相关了

Tue Oct 17 16:20:07 2023 daemon.err uhttpd[2163]: sh: /etc/init.d/dockerd: line 6: extra_command: not found
Tue Oct 17 16:20:07 2023 daemon.err uhttpd[2163]: sh: /etc/init.d/dockerd: line 7: extra_command: not found
Tue Oct 17 16:20:07 2023 daemon.err uhttpd[2163]: sh: /etc/init.d/dockerman: line 6: config_load: not found
Tue Oct 17 16:20:07 2023 daemon.err uhttpd[2163]: sh: /etc/init.d/dockerman: line 130: extra_command: not found
Tue Oct 17 16:20:07 2023 daemon.err uhttpd[2163]: sh: /etc/init.d/dockerman: line 131: extra_command: not found
Tue Oct 17 16:31:34 2023 daemon.err modprobe: failed to find a module named aufs
Tue Oct 17 16:31:34 2023 daemon.err dockerd[22024]: time="2023-10-17T08:31:34.748541841Z" level=error msg="post event" error="failed to connect: dial unix /var/run/docker/containerd/containerd.sock.ttrpc: connect: connection refused"
Tue Oct 17 16:31:44 2023 daemon.info modprobe: nf_conntrack is already loaded
Tue Oct 17 16:31:44 2023 daemon.err modprobe: failed to find a module named nf_conntrack_netlink
lisaac commented 11 months ago

运行一下,看看结果

docker top [container_id]
docker stats [container_id] --no-stream
devioa commented 11 months ago
root@OpenWRT:~# docker top smartdns
PID                 USER                VSZ                 STAT                COMMAND
30951               root                27092               S                   /usr/sbin/smartdns -f -x -p -
root@OpenWRT:~# docker stats smartdns --no-stream
CONTAINER ID   NAME       CPU %     MEM USAGE / LIMIT   MEM %     NET I/O   BLOCK I/O   PIDS
90fde66819c1   smartdns   0.00%     0B / 0B             0.00%     0B / 0B   0B / 0B     0

docker stats好像也是无法获取,这个可能是哪些原因?

lisaac commented 11 months ago

先使用这个脚本查一下内核模块 https://github.com/lisaac/luci-app-dockerman/issues/36#issuecomment-612375880

devioa commented 11 months ago

docker info信息如下:

root@OpenWRT:~# docker info
Client:
 Version:    24.0.5
 Context:    default
 Debug Mode: false

Server:
 Containers: 12
  Running: 12
  Paused: 0
  Stopped: 0
 Images: 12
 Server Version: 24.0.5
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version:
 runc version:
 init version: de40ad0
 Security Options:
  seccomp
   Profile: builtin
  cgroupns
 Kernel Version: 6.1.56
 Operating System: OpenWrt SNAPSHOT
 OSType: linux
 Architecture: x86_64
 CPUs: 4
 Total Memory: 3.849GiB
 Name: OpenWRT
 ID: 1bcdc349-5905-4211-977d-e0574f24767f
 Docker Root Dir: /opt/docker
 Debug Mode: false
 Username: devioa
 Experimental: false
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled: false

WARNING: No memory limit support
WARNING: No swap limit support
WARNING: No cpu cfs quota support
WARNING: No cpu cfs period support
WARNING: No cpu shares support
WARNING: No cpuset support
WARNING: No io.weight support
WARNING: No io.weight (per device) support
WARNING: No io.max (rbps) support
WARNING: No io.max (wbps) support
WARNING: No io.max (riops) support
WARNING: No io.max (wiops) support
WARNING: bridge-nf-call-iptables is disabled
WARNING: bridge-nf-call-ip6tables is disabled
devioa commented 11 months ago

先使用这个脚本查一下内核模块 #36 (comment)

好的我试试

devioa commented 11 months ago

好像找不到 kernel config

root@OpenWRT:~# ./check-config.sh
warning: /proc/config.gz does not exist, searching other paths for kernel config ...
error: cannot find kernel config
  try running this script again, specifying the kernel config:
    CONFIG=/path/to/kernel/.config ./check-config.sh or ./check-config.sh /path/to/kernel/.config
lisaac commented 11 months ago

docker info结果来看,环境应该是有点问题的 containerd versionrunc version 都没有显示,可能与此有关

至于kernel config,你使用的是哪个版本的 openwrt,编译时的.config是否还在?

lisaac commented 11 months ago

也可以尝试检查一下,系统是否有 containerd 和 runc

devioa commented 11 months ago

也可以尝试检查一下,系统是否有 containerd 和 runc

有的

root@OpenWRT:~# opkg list|grep containerd
containerd - 1.7.1-1
root@OpenWRT:~# opkg list|grep runc
runc - 1.1.8-1

docker info结果来看,环境应该是有点问题的 containerd versionrunc version 都没有显示,可能与此有关

我看我 WSL2 上 Ubuntu 的docker info打印出来也没有这两个的版本信息:

devioa@Devioa-Desktop:~$ docker info
Client:
 Version:    24.0.5
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.11.2
    Path:     /home/devioa/.docker/cli-plugins/docker-buildx

Server:
 Containers: 0
  Running: 0
  Paused: 0
  Stopped: 0
 Images: 27
 Server Version: 24.0.5
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 1
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version:
 runc version:
 init version:
 Security Options:
  seccomp
   Profile: builtin
 Kernel Version: 5.15.90.1-microsoft-standard-WSL2
 Operating System: Ubuntu 22.04.3 LTS
 OSType: linux
 Architecture: x86_64
 CPUs: 24
 Total Memory: 15.58GiB
 Name: Devioa-Desktop
 ID: a2e91ce2-9afd-4711-943b-29fc581d002f
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Username: devioa
 Experimental: false
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled: false

WARNING: No blkio throttle.read_bps_device support
WARNING: No blkio throttle.write_bps_device support
WARNING: No blkio throttle.read_iops_device support
WARNING: No blkio throttle.write_iops_device support

至于kernel config,你使用的是哪个版本的 openwrt,编译时的.config是否还在?

在的,7000+行不好直接贴上来,我传我 alist 上了,http://mosol.oicp.net:5244/d/Assets/.config

lisaac commented 11 months ago

在的,7000+行不好直接贴上来,我传我 alist 上了,http://mosol.oicp.net:5244/d/Assets/.config

下面是用 check config 结果:

Generally Necessary:
- cgroup hierarchy: cgroupv2
  Controllers:
  - cpu: available
  - cpuset: available
  - io: available
  - memory: available
  - pids: available
- apparmor: enabled, but apparmor_parser missing
    (use "apt-get install apparmor" to fix this)
- CONFIG_NAMESPACES: missing
- CONFIG_NET_NS: missing
- CONFIG_PID_NS: missing
- CONFIG_IPC_NS: missing
- CONFIG_UTS_NS: missing
- CONFIG_CGROUPS: missing
- CONFIG_CGROUP_CPUACCT: missing
- CONFIG_CGROUP_DEVICE: missing
- CONFIG_CGROUP_FREEZER: missing
- CONFIG_CGROUP_SCHED: missing
- CONFIG_CPUSETS: missing
- CONFIG_MEMCG: missing
- CONFIG_KEYS: missing
- CONFIG_VETH: missing
- CONFIG_BRIDGE: missing
- CONFIG_BRIDGE_NETFILTER: missing
- CONFIG_IP_NF_FILTER: missing
- CONFIG_IP_NF_TARGET_MASQUERADE: missing
- CONFIG_NETFILTER_XT_MATCH_ADDRTYPE: missing
- CONFIG_NETFILTER_XT_MATCH_CONNTRACK: missing
- CONFIG_NETFILTER_XT_MATCH_IPVS: missing
- CONFIG_NETFILTER_XT_MARK: missing
- CONFIG_IP_NF_NAT: missing
- CONFIG_NF_NAT: missing
- CONFIG_POSIX_MQUEUE: missing
- CONFIG_CGROUP_BPF: missing

Optional Features:
- CONFIG_USER_NS: missing
- CONFIG_SECCOMP: enabled
- CONFIG_SECCOMP_FILTER: missing
- CONFIG_CGROUP_PIDS: missing
- CONFIG_MEMCG_SWAP: missing
    (cgroup swap accounting is currently enabled)
- CONFIG_BLK_CGROUP: missing
- CONFIG_BLK_DEV_THROTTLING: missing
- CONFIG_CGROUP_PERF: missing
- CONFIG_CGROUP_HUGETLB: missing
- CONFIG_NET_CLS_CGROUP: missing
- CONFIG_CGROUP_NET_PRIO: missing
- CONFIG_CFS_BANDWIDTH: missing
- CONFIG_FAIR_GROUP_SCHED: missing
- CONFIG_IP_NF_TARGET_REDIRECT: missing
- CONFIG_IP_VS: missing
- CONFIG_IP_VS_NFCT: missing
- CONFIG_IP_VS_PROTO_TCP: missing
- CONFIG_IP_VS_PROTO_UDP: missing
- CONFIG_IP_VS_RR: missing
- CONFIG_SECURITY_SELINUX: missing
- CONFIG_SECURITY_APPARMOR: missing
- CONFIG_EXT3_FS: missing
- CONFIG_EXT3_FS_XATTR: missing
- CONFIG_EXT3_FS_POSIX_ACL: missing
- CONFIG_EXT3_FS_SECURITY: missing
    (enable these ext3 configs if you are using ext3 as backing filesystem)
- CONFIG_EXT4_FS: missing
- CONFIG_EXT4_FS_POSIX_ACL: missing
- CONFIG_EXT4_FS_SECURITY: missing
    enable these ext4 configs if you are using ext4 as backing filesystem
- Network Drivers:
  - "overlay":
    - CONFIG_VXLAN: missing
    - CONFIG_BRIDGE_VLAN_FILTERING: missing
      Optional (for encrypted networks):
      - CONFIG_CRYPTO: missing
      - CONFIG_CRYPTO_AEAD: missing
      - CONFIG_CRYPTO_GCM: missing
      - CONFIG_CRYPTO_SEQIV: missing
      - CONFIG_CRYPTO_GHASH: missing
      - CONFIG_XFRM: missing
      - CONFIG_XFRM_USER: missing
      - CONFIG_XFRM_ALGO: missing
      - CONFIG_INET_ESP: missing
      - CONFIG_NETFILTER_XT_MATCH_BPF: missing
  - "ipvlan":
    - CONFIG_IPVLAN: missing
  - "macvlan":
    - CONFIG_MACVLAN: missing
    - CONFIG_DUMMY: missing
  - "ftp,tftp client in container":
    - CONFIG_NF_NAT_FTP: missing
    - CONFIG_NF_CONNTRACK_FTP: missing
    - CONFIG_NF_NAT_TFTP: missing
    - CONFIG_NF_CONNTRACK_TFTP: missing
- Storage Drivers:
  - "btrfs":
    - CONFIG_BTRFS_FS: missing
    - CONFIG_BTRFS_FS_POSIX_ACL: missing
  - "overlay":
    - CONFIG_OVERLAY_FS: missing
  - "zfs":
    - /dev/zfs: present
    - zfs command: missing
    - zpool command: missing

Limits:
- /proc/sys/kernel/keys/root_maxkeys: 1000000
devioa commented 11 months ago

啊这,全都 missing 啊?可我在 .config 里搜索一些关键词(比如NET_NS)看了都是y呀,请问您知道可能是什么原因呢?这个真触及我知识盲区了😨

lisaac commented 11 months ago

啊这,全都 missing 啊?可我在 .config 里搜索一些关键词(比如NET_NS)看了都是y呀,请问您知道可能是什么原因呢?这个真触及我知识盲区了😨

可能是需要 .kernel_config 文件来检查,当然你可直接检查一下这些内核模块是否都配置了

devioa commented 11 months ago

可能是需要 .kernel_config 文件来检查,当然你可直接检查一下这些内核模块是否都配置了

这个文件我在哪儿可以找到?

lisaac commented 11 months ago

没记错 openwrt 编译目录能找到

devioa commented 11 months ago

我在lede目录下搜索没有找到.kernel_config 我手动翻了下,只在lede/config里找到一个很相似的Config-kernel.in 内容大概是这样的:

# SPDX-License-Identifier: GPL-2.0-only
#
# Copyright (C) 2006-2014 OpenWrt.org

config KERNEL_BUILD_USER
    string "Custom Kernel Build User Name"
    default "builder" if BUILDBOT
    default ""
    help
      Sets the Kernel build user string, which for example will be returned
      by 'uname -a' on running systems.
      If not set, uses system user at build time.

config KERNEL_BUILD_DOMAIN
    string "Custom Kernel Build Domain Name"
    default "buildhost" if BUILDBOT
    default ""
    help
      Sets the Kernel build domain string, which for example will be
      returned by 'uname -a' on running systems.
      If not set, uses system hostname at build time.

config KERNEL_PRINTK
    bool "Enable support for printk"
    default y

config KERNEL_SWAP
    bool "Support for paging of anonymous memory (swap)"
    default y if !SMALL_FLASH

config KERNEL_PROC_STRIPPED
    bool "Strip non-essential /proc functionality to reduce code size"
    default y if SMALL_FLASH

config KERNEL_DEBUG_FS
    bool "Compile the kernel with debug filesystem enabled"
    default y
    help
      debugfs is a virtual file system that kernel developers use to put
      debugging files into. Enable this option to be able to read and
      write to these files. Many common debugging facilities, such as
      ftrace, require the existence of debugfs.

config KERNEL_MIPS_FP_SUPPORT
    bool
    default y if TARGET_pistachio

config KERNEL_ARM_PMU
    bool
    default n
    depends on (arm || aarch64)
......
lisaac commented 11 months ago

@devioa

Generally Necessary:
- cgroup hierarchy: cgroupv2
  Controllers:
  - cpu: available
  - cpuset: available
  - io: available
  - memory: available
  - pids: available
- apparmor: enabled and tools installed
- CONFIG_NAMESPACES: enabled
- CONFIG_NET_NS: enabled
- CONFIG_PID_NS: enabled
- CONFIG_IPC_NS: enabled
- CONFIG_UTS_NS: enabled
- CONFIG_CGROUPS: enabled
- CONFIG_CGROUP_CPUACCT: enabled
- CONFIG_CGROUP_DEVICE: missing
- CONFIG_CGROUP_FREEZER: missing
- CONFIG_CGROUP_SCHED: enabled
- CONFIG_CPUSETS: enabled
- CONFIG_MEMCG: enabled
- CONFIG_KEYS: enabled
- CONFIG_VETH: missing
- CONFIG_BRIDGE: missing
- CONFIG_BRIDGE_NETFILTER: missing
- CONFIG_IP_NF_FILTER: missing
- CONFIG_IP_NF_TARGET_MASQUERADE: missing
- CONFIG_NETFILTER_XT_MATCH_ADDRTYPE: missing
- CONFIG_NETFILTER_XT_MATCH_CONNTRACK: missing
- CONFIG_NETFILTER_XT_MATCH_IPVS: missing
- CONFIG_NETFILTER_XT_MARK: missing
- CONFIG_IP_NF_NAT: missing
- CONFIG_NF_NAT: missing
- CONFIG_POSIX_MQUEUE: enabled
- CONFIG_CGROUP_BPF: enabled

Optional Features:
- CONFIG_USER_NS: enabled
- CONFIG_SECCOMP: enabled
- CONFIG_SECCOMP_FILTER: enabled
- CONFIG_CGROUP_PIDS: enabled
- CONFIG_MEMCG_SWAP: enabled
    (cgroup swap accounting is currently enabled)
- CONFIG_BLK_CGROUP: enabled
- CONFIG_BLK_DEV_THROTTLING: enabled
- CONFIG_CGROUP_PERF: missing
- CONFIG_CGROUP_HUGETLB: missing
- CONFIG_NET_CLS_CGROUP: missing
- CONFIG_CGROUP_NET_PRIO: missing
- CONFIG_CFS_BANDWIDTH: enabled
- CONFIG_FAIR_GROUP_SCHED: enabled
- CONFIG_IP_NF_TARGET_REDIRECT: missing
- CONFIG_IP_VS: missing
- CONFIG_IP_VS_NFCT: missing
- CONFIG_IP_VS_PROTO_TCP: missing
- CONFIG_IP_VS_PROTO_UDP: missing
- CONFIG_IP_VS_RR: missing
- CONFIG_SECURITY_SELINUX: missing
- CONFIG_SECURITY_APPARMOR: missing
- CONFIG_EXT3_FS: missing
- CONFIG_EXT3_FS_XATTR: missing
- CONFIG_EXT3_FS_POSIX_ACL: missing
- CONFIG_EXT3_FS_SECURITY: missing
    (enable these ext3 configs if you are using ext3 as backing filesystem)
- CONFIG_EXT4_FS: missing
- CONFIG_EXT4_FS_POSIX_ACL: missing
- CONFIG_EXT4_FS_SECURITY: missing
    enable these ext4 configs if you are using ext4 as backing filesystem
- Network Drivers:
  - "overlay":
    - CONFIG_VXLAN: missing
    - CONFIG_BRIDGE_VLAN_FILTERING: missing
      Optional (for encrypted networks):
      - CONFIG_CRYPTO: missing
      - CONFIG_CRYPTO_AEAD: missing
      - CONFIG_CRYPTO_GCM: missing
      - CONFIG_CRYPTO_SEQIV: missing
      - CONFIG_CRYPTO_GHASH: missing
      - CONFIG_XFRM: missing
      - CONFIG_XFRM_USER: missing
      - CONFIG_XFRM_ALGO: missing
      - CONFIG_INET_ESP: missing
      - CONFIG_NETFILTER_XT_MATCH_BPF: missing
  - "ipvlan":
    - CONFIG_IPVLAN: missing
  - "macvlan":
    - CONFIG_MACVLAN: missing
    - CONFIG_DUMMY: missing
  - "ftp,tftp client in container":
    - CONFIG_NF_NAT_FTP: missing
    - CONFIG_NF_CONNTRACK_FTP: missing
    - CONFIG_NF_NAT_TFTP: missing
    - CONFIG_NF_CONNTRACK_TFTP: missing
- Storage Drivers:
  - "btrfs":
    - CONFIG_BTRFS_FS: missing
    - CONFIG_BTRFS_FS_POSIX_ACL: missing
  - "overlay":
    - CONFIG_OVERLAY_FS: missing
  - "zfs":
    - /dev/zfs: present
    - zfs command: missing
    - zpool command: missing

Limits:
- /proc/sys/kernel/keys/root_maxkeys: 1000000
lisaac commented 11 months ago

你先按照这个把模块加上试试,等你好消息

devioa commented 11 months ago

你先按照这个把模块加上试试,等你好消息

感觉这个脚本并不智能,我发现这个脚本不能正常读取未压缩为gz格式的.config,我还需gzip config./check-config.sh config.gz才可以正常读取 我试了试在 Ubuntu 上运行都是enabled,然后我顺着找到 Ubuntu 的/proc/config.gz在里面搜索相同的关键字(比如CONFIG_NET_NS)可以找到对应的配置项为y,然后我看了在 OpenWrt 的.config里对应的是CONFIG_KERNEL_NET_NS=y 并且我把中间的KERNEL_删掉再./check-config.sh config.gz对应的就变成enabled了 下面是我按上述方法删掉KERNEL_后检查的结果:

root@OpenWRT:~# ./check-config.sh config.gz
info: reading kernel config from config.gz ...

Generally Necessary:
- cgroup hierarchy: properly mounted [/sys/fs/cgroup]
- CONFIG_NAMESPACES: enabled
- CONFIG_NET_NS: enabled
- CONFIG_PID_NS: enabled
- CONFIG_IPC_NS: enabled
- CONFIG_UTS_NS: enabled
- CONFIG_CGROUPS: enabled
- CONFIG_CGROUP_CPUACCT: enabled
- CONFIG_CGROUP_DEVICE: missing
- CONFIG_CGROUP_FREEZER: missing
- CONFIG_CGROUP_SCHED: enabled
- CONFIG_CPUSETS: enabled
- CONFIG_MEMCG: enabled
- CONFIG_KEYS: enabled
- CONFIG_VETH: missing
- CONFIG_BRIDGE: missing
- CONFIG_BRIDGE_NETFILTER: missing
- CONFIG_NF_NAT_IPV4: missing
- CONFIG_IP_NF_FILTER: missing
- CONFIG_IP_NF_TARGET_MASQUERADE: missing
- CONFIG_NETFILTER_XT_MATCH_ADDRTYPE: missing
- CONFIG_NETFILTER_XT_MATCH_CONNTRACK: missing
- CONFIG_NETFILTER_XT_MATCH_IPVS: missing
- CONFIG_IP_NF_NAT: missing
- CONFIG_NF_NAT: missing
- CONFIG_NF_NAT_NEEDED: missing
- CONFIG_POSIX_MQUEUE: enabled

Optional Features:
- CONFIG_USER_NS: enabled
- CONFIG_SECCOMP: enabled
- CONFIG_CGROUP_PIDS: enabled
- CONFIG_MEMCG_SWAP: enabled
- CONFIG_MEMCG_SWAP_ENABLED: enabled
    (cgroup swap accounting is currently enabled)
- CONFIG_BLK_CGROUP: enabled
- CONFIG_BLK_DEV_THROTTLING: enabled
- CONFIG_IOSCHED_CFQ: missing
- CONFIG_CFQ_GROUP_IOSCHED: missing
- CONFIG_CGROUP_PERF: enabled
- CONFIG_CGROUP_HUGETLB: enabled
- CONFIG_NET_CLS_CGROUP: missing
- CONFIG_CGROUP_NET_PRIO: missing
- CONFIG_CFS_BANDWIDTH: enabled
- CONFIG_FAIR_GROUP_SCHED: enabled
- CONFIG_RT_GROUP_SCHED: enabled
- CONFIG_IP_VS: missing
- CONFIG_IP_VS_NFCT: missing
- CONFIG_IP_VS_RR: missing
- CONFIG_EXT3_FS: missing
- CONFIG_EXT3_FS_XATTR: missing
- CONFIG_EXT3_FS_POSIX_ACL: missing
- CONFIG_EXT3_FS_SECURITY: missing
    (enable these ext3 configs if you are using ext3 as backing filesystem)
- CONFIG_EXT4_FS: missing
- CONFIG_EXT4_FS_POSIX_ACL: missing
- CONFIG_EXT4_FS_SECURITY: missing
    enable these ext4 configs if you are using ext4 as backing filesystem
- Network Drivers:
  - "overlay":
    - CONFIG_VXLAN: missing
      Optional (for encrypted networks):
      - CONFIG_CRYPTO: missing
      - CONFIG_CRYPTO_AEAD: missing
      - CONFIG_CRYPTO_GCM: missing
      - CONFIG_CRYPTO_SEQIV: missing
      - CONFIG_CRYPTO_GHASH: missing
      - CONFIG_XFRM: missing
      - CONFIG_XFRM_USER: missing
      - CONFIG_XFRM_ALGO: missing
      - CONFIG_INET_ESP: missing
      - CONFIG_INET_XFRM_MODE_TRANSPORT: missing
  - "ipvlan":
    - CONFIG_IPVLAN: missing
  - "macvlan":
    - CONFIG_MACVLAN: missing
    - CONFIG_DUMMY: missing
  - "ftp,tftp client in container":
    - CONFIG_NF_NAT_FTP: missing
    - CONFIG_NF_CONNTRACK_FTP: missing
    - CONFIG_NF_NAT_TFTP: missing
    - CONFIG_NF_CONNTRACK_TFTP: missing
- Storage Drivers:
  - "aufs":
    - CONFIG_AUFS_FS: missing
  - "btrfs":
    - CONFIG_BTRFS_FS: missing
    - CONFIG_BTRFS_FS_POSIX_ACL: missing
  - "devicemapper":
    - CONFIG_BLK_DEV_DM: missing
    - CONFIG_DM_THIN_PROVISIONING: missing
  - "overlay":
    - CONFIG_OVERLAY_FS: missing
  - "zfs":
    - /dev/zfs: missing
    - zfs command: missing
    - zpool command: missing

Limits:
- /proc/sys/kernel/keys/root_maxkeys: 1000000

所以我内核模块应该是都没问题的

lisaac commented 11 months ago

这个脚本没有考虑openwrt的情况,只是针对正常linux内核,针对.config当然会有点水土服

所以你这个结果根https://github.com/lisaac/luci-app-dockerman/issues/175#issuecomment-1767568345 基本一样,可能我用了比较新的版本?

从结果来看,你可以再看看 Generally Necessary 中还是有不少missing的,建议排查一下

devioa commented 11 months ago

这个脚本没有考虑openwrt的情况,只是针对正常linux内核,针对.config当然会有点水土服

所以你这个结果根#175 (comment) 基本一样,可能我用了比较新的版本?

从结果来看,你可以再看看 Generally Necessary 中还是有不少missing的,建议排查一下

我感觉可能不是内核模块的原因,因为我之前用相同的.config编译出来的固件在以前还是物理机运行 openwrt 的某段时间,docker stats应该是正常的,因为我在容器状态里能看到正常的资源使用状态,但有时更新固件后会抽风,相同固件包再刷一遍到另一个分区就正常(我当时物理机上 openwrt rootfs 分区用的是类似安卓那种 A/B 分区概念,更新固件时会刷到另一个分区,然后再通过修改 boot 分区中grub.cfgroot=PARTUUID引导到已更新的分区),有时候重启后也会恢复正常,也就是说这个问题不一定100%能复现,但后来到现在我用的是 ESXi 虚拟机平台运行的 openwrt,这个NaN undefined / NaN undefined (0%)就100%复现,无论怎么重启怎么重装固件都是如此

devioa commented 11 months ago
WARNING: No memory limit support
WARNING: No swap limit support
WARNING: No cpu cfs quota support
WARNING: No cpu cfs period support
WARNING: No cpu shares support
WARNING: No cpuset support
WARNING: No io.weight support
WARNING: No io.weight (per device) support
WARNING: No io.max (rbps) support
WARNING: No io.max (wbps) support
WARNING: No io.max (riops) support
WARNING: No io.max (wiops) support

我感觉可能还是和docker info中这些 warning 有关,但我 Google 搜了半天也没找到适用 openwrt 解决的方法

devioa commented 11 months ago
WARNING: No memory limit support
WARNING: No swap limit support
WARNING: No cpu cfs quota support
WARNING: No cpu cfs period support
WARNING: No cpu shares support
WARNING: No cpuset support
WARNING: No io.weight support
WARNING: No io.weight (per device) support
WARNING: No io.max (rbps) support
WARNING: No io.max (wbps) support
WARNING: No io.max (riops) support
WARNING: No io.max (wiops) support

我感觉可能还是和docker info中这些 warning 有关,但我 Google 搜了半天也没找到适用 openwrt 解决的方法

我找了一些验证方法,比如这个WARNING: No cpuset support,我按 stackoverflow 验证出来内核是有支持的:

root@OpenWRT:~# cat /proc/filesystems
nodev   sysfs
nodev   tmpfs
nodev   bdev
nodev   proc
nodev   cgroup
nodev   cgroup2
nodev   cpuset  ←这个
nodev   debugfs
nodev   sockfs
nodev   bpf
nodev   pipefs
nodev   ramfs
nodev   devpts
        ext3
        ext2
        ext4
        squashfs
        iso9660
nodev   overlay
        f2fs
nodev   mqueue
        btrfs
        vfat
OldCoding commented 11 months ago

同样遇到这个问题了,用的是Lede最新源码,github云编译的,但是有个奇怪的现象,我的设备是ARM盒子,内核是F大的内核,6.1.57,第一次刷入固件启动后任何容器都能正常显示资源状态,然后设备重启后就无法显示了,猜测可能是什么东西没启动正确,或者运行异常了

devioa commented 11 months ago

@OldCoding 方便发一下docker info的打印信息吗?

OldCoding commented 11 months ago

@OldCoding 方便发一下docker info的打印信息吗?

root@X96Max:~# docker info Client: Context: default Debug Mode: false

Server: Containers: 4 Running: 4 Paused: 0 Stopped: 0 Images: 4 Server Version: 20.10.17 Storage Driver: overlay2 Backing Filesystem: btrfs Supports d_type: true Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: cgroupfs Cgroup Version: 2 Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog Swarm: inactive Runtimes: io.containerd.runc.v2 io.containerd.runtime.v1.linux runc Default Runtime: runc Init Binary: docker-init containerd version: 10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 runc version: a916309fff0f838eb94e928713dbc3c0d0ac7aa4 init version: de40ad0 Security Options: cgroupns Kernel Version: 6.1.57-flippy-86+ Operating System: OpenWrt SNAPSHOT OSType: linux Architecture: aarch64 CPUs: 4 Total Memory: 3.697GiB Name: X96Max ID: X6BA:3VT2:2N47:XYTV:UQIM:T3YP:OEFB:MEQD:GSNM:EBUT:4QUK:TNF6 Docker Root Dir: /mnt/mmcblk2p4/docker Debug Mode: false Registry: https://index.docker.io/v1/ Labels: Experimental: false Insecure Registries: 127.0.0.0/8 Registry Mirrors: https://mirror.baidubce.com/ https://hub-mirror.c.163.com/ Live Restore Enabled: false

WARNING: No memory limit support WARNING: No swap limit support WARNING: No cpu cfs quota support WARNING: No cpu cfs period support WARNING: No cpu shares support WARNING: No cpuset support WARNING: No io.weight support WARNING: No io.weight (per device) support WARNING: No io.max (rbps) support WARNING: No io.max (wbps) support WARNING: No io.max (riops) support WARNING: No io.max (wiops) support

devioa commented 11 months ago

我刚刚观察到一个现象,如果docker infoCgroup Version1的话,下面没有任何 warning,但是重启后就变成Cgroup Version: 2了,然后下面就会有很多 warning

devioa commented 11 months ago

Cgroup Version: 1我也只在我刚刷入新固件时观察到的,因为要覆盖一些个性化配置文件,所以需要重启固件以应用 但重启后,目前暂时看到的就都是Cgroup Version: 2

devioa commented 11 months ago

@OldCoding 你这大概率和我上述说的原因有关 你这也是 cgroup v2,下面的 warning 也和我一样 我还多了两个bridge-nf-call-iptables is disabled bridge-nf-call-ip6tables is disabled 这个是因为最近 lede 有提交在sysctl.conf里关闭了这个 bridge-nf-call-iptables,手动再改回去就可以了

devioa commented 11 months ago

@lisaac @OldCoding 果然和我的猜想一致,经过我多次尝试,确认在Cgroup Version: 1时,不会有 WARNING 信息 并且 dockerman 和docker stats资源状态均显示正常: image QQ截图20231018180740 猜测是 cgroup v2 某些 api Docker 还不支持的原因?不清楚不是很懂这一块 估计下次重启又变成Cgroup Version: 2了,这个12的变动不是很有规律,也不清楚是因为什么导致cgroup版本的变化

OldCoding commented 11 months ago

找了台空闲设备试了一下,docker info中Cgroup Version显示为1的就无法显示资源状态 Client: Context: default Debug Mode: false

Server: Containers: 4 Running: 4 Paused: 0 Stopped: 0 Images: 4 Server Version: 20.10.17 Storage Driver: overlay2 Backing Filesystem: btrfs Supports d_type: true Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: cgroupfs Cgroup Version: 2 Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog Swarm: inactive Runtimes: runc io.containerd.runc.v2 io.containerd.runtime.v1.linux Default Runtime: runc Init Binary: docker-init containerd version: 10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 runc version: a916309fff0f838eb94e928713dbc3c0d0ac7aa4 init version: de40ad0 Security Options: cgroupns Kernel Version: 6.1.57-flippy-86+ Operating System: OpenWrt SNAPSHOT OSType: linux Architecture: aarch64 CPUs: 4 Total Memory: 3.697GiB Name: X96Max ID: X6BA:3VT2:2N47:XYTV:UQIM:T3YP:OEFB:MEQD:GSNM:EBUT:4QUK:TNF6 Docker Root Dir: /mnt/mmcblk2p4/docker Debug Mode: false Registry: https://index.docker.io/v1/ Labels: Experimental: false Insecure Registries: 127.0.0.0/8 Registry Mirrors: https://mirror.baidubce.com/ https://hub-mirror.c.163.com/ Live Restore Enabled: false

WARNING: No memory limit support WARNING: No swap limit support WARNING: No cpu cfs quota support WARNING: No cpu cfs period support WARNING: No cpu shares support WARNING: No cpuset support WARNING: No io.weight support WARNING: No io.weight (per device) support WARNING: No io.max (rbps) support WARNING: No io.max (wbps) support WARNING: No io.max (riops) support WARNING: No io.max (wiops) support 这个是不能正常显示的

Client: Context: default Debug Mode: false

Server: Containers: 1 Running: 1 Paused: 0 Stopped: 0 Images: 1 Server Version: 20.10.17 Storage Driver: overlay2 Backing Filesystem: btrfs Supports d_type: true Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: cgroupfs Cgroup Version: 1 Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog Swarm: inactive Runtimes: io.containerd.runc.v2 io.containerd.runtime.v1.linux runc Default Runtime: runc Init Binary: docker-init containerd version: 10c12954828e7c7c9b6e0ea9b0c02b01407d3ae1 runc version: a916309fff0f838eb94e928713dbc3c0d0ac7aa4 init version: de40ad0 Kernel Version: 6.1.57-flippy-86+ Operating System: OpenWrt SNAPSHOT OSType: linux Architecture: aarch64 CPUs: 4 Total Memory: 1.884GiB Name: N1 ID: ULVQ:CQHS:YVIK:KECO:VOHC:EZIY:2TGC:QFRJ:WUWH:OBCR:5QTB:ZQML Docker Root Dir: /mnt/mmcblk2p4/docker Debug Mode: false Registry: https://index.docker.io/v1/ Labels: Experimental: false Insecure Registries: 127.0.0.0/8 Registry Mirrors: https://dockerproxy.com/ Live Restore Enabled: false 这个是能正常显示的,都是同一天的源码编译的

OldCoding commented 11 months ago

这个是能正常显示的系统日志和内核日志 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.043110] mousedev: PS/2 mouse device common for all mice Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.048496] input: gpio-keys-polled as /devices/platform/gpio-keys-polled/input/input0 Wed Oct 18 19:11:41 2023 kern.warn kernel: [ 2.057389] SPI driver rmi4_spi has no spi_device_id for syna,rmi4-spi Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.063107] meson-vrtc c81000a8.rtc: registered as rtc0 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.067567] meson-vrtc c81000a8.rtc: setting system clock to 1970-01-01T00:00:02 UTC (2) Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.076047] i2c_dev: i2c /dev entries driver Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.081570] Registered IR keymap rc-cec Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.083679] rc rc0: meson_ao_cec as /devices/platform/soc/c8100000.bus/c8100100.cec/rc/rc0 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.091944] input: meson_ao_cec as /devices/platform/soc/c8100000.bus/c8100100.cec/rc/rc0/input1 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.103714] sdhci: Secure Digital Host Controller Interface driver Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.106631] sdhci: Copyright(c) Pierre Ossman Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.110923] Synopsys Designware Multimedia Card Interface Driver Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.117754] sdhci-pltfm: SDHCI platform and OF driver helper Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.118228] meson-gx-mmc d0074000.mmc: allocated mmc-pwrseq Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.128063] ledtrig-cpu: registered to indicate activity on CPUs Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.135134] meson-sm: secure-monitor enabled Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.139587] gxl-crypto c883e000.crypto: will run requests pump with realtime priority Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.146069] gxl-crypto c883e000.crypto: will run requests pump with realtime priority Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.154075] hid: raw HID events driver (C) Jiri Kosina Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.158979] usbcore: registered new interface driver usbhid Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.164384] usbhid: USB HID core driver Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.168669] platform-mhu c883c404.mailbox: Platform MHU Mailbox registered Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.185720] Initializing XFRM netlink socket Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.186453] NET: Registered PF_INET6 protocol family Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.225242] Segment Routing with IPv6 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.225284] RPL Segment Routing with IPv6 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.227309] In-situ OAM (IOAM) with IPv6 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.231316] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.238178] NET: Registered PF_PACKET protocol family Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.242057] NET: Registered PF_KEY protocol family Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.246990] 8021q: 802.1Q VLAN Support v1.8 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.251419] registered taskstats version 1 Wed Oct 18 19:11:41 2023 kern.notice kernel: [ 2.254986] Loading compiled-in X.509 certificates Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.264177] zswap: loaded using pool zstd/zbud Wed Oct 18 19:11:41 2023 kern.notice kernel: [ 2.264745] Key type .fscrypt registered Wed Oct 18 19:11:41 2023 kern.notice kernel: [ 2.267971] Key type fscrypt-provisioning registered Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.273981] Btrfs loaded, crc32c=crc32c-generic, zoned=no, fsverity=no Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.342934] mmc2: new HS200 MMC card at address 0001 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.343838] mmcblk2: mmc2:0001 8GME4R 7.28 GiB Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.348331] mmcblk2: p1 p2 p3 p4 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.351186] mmcblk2boot0: mmc2:0001 8GME4R 4.00 MiB Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.356540] mmcblk2boot1: mmc2:0001 8GME4R 4.00 MiB Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.361089] mmcblk2rpmb: mmc2:0001 8GME4R 512 KiB, chardev (237:0) Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.497358] alg: No test for 842 (842-scomp) Wed Oct 18 19:11:41 2023 kern.info kernel: [ 2.497522] alg: No test for 842 (842-generic) Wed Oct 18 19:11:41 2023 kern.err kernel: [ 3.252598] meson_uart c11084c0.serial: Failed to create device link (0x180) with wifi32k Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.256064] meson-drm d0100000.vpu: Queued 1 outputs on vpu Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.262136] meson-drm d0100000.vpu: CVBS Output connector not available Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.292282] meson-dw-hdmi c883a000.hdmi-tx: Detected HDMI TX controller v2.01a with HDCP (meson_dw_hdmi_phy) Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.297023] meson-dw-hdmi c883a000.hdmi-tx: registered DesignWare HDMI I2C bus driver Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.304841] meson-drm d0100000.vpu: bound c883a000.hdmi-tx (ops meson_dw_hdmi_ops) Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.312303] [drm] Initialized meson 1.0.0 20161109 for d0100000.vpu on minor 0 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.318974] meson-drm d0100000.vpu: [drm] Cannot find any crtc or sizes Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.325528] meson-drm d0100000.vpu: [drm] Cannot find any crtc or sizes Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.330848] meson8b-dwmac c9410000.ethernet: IRQ eth_wake_irq not found Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.338572] meson8b-dwmac c9410000.ethernet: IRQ eth_lpi not found Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.344847] meson8b-dwmac c9410000.ethernet: PTP uses main clock Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.351426] meson8b-dwmac c9410000.ethernet: User ID: 0x11, Synopsys ID: 0x37 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.357721] meson8b-dwmac c9410000.ethernet: DWMAC1000 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.362886] meson8b-dwmac c9410000.ethernet: DMA HW capability register supported Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.370302] meson8b-dwmac c9410000.ethernet: RX Checksum Offload Engine supported Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.377719] meson8b-dwmac c9410000.ethernet: COE Type 2 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.382893] meson8b-dwmac c9410000.ethernet: TX Checksum insertion supported Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.389884] meson8b-dwmac c9410000.ethernet: Wake-Up On Lan supported Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.396263] meson8b-dwmac c9410000.ethernet: Normal descriptors Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.402128] meson8b-dwmac c9410000.ethernet: Ring mode enabled Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.407906] meson8b-dwmac c9410000.ethernet: Enable RX Mitigation via HW Watchdog Timer Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.418557] dwc3-meson-g12a d0078080.usb: USB2 ports: 2 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.421042] dwc3-meson-g12a d0078080.usb: USB3 ports: 0 Wed Oct 18 19:11:41 2023 kern.warn kernel: [ 3.941146] dwc2 c9100000.usb: supply vusb_d not found, using dummy regulator Wed Oct 18 19:11:41 2023 kern.warn kernel: [ 3.942827] dwc2 c9100000.usb: supply vusb_a not found, using dummy regulator Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.949991] dwc2 c9100000.usb: EPs: 7, dedicated fifos, 712 entries in SPRAM Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.958432] xhci-hcd xhci-hcd.3.auto: xHCI Host Controller Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.962389] xhci-hcd xhci-hcd.3.auto: new USB bus registered, assigned bus number 1 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.969872] xhci-hcd xhci-hcd.3.auto: USB3 root hub has no ports Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.975701] xhci-hcd xhci-hcd.3.auto: hcc params 0x0228f664 hci version 0x100 quirks 0x0000000002010010 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.985054] xhci-hcd xhci-hcd.3.auto: irq 32, io mem 0xc9000000 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.991166] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.01 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 3.999068] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.006225] usb usb1: Product: xHCI Host Controller Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.011054] usb usb1: Manufacturer: Linux 6.1.53-flippy-85+ xhci-hcd Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.017350] usb usb1: SerialNumber: xhci-hcd.3.auto Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.022660] hub 1-0:1.0: USB hub found Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.025921] hub 1-0:1.0: 2 ports detected Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.033007] scpi_protocol scpi: SCP Protocol legacy pre-1.0 firmware Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.033473] meson-gx-mmc d0070000.mmc: allocated mmc-pwrseq Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.057272] simple-framebuffer 7fe5b000.framebuffer: framebuffer at 0x7fe5b000, 0x195000 bytes Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.060270] simple-framebuffer 7fe5b000.framebuffer: format=x8r8g8b8, mode=720x576x32, linelength=2880 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.072842] Console: switching to colour frame buffer device 90x36 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.076144] simple-framebuffer 7fe5b000.framebuffer: fb0: simplefb registered! Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.114765] mmc0: new ultra high speed SDR50 SDIO card at address 0001 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.301692] ALSA device list: Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.301790] No soundcards found. Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.303154] Freeing unused kernel memory: 1664K Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.307088] Run /init as init process Wed Oct 18 19:11:41 2023 kern.debug kernel: [ 4.310577] with arguments: Wed Oct 18 19:11:41 2023 kern.debug kernel: [ 4.310584] /init Wed Oct 18 19:11:41 2023 kern.debug kernel: [ 4.310589] with environment: Wed Oct 18 19:11:41 2023 kern.debug kernel: [ 4.310592] HOME=/ Wed Oct 18 19:11:41 2023 kern.debug kernel: [ 4.310596] TERM=linux Wed Oct 18 19:11:41 2023 kern.debug kernel: [ 4.310600] cgroup_enable=memory Wed Oct 18 19:11:41 2023 kern.debug kernel: [ 4.310604] cgroup_memory=1 Wed Oct 18 19:11:41 2023 kern.debug kernel: [ 4.310608] mac=5a:15:88:19:15:54 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.954740] BTRFS: device label EMMC_SHARED devid 1 transid 53614 /dev/mmcblk2p4 scanned by btrfs (304) Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.962037] BTRFS: device label EMMC_ROOTFS2 devid 1 transid 23688 /dev/mmcblk2p3 scanned by btrfs (304) Wed Oct 18 19:11:41 2023 kern.info kernel: [ 4.971440] BTRFS: device label EMMC_ROOTFS1 devid 1 transid 3595 /dev/mmcblk2p2 scanned by btrfs (304) Wed Oct 18 19:11:41 2023 kern.info kernel: [ 5.018121] BTRFS info (device mmcblk2p2): using crc32c (crc32c-generic) checksum algorithm Wed Oct 18 19:11:41 2023 kern.info kernel: [ 5.024572] BTRFS info (device mmcblk2p2): use zstd compression, level 6 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 5.031155] BTRFS info (device mmcblk2p2): using free space tree Wed Oct 18 19:11:41 2023 kern.info kernel: [ 5.045915] BTRFS info (device mmcblk2p2): enabling ssd optimizations Wed Oct 18 19:11:41 2023 user.info kernel: [ 5.165356] init: Console is alive Wed Oct 18 19:11:41 2023 user.info kernel: [ 8.148604] kmodloader: loading kernel modules from /etc/modules-boot.d/ Wed Oct 18 19:11:41 2023 kern.info kernel: [ 8.166870] device-mapper: ioctl: 4.47.0-ioctl (2022-07-28) initialised: dm-devel@redhat.com Wed Oct 18 19:11:41 2023 user.info kernel: [ 8.226939] kmodloader: done loading kernel modules from /etc/modules-boot.d/ Wed Oct 18 19:11:41 2023 user.info kernel: [ 8.236070] init: - preinit - Wed Oct 18 19:11:41 2023 kern.notice kernel: [ 9.732231] random: crng init done Wed Oct 18 19:11:41 2023 kern.info kernel: [ 9.878913] meson8b-dwmac c9410000.ethernet eth0: Register MEM_TYPE_PAGE_POOL RxQ-0 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 10.060623] meson8b-dwmac c9410000.ethernet eth0: PHY [mdio_mux-0.2009087f:00] driver [RTL8211F Gigabit Ethernet] (irq=35) Wed Oct 18 19:11:41 2023 kern.info kernel: [ 11.632281] meson8b-dwmac c9410000.ethernet eth0: No Safety Features support found Wed Oct 18 19:11:41 2023 kern.info kernel: [ 11.643684] meson8b-dwmac c9410000.ethernet eth0: PTP not supported by HW Wed Oct 18 19:11:41 2023 kern.info kernel: [ 11.655156] meson8b-dwmac c9410000.ethernet eth0: configuring for phy/rgmii link mode Wed Oct 18 19:11:41 2023 kern.info kernel: [ 14.328539] meson8b-dwmac c9410000.ethernet eth0: Link is Up - 1Gbps/Full - flow control rx/tx Wed Oct 18 19:11:41 2023 kern.info kernel: [ 14.334768] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Wed Oct 18 19:11:41 2023 user.notice kernel: [ 14.817005] mount_root: mounting /dev/root Wed Oct 18 19:11:41 2023 user.info kernel: [ 14.833662] mount_root: loading kmods from internal overlay Wed Oct 18 19:11:41 2023 user.info kernel: [ 15.161776] kmodloader: loading kernel modules from //etc/modules-boot.d/ Wed Oct 18 19:11:41 2023 user.info kernel: [ 15.170938] kmodloader: done loading kernel modules from //etc/modules-boot.d/ Wed Oct 18 19:11:41 2023 user.info kernel: [ 15.239802] block: attempting to load /etc/config/fstab Wed Oct 18 19:11:41 2023 user.err kernel: [ 15.244901] block: extroot: unable to determine root device Wed Oct 18 19:11:41 2023 user.warn kernel: [ 15.283117] urandom-seed: Seeding with /etc/urandom.seed Wed Oct 18 19:11:41 2023 kern.info kernel: [ 15.444575] meson8b-dwmac c9410000.ethernet eth0: Link is Down Wed Oct 18 19:11:41 2023 user.info kernel: [ 15.475468] procd: - early - Wed Oct 18 19:11:41 2023 user.info kernel: [ 16.034040] procd: - ubus - Wed Oct 18 19:11:41 2023 user.info kernel: [ 16.090944] procd: - init - Wed Oct 18 19:11:41 2023 user.info kernel: [ 16.352090] urngd: v1.0.2 started. Wed Oct 18 19:11:41 2023 user.info kernel: [ 16.928648] kmodloader: loading kernel modules from /etc/modules.d/ Wed Oct 18 19:11:41 2023 kern.warn kernel: [ 16.937361] "cryptomgr_test" (657) uses obsolete ecb(arc4) skcipher Wed Oct 18 19:11:41 2023 kern.info kernel: [ 16.951089] tun: Universal TUN/TAP device driver, 1.6 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 16.965705] l2tp_core: L2TP core driver, V2.0 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 16.973198] l2tp_netlink: L2TP netlink interface Wed Oct 18 19:11:41 2023 kern.info kernel: [ 16.995628] VMware vmxnet3 virtual NIC driver - version 1.7.0.0-k-NAPI Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.002709] gre: GRE over IPv4 demultiplexor driver Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.010521] ip_gre: GRE over IPv4 tunneling driver Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.209836] cryptodev: driver 1.12 loaded. Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.224074] GACT probability on Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.231348] Mirror/redirect action on Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.273582] u32 classifier Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.274934] Performance counters on Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.276255] input device check on Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.279419] Actions configured Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.315895] ntfs3: Max link count 4000 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.317147] ntfs3: Enabled Linux POSIX ACLs support Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.320077] ntfs3: Read-only LZX/Xpress compression included Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.344475] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.362887] e1000e: Intel(R) PRO/1000 Network Driver Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.364128] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.411285] usbcore: registered new interface driver option Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.412870] usbserial: USB Serial support registered for GSM modem (1-port) Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.426673] usbcore: registered new interface driver r8152 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.439632] usbcore: registered new interface driver rtl8150 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.449133] usbcore: registered new interface driver ums-alauda Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.451380] usbcore: registered new interface driver ums-cypress Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.457456] usbcore: registered new interface driver ums-datafab Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.463349] usbcore: registered new interface driver ums-freecom Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.469327] usbcore: registered new interface driver ums-isd200 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.475200] usbcore: registered new interface driver ums-jumpshot Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.481204] usbcore: registered new interface driver ums-karma Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.487098] usbcore: registered new interface driver ums-sddr09 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.492926] usbcore: registered new interface driver ums-sddr55 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.498833] usbcore: registered new interface driver ums-usbat Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.505457] usbcore: registered new interface driver usblp Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.545545] xt_time: kernel timezone is -0000 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.547930] usbcore: registered new interface driver ax88179_178a Wed Oct 18 19:11:41 2023 kern.notice kernel: [ 17.552479] Bridge firewalling registered Wed Oct 18 19:11:41 2023 kern.notice kernel: [ 17.567247] cfg80211: Loading compiled-in X.509 certificates for regulatory database Wed Oct 18 19:11:41 2023 kern.notice kernel: [ 17.608059] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.643633] usbcore: registered new interface driver mt7601u Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.650771] usbcore: registered new interface driver mt7663u Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.661597] usbcore: registered new interface driver mt76x2u Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.674661] PPP generic driver version 2.4.2 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.677294] PPP MPPE Compression module registered Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.680188] NET: Registered PF_PPPOX protocol family Wed Oct 18 19:11:41 2023 kern.info kernel: [ 17.708069] usbcore: registered new interface driver ath10k_usb Wed Oct 18 19:11:41 2023 kern.debug kernel: [ 17.717321] brcmfmac: F1 signature read @0x18000000=0x15264345 Wed Oct 18 19:11:41 2023 kern.err kernel: [ 17.719711] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43455-sdio for chip BCM4345/6 Wed Oct 18 19:11:41 2023 kern.warn kernel: [ 17.725729] brcmfmac mmc0:0001:1: Direct firmware load for brcm/brcmfmac43455-sdio.phicomm,n1.bin failed with error -2 Wed Oct 18 19:11:41 2023 kern.err kernel: [ 17.988752] brcmfmac: brcmf_c_preinit_dcmds: Firmware: BCM4345/6 wl0: Feb 27 2018 03:15:32 version 7.45.154 (r684107 CY) FWID 01-4fbe0b04 Wed Oct 18 19:11:41 2023 kern.info kernel: [ 18.522145] usbcore: registered new interface driver brcmfmac Wed Oct 18 19:11:41 2023 kern.info kernel: [ 18.534333] usbcore: registered new interface driver mt76x0u Wed Oct 18 19:11:41 2023 kern.info kernel: [ 18.539640] usbcore: registered new interface driver rt2500usb Wed Oct 18 19:11:41 2023 kern.info kernel: [ 18.548352] usbcore: registered new interface driver rt2800usb Wed Oct 18 19:11:41 2023 user.info kernel: [ 18.552027] kmodloader: done loading kernel modules from /etc/modules.d/ Wed Oct 18 19:11:41 2023 kern.warn kernel: [ 19.022169] FAT-fs (mmcblk2p1): utf8 is not a recommended IO charset for FAT filesystems, filesystem will be case sensitive! Wed Oct 18 19:11:41 2023 kern.info kernel: [ 19.036386] BTRFS info (device mmcblk2p3): using crc32c (crc32c-generic) checksum algorithm Wed Oct 18 19:11:41 2023 kern.info kernel: [ 19.041895] BTRFS info (device mmcblk2p3): using free space tree Wed Oct 18 19:11:41 2023 kern.info kernel: [ 19.056395] BTRFS info (device mmcblk2p3): enabling ssd optimizations Wed Oct 18 19:11:41 2023 kern.info kernel: [ 19.063710] BTRFS info (device mmcblk2p4): using crc32c (crc32c-generic) checksum algorithm Wed Oct 18 19:11:41 2023 kern.info kernel: [ 19.069394] BTRFS info (device mmcblk2p4): using free space tree Wed Oct 18 19:11:41 2023 kern.info kernel: [ 19.082886] BTRFS info (device mmcblk2p4): enabling ssd optimizations Wed Oct 18 19:11:41 2023 daemon.notice procd: /etc/rc.d/S13openssl: Generating engines.cnf Wed Oct 18 19:11:41 2023 daemon.notice procd: /etc/rc.d/S13openssl: Skipping devcrypto: /usr/lib/engines-3/devcrypto.so not found. Wed Oct 18 19:11:41 2023 daemon.notice procd: /etc/rc.d/S13openssl: Generating providers.cnf Wed Oct 18 19:11:41 2023 user.notice dnsmasq: DNS rebinding protection is active, will discard upstream RFC1918 responses! Wed Oct 18 19:11:41 2023 user.notice dnsmasq: Allowing 127.0.0.0/8 responses Wed Oct 18 19:11:43 2023 daemon.notice wpa_supplicant[1520]: Successfully initialized wpa_supplicant Wed Oct 18 19:11:43 2023 user.notice : Added device handler type: 8021ad Wed Oct 18 19:11:43 2023 user.notice : Added device handler type: 8021q Wed Oct 18 19:11:43 2023 user.notice : Added device handler type: macvlan Wed Oct 18 19:11:43 2023 user.notice : Added device handler type: veth Wed Oct 18 19:11:43 2023 user.notice : Added device handler type: bridge Wed Oct 18 19:11:43 2023 user.notice : Added device handler type: Network device Wed Oct 18 19:11:43 2023 user.notice : Added device handler type: tunnel Wed Oct 18 19:11:43 2023 daemon.notice procd: /etc/rc.d/S50autoreboot: Command failed: ubus call service delete { "name": "cron" } (Not found) Wed Oct 18 19:11:43 2023 daemon.notice procd: /etc/rc.d/S50autoreboot: Auto REBOOT has started. Wed Oct 18 19:11:43 2023 cron.err crond[1739]: crond (busybox 1.36.0) started, log level 8 Wed Oct 18 19:11:43 2023 daemon.notice procd: /etc/rc.d/S50netserver: Starting netserver with host 'IN(6)ADDR_ANY' port '12865' and family AF_UNSPEC Wed Oct 18 19:11:44 2023 kern.info kernel: [ 22.290348] meson8b-dwmac c9410000.ethernet eth0: Register MEM_TYPE_PAGE_POOL RxQ-0 Wed Oct 18 19:11:44 2023 kern.info kernel: [ 22.520273] meson8b-dwmac c9410000.ethernet eth0: PHY [mdio_mux-0.2009087f:00] driver [RTL8211F Gigabit Ethernet] (irq=35) Wed Oct 18 19:11:45 2023 kern.info kernel: [ 24.048378] meson8b-dwmac c9410000.ethernet eth0: No Safety Features support found Wed Oct 18 19:11:45 2023 kern.info kernel: [ 24.061848] meson8b-dwmac c9410000.ethernet eth0: PTP not supported by HW Wed Oct 18 19:11:45 2023 kern.info kernel: [ 24.072014] meson8b-dwmac c9410000.ethernet eth0: configuring for phy/rgmii link mode Wed Oct 18 19:11:45 2023 daemon.notice netifd: Interface 'lan' is enabled Wed Oct 18 19:11:45 2023 daemon.notice netifd: Interface 'lan' is setting up now Wed Oct 18 19:11:45 2023 daemon.notice netifd: Interface 'lan' is now up Wed Oct 18 19:11:45 2023 daemon.notice netifd: Interface 'loopback' is enabled Wed Oct 18 19:11:45 2023 daemon.notice netifd: Interface 'loopback' is setting up now Wed Oct 18 19:11:45 2023 daemon.notice netifd: Interface 'loopback' is now up Wed Oct 18 19:11:45 2023 daemon.notice netifd: Network device 'lo' link is up Wed Oct 18 19:11:45 2023 daemon.notice netifd: Interface 'loopback' has link connectivity Wed Oct 18 19:11:46 2023 daemon.notice netifd: radio0 (1990): ./mac80211.sh: eval: line 1087: ipconfig: not found Wed Oct 18 19:11:46 2023 daemon.notice netifd: radio0 (1990): ./mac80211.sh: eval: line 998: ipconfig: not found Wed Oct 18 19:11:46 2023 daemon.notice netifd: radio0 (1990): ./mac80211.sh: eval: line 1095: ipconfig: not found Wed Oct 18 19:11:46 2023 daemon.notice netifd: radio0 (1990): ./mac80211.sh: eval: line 1096: ipconfig: not found Wed Oct 18 19:11:46 2023 user.notice firewall: Reloading firewall due to ifup of lan (eth0) Wed Oct 18 19:11:46 2023 daemon.info avahi-daemon[2568]: Found user 'nobody' (UID 65534) and group 'nogroup' (GID 65534). Wed Oct 18 19:11:46 2023 daemon.info avahi-daemon[2568]: Successfully dropped root privileges. Wed Oct 18 19:11:46 2023 daemon.info avahi-daemon[2568]: avahi-daemon 0.8 starting up. Wed Oct 18 19:11:46 2023 daemon.warn avahi-daemon[2568]: WARNING: No NSS support for mDNS detected, consider installing nss-mdns! Wed Oct 18 19:11:46 2023 daemon.info avahi-daemon[2568]: No service file found in /etc/avahi/services. Wed Oct 18 19:11:46 2023 daemon.info avahi-daemon[2568]: Joining mDNS multicast group on interface eth0.IPv4 with address 192.168.123.2. Wed Oct 18 19:11:46 2023 daemon.info avahi-daemon[2568]: New relevant interface eth0.IPv4 for mDNS. Wed Oct 18 19:11:46 2023 daemon.info avahi-daemon[2568]: Joining mDNS multicast group on interface lo.IPv6 with address ::1. Wed Oct 18 19:11:46 2023 daemon.info avahi-daemon[2568]: New relevant interface lo.IPv6 for mDNS. Wed Oct 18 19:11:46 2023 daemon.info avahi-daemon[2568]: Joining mDNS multicast group on interface lo.IPv4 with address 127.0.0.1. Wed Oct 18 19:11:46 2023 daemon.info avahi-daemon[2568]: New relevant interface lo.IPv4 for mDNS. Wed Oct 18 19:11:46 2023 daemon.info avahi-daemon[2568]: Network interface enumeration completed. Wed Oct 18 19:11:46 2023 daemon.info avahi-daemon[2568]: Registering new address record for 192.168.123.2 on eth0.IPv4. Wed Oct 18 19:11:46 2023 daemon.info avahi-daemon[2568]: Registering new address record for ::1 on lo.*. Wed Oct 18 19:11:46 2023 daemon.info avahi-daemon[2568]: Registering new address record for 127.0.0.1 on lo.IPv4. Wed Oct 18 19:11:46 2023 daemon.info avahi-daemon[2568]: Registering HINFO record with values 'AARCH64'/'LINUX'. Wed Oct 18 19:11:46 2023 user.notice nlbwmon: Reloading nlbwmon due to ifup of lan (eth0) Wed Oct 18 19:11:47 2023 daemon.notice netifd: radio0 (1990): ./mac80211.sh: eval: line 1128: ipconfig: not found Wed Oct 18 19:11:47 2023 daemon.notice netifd: radio0 (1990): ./mac80211.sh: eval: line 208: ipconfig: not found Wed Oct 18 19:11:47 2023 daemon.info nginx_init: using /etc/nginx/uci.conf (the test is ok) Wed Oct 18 19:11:47 2023 authpriv.info dropbear[2786]: Not backgrounding Wed Oct 18 19:11:47 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to 0.0.0.0:443 failed (98: Address in use) Wed Oct 18 19:11:47 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to [::]:443 failed (98: Address in use) Wed Oct 18 19:11:47 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to 0.0.0.0:80 failed (98: Address in use) Wed Oct 18 19:11:47 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to [::]:80 failed (98: Address in use) Wed Oct 18 19:11:47 2023 daemon.err miniupnpd[2859]: could not open lease file: /var/upnp.leases Wed Oct 18 19:11:47 2023 daemon.notice miniupnpd[2859]: HTTP listening on port 5000 Wed Oct 18 19:11:47 2023 daemon.notice miniupnpd[2859]: Listening for NAT-PMP/PCP traffic on port 5351 Wed Oct 18 19:11:47 2023 daemon.notice hostapd: Configuration file: /var/run/hostapd-phy0.conf (phy wlan0) --> new PHY Wed Oct 18 19:11:47 2023 user.notice ucitrack: Setting up /etc/config/network reload dependency on /etc/config/dhcp Wed Oct 18 19:11:47 2023 user.notice ucitrack: Setting up /etc/config/network reload dependency on /etc/config/radvd Wed Oct 18 19:11:47 2023 user.notice ucitrack: Setting up /etc/config/wireless reload dependency on /etc/config/network Wed Oct 18 19:11:47 2023 user.notice ucitrack: Setting up /etc/config/firewall reload dependency on /etc/config/luci-splash Wed Oct 18 19:11:47 2023 daemon.notice hostapd: wlan0: interface state UNINITIALIZED->COUNTRY_UPDATE Wed Oct 18 19:11:47 2023 user.notice ucitrack: Setting up /etc/config/firewall reload dependency on /etc/config/qos Wed Oct 18 19:11:47 2023 user.notice ucitrack: Setting up /etc/config/firewall reload dependency on /etc/config/miniupnpd Wed Oct 18 19:11:47 2023 user.notice ucitrack: Setting up /etc/config/firewall reload dependency on /etc/config/sqm Wed Oct 18 19:11:47 2023 user.notice ucitrack: Setting up /etc/config/dhcp reload dependency on /etc/config/odhcpd Wed Oct 18 19:11:47 2023 user.notice ucitrack: Setting up non-init /etc/config/fstab reload handler: /sbin/block mount Wed Oct 18 19:11:47 2023 user.notice ucitrack: Setting up /etc/config/system reload trigger for non-procd /etc/init.d/led Wed Oct 18 19:11:47 2023 user.notice ucitrack: Setting up /etc/config/system reload dependency on /etc/config/luci_statistics Wed Oct 18 19:11:47 2023 kern.info kernel: [ 25.816549] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready Wed Oct 18 19:11:47 2023 user.notice ucitrack: Setting up /etc/config/system reload dependency on /etc/config/dhcp Wed Oct 18 19:11:47 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to 0.0.0.0:443 failed (98: Address in use) Wed Oct 18 19:11:47 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to [::]:443 failed (98: Address in use) Wed Oct 18 19:11:47 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to 0.0.0.0:80 failed (98: Address in use) Wed Oct 18 19:11:47 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to [::]:80 failed (98: Address in use) Wed Oct 18 19:11:47 2023 daemon.notice hostapd: wlan0: interface state COUNTRY_UPDATE->ENABLED Wed Oct 18 19:11:47 2023 daemon.notice hostapd: wlan0: AP-ENABLED Wed Oct 18 19:11:47 2023 user.notice ucitrack: Setting up /etc/config/autoreboot reload trigger for non-procd /etc/init.d/autoreboot Wed Oct 18 19:11:47 2023 daemon.info avahi-daemon[2568]: Server startup complete. Host name is N1.local. Local service cookie is 1819311974. Wed Oct 18 19:11:48 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to 0.0.0.0:443 failed (98: Address in use) Wed Oct 18 19:11:48 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to [::]:443 failed (98: Address in use) Wed Oct 18 19:11:48 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to 0.0.0.0:80 failed (98: Address in use) Wed Oct 18 19:11:48 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to [::]:80 failed (98: Address in use) Wed Oct 18 19:11:48 2023 user.notice nlbwmon: Reloading nlbwmon due to ifup of loopback (lo) Wed Oct 18 19:11:48 2023 user.notice ucitrack: Setting up /etc/config/amlogic reload trigger for non-procd /etc/init.d/amlogic Wed Oct 18 19:11:48 2023 user.notice ucitrack: Setting up /etc/config/filebrowser reload trigger for non-procd /etc/init.d/filebrowser Wed Oct 18 19:11:48 2023 user.notice ucitrack: Setting up /etc/config/luci-app-ipsec-server reload trigger for non-procd /etc/init.d/luci-app-ipsec-server Wed Oct 18 19:11:48 2023 user.notice ucitrack: Setting up /etc/config/socat reload trigger for non-procd /etc/init.d/luci_socat Wed Oct 18 19:11:48 2023 user.notice ucitrack: Setting up /etc/config/arpbind reload trigger for non-procd /etc/init.d/arpbind Wed Oct 18 19:11:48 2023 user.notice ucitrack: Setting up /etc/config/frp reload trigger for non-procd /etc/init.d/frp Wed Oct 18 19:11:48 2023 daemon.notice netifd: Network device 'wlan0' link is up Wed Oct 18 19:11:48 2023 user.notice ucitrack: Setting up /etc/config/kodexplorer reload trigger for non-procd /etc/init.d/kodexplorer Wed Oct 18 19:11:48 2023 user.notice ucitrack: Setting up /etc/config/mia reload trigger for non-procd /etc/init.d/mia Wed Oct 18 19:11:48 2023 kern.info kernel: [ 26.750067] meson8b-dwmac c9410000.ethernet eth0: Link is Up - 1Gbps/Full - flow control rx/tx Wed Oct 18 19:11:48 2023 kern.info kernel: [ 26.757630] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Wed Oct 18 19:11:48 2023 daemon.notice netifd: Network device 'eth0' link is up Wed Oct 18 19:11:48 2023 daemon.notice netifd: Interface 'lan' has link connectivity Wed Oct 18 19:11:48 2023 user.notice ucitrack: Setting up /etc/config/openclash reload trigger for non-procd /etc/init.d/openclash Wed Oct 18 19:11:48 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to 0.0.0.0:443 failed (98: Address in use) Wed Oct 18 19:11:48 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to [::]:443 failed (98: Address in use) Wed Oct 18 19:11:48 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to 0.0.0.0:80 failed (98: Address in use) Wed Oct 18 19:11:48 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to [::]:80 failed (98: Address in use) Wed Oct 18 19:11:48 2023 user.notice ucitrack: Setting up /etc/config/passwall reload trigger for non-procd /etc/init.d/passwall Wed Oct 18 19:11:48 2023 user.notice ucitrack: Setting up /etc/config/passwall_server reload trigger for non-procd /etc/init.d/passwall_server Wed Oct 18 19:11:48 2023 user.notice ucitrack: Setting up /etc/config/passwall2 reload trigger for non-procd /etc/init.d/passwall2 Wed Oct 18 19:11:48 2023 user.notice ucitrack: Setting up /etc/config/passwall2_server reload trigger for non-procd /etc/init.d/passwall2_server Wed Oct 18 19:11:48 2023 user.notice ucitrack: Setting up /etc/config/pushbot reload trigger for non-procd /etc/init.d/pushbot Wed Oct 18 19:11:48 2023 user.notice ucitrack: Setting up /etc/config/shadowsocksr reload trigger for non-procd /etc/init.d/shadowsocksr Wed Oct 18 19:11:49 2023 user.notice ucitrack: Setting up /etc/config/turboacc reload trigger for non-procd /etc/init.d/turboacc Wed Oct 18 19:11:49 2023 user.notice ucitrack: Setting up /etc/config/usb_printer reload trigger for non-procd /etc/init.d/usb_printer Wed Oct 18 19:11:49 2023 user.notice ucitrack: Setting up /etc/config/v2ray_server reload trigger for non-procd /etc/init.d/v2ray_server Wed Oct 18 19:11:49 2023 user.notice ucitrack: Setting up /etc/config/vlmcsd reload trigger for non-procd /etc/init.d/kms Wed Oct 18 19:11:49 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to 0.0.0.0:443 failed (98: Address in use) Wed Oct 18 19:11:49 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to [::]:443 failed (98: Address in use) Wed Oct 18 19:11:49 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to 0.0.0.0:80 failed (98: Address in use) Wed Oct 18 19:11:49 2023 daemon.err nginx[2816]: 2023/10/18 19:11:47 [emerg] 2816#0: bind() to [::]:80 failed (98: Address in use) Wed Oct 18 19:11:49 2023 user.notice ucitrack: Setting up /etc/config/vsftpd reload trigger for non-procd /etc/init.d/vsftpd Wed Oct 18 19:11:49 2023 user.notice ucitrack: Setting up /etc/config/qbittorrent reload trigger for non-procd /etc/init.d/qbittorrent Wed Oct 18 19:11:49 2023 daemon.info avahi-daemon[2568]: Joining mDNS multicast group on interface wlan0.IPv6 with address fe80::9c62:57ff:fec3:ab02. Wed Oct 18 19:11:49 2023 daemon.info avahi-daemon[2568]: New relevant interface wlan0.IPv6 for mDNS. Wed Oct 18 19:11:49 2023 daemon.info avahi-daemon[2568]: Registering new address record for fe80::9c62:57ff:fec3:ab02 on wlan0.. Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: KMS Server has started. Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: Usage: uci [] [] Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: Commands: Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: batch Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: export [] Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: import [] Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: changes [] Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: commit [] Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: add Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: add_list .

.
.
[.
[.
[.
[[.
[.
[.
= Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: Options: Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: -c set the search path for config files (default: /etc/config) Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: -d set the delimiter for list values in uci show Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: -f use as input instead of stdin Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: -m when importing, merge data into an existing package Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: -n name unnamed sections on export (default) Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: -N don't name unnamed sections Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: -p add a search path for config change files Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: -P add a search path for config change files and use as default Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: -t set save path for config change files Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: -q quiet mode (don't print error messages) Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: -s force strict mode (stop on parser errors, default) Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: -S disable strict mode Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: -X do not use extended syntax on 'show' Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: Usage: uci [] [] Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: Commands: Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: batch Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: export [] Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: import [] Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: changes [] Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: commit [] Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: add Wed Oct 18 19:11:49 2023 daemon.notice procd: /etc/rc.d/S90kms: add_list .
.
devioa commented 11 months ago

找了台空闲设备试了一下,docker info中Cgroup Version显示为1的就无法显示资源状态

说反了吧

这个是能正常显示的系统日志和内核日志

这个问题没法反映到内核日志和系统日志里,你的日志我刚刚也看了,没什么参考价值

OldCoding commented 11 months ago

找了台空闲设备试了一下,docker info中Cgroup Version显示为1的就无法显示资源状态

说反了吧

这个是能正常显示的系统日志和内核日志

这个问题没法反映到内核日志和系统日志里,你的日志我刚刚也看了,没什么参考价值

说反了, Cgroup Version显示为2就无法正常显示

devioa commented 11 months ago

说反了, Cgroup Version显示为2就无法正常显示

那情况就是和我说的一模一样的

Diciya commented 10 months ago

不止是docker界面有这个问题,我的网心云也出现了这种问题,不过cpu核数也出现无法识别的情况 image

devioa commented 10 months ago

@Diciya 那你看下你的docker info打印信息里是不是Cgroup Version: 2docker stats是不是状态也全是0

Diciya commented 10 months ago

@Diciya 那你看下你的docker info打印信息里是不是Cgroup Version: 2docker stats是不是状态也全是0

root@ImmortalWrt:~# docker info Client: Version: 24.0.5 Context: default Debug Mode: false

Server: Containers: 1 Running: 1 Paused: 0 Stopped: 0 Images: 1 Server Version: 24.0.5 Storage Driver: overlay2 Backing Filesystem: extfs Supports d_type: true Using metacopy: false Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: cgroupfs Cgroup Version: 2 Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog Swarm: inactive Runtimes: runc io.containerd.runc.v2 Default Runtime: runc Init Binary: docker-init containerd version: runc version: init version: de40ad0 Security Options: seccomp Profile: builtin cgroupns Kernel Version: 6.1.57 Operating System: ImmortalWrt SNAPSHOT OSType: linux Architecture: aarch64 CPUs: 8 Total Memory: 7.576GiB Name: ImmortalWrt ID: 7a3284ee-5651-43c1-9da2-7de570bb2d9e Docker Root Dir: /opt/docker/ Debug Mode: false Experimental: false Insecure Registries: 127.0.0.0/8 Live Restore Enabled: false

WARNING: No memory limit support WARNING: No swap limit support WARNING: No cpu cfs quota support WARNING: No cpu cfs period support WARNING: No cpu shares support WARNING: No cpuset support WARNING: No io.weight support WARNING: No io.weight (per device) support WARNING: No io.max (rbps) support WARNING: No io.max (wbps) support WARNING: No io.max (riops) support WARNING: No io.max (wiops) support

devioa commented 10 months ago

你也是Cgroup Version: 2 那看来这个问题的原因很明显了

devioa commented 10 months ago

@Diciya 你再mount | grep cgroup看看打印的有哪些

Diciya commented 10 months ago

@Diciya 你再mount | grep cgroup看看打印的有哪些

root@ImmortalWrt:~# mount | grep cgroup cgroup2 on /sys/fs/cgroup type cgroup2 (rw,nosuid,nodev,noexec,relatime,nsdelegate) cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,relatime,cpuset) cgroup on /sys/fs/cgroup/cpu type cgroup (rw,relatime,cpu) cgroup on /sys/fs/cgroup/cpuacct type cgroup (rw,relatime,cpuacct) cgroup on /sys/fs/cgroup/blkio type cgroup (rw,relatime,blkio) cgroup on /sys/fs/cgroup/memory type cgroup (rw,relatime,memory) cgroup on /sys/fs/cgroup/devices type cgroup (rw,relatime,devices) cgroup on /sys/fs/cgroup/freezer type cgroup (rw,relatime,freezer) cgroup on /sys/fs/cgroup/net_cls type cgroup (rw,relatime,net_cls) cgroup on /sys/fs/cgroup/net_prio type cgroup (rw,relatime,net_prio) cgroup on /sys/fs/cgroup/pids type cgroup (rw,relatime,pids) cgroup on /sys/fs/cgroup/rdma type cgroup (rw,relatime,rdma)

Diciya commented 10 months ago

我的处理器是RK3588 这是ARM处理器,不知其他是否也存在相同问题

devioa commented 10 months ago

cgroup2 on /sys/fs/cgroup type cgroup2 (rw,nosuid,nodev,noexec,relatime,nsdelegate)

应该和这个cgroup2挂载有关 下面是我目前Cgroup Version: 1,资源状态显示正常的 cgroup 挂载状态

root@OpenWrt:~# mount|grep cgroup
cgroup on /sys/fs/cgroup type tmpfs (rw,relatime,mode=755)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,relatime,cpuset)
cgroup on /sys/fs/cgroup/cpu type cgroup (rw,relatime,cpu)
cgroup on /sys/fs/cgroup/cpuacct type cgroup (rw,relatime,cpuacct)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,relatime,blkio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,relatime,memory)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,relatime,devices)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls type cgroup (rw,relatime,net_cls)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,relatime,perf_event)
cgroup on /sys/fs/cgroup/net_prio type cgroup (rw,relatime,net_prio)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,relatime,hugetlb)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,relatime,pids)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,relatime,rdma)
cgroup on /sys/fs/cgroup/debug type cgroup (rw,relatime,debug)
devioa commented 10 months ago

但我 Ubuntu 也有挂载 cgroup2且是Cgroup Version: 1,但是挂载点不同

devioa@Devioa-Desktop:~$ mount | grep cgroup
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,size=4096k,nr_inodes=1024,mode=755)
cgroup2 on /sys/fs/cgroup/unified type cgroup2 (rw,nosuid,nodev,noexec,relatime,nsdelegate) ←这个是挂载在 unified 上的
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/cpu type cgroup (rw,nosuid,nodev,noexec,relatime,cpu)
cgroup on /sys/fs/cgroup/cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpuacct)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_prio)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,name=systemd)
devioa commented 10 months ago

不知道 openwrt 在哪儿去改这个cgroup2的挂载点,我感觉如果把这个挂载点改到 Ubuntu 那个位置可能就正常了 仅猜测,这块我实在懂得不多

devioa commented 10 months ago

@Diciya 你再ls /sys/fs/cgroup我看下