search

labring / sealos

Sealos is a production-ready Kubernetes distribution. You can run any Docker image on sealos, start high availability databases like mysql/pgsql/redis/mongo, develop applications using any Programming language.
https://cloud.sealos.io
Apache License 2.0
13.96k stars 2.07k forks source link

sealos 4.0 安装时 k8s.gcr.io 相关镜像 pull 报错，导入后也无法启动集群 #1440

Closed caixiaomao closed 2 years ago

caixiaomao commented 2 years ago

Which command or component sealos run labring/kubernetes:v1.24.3 --masters 81.70.253.133 --pk /home/tools/sealos/caixiaomao Snipaste_2022-07-31_22-22-47

The Description of the question 详细日志 sealos.log $ sealos run labring/kubernetes:v1.24.3 --masters 81.70.253.133 --pk /home/tools/sealos/caixiaomao 2022-07-31 16:55:59 [INFO] Start to create a new cluster: master [81.70.253.133], worker [] 2022-07-31 16:55:59 [INFO] Executing pipeline Check in CreateProcessor. 2022-07-31 16:55:59 [INFO] checker:hostname [81.70.253.133:22] 2022-07-31 16:55:59 [INFO] checker:timeSync [81.70.253.133:22] 2022-07-31 16:56:00 [INFO] Executing pipeline PreProcess in CreateProcessor. 32b8fcc13f968a4054ad0e69beaa1b6e35c74e8bed6494e2af64cfbcd89db884 default-wcuqxmyp 2022-07-31 16:56:00 [INFO] Executing pipeline RunConfig in CreateProcessor. 2022-07-31 16:56:00 [INFO] Executing pipeline MountRootfs in CreateProcessor. 81.70.253.133:22: INFO [2022-07-31 17:06:35] >> check root,port,cri success
81.70.253.133:22: Created symlink /etc/systemd/system/multi-user.target.wants/containerd.service → /etc/systemd/system/containerd.service. 81.70.253.133:22: INFO [2022-07-31 17:06:37] >> Health check containerd! 81.70.253.133:22: INFO [2022-07-31 17:06:37] >> containerd is running 81.70.253.133:22: INFO [2022-07-31 17:06:37] >> init containerd success 81.70.253.133:22: Created symlink /etc/systemd/system/multi-user.target.wants/image-cri-shim.service → /etc/systemd/system/image-cri-shim.service. 81.70.253.133:22: INFO [2022-07-31 17:06:37] >> Health check image-cri-shim! 81.70.253.133:22: INFO [2022-07-31 17:06:37] >> image-cri-shim is running 81.70.253.133:22: INFO [2022-07-31 17:06:37] >> init shim success 81.70.253.133:22: Applying /usr/lib/sysctl.d/50-pid-max.conf ... 81.70.253.133:22: kernel.pid_max = 4194304 81.70.253.133:22: Applying /etc/sysctl.d/99-sysctl.conf ... 81.70.253.133:22: kernel.core_uses_pid = 1 81.70.253.133:22: net.ipv4.ip_forward = 0 81.70.253.133:22: net.ipv6.conf.all.forwarding = 0 81.70.253.133:22: net.ipv4.conf.default.rp_filter = 1 81.70.253.133:22: kernel.msgmnb = 65536 81.70.253.133:22: kernel.msgmax = 65536 81.70.253.133:22: net.ipv4.conf.default.accept_source_route = 0 81.70.253.133:22: net.ipv4.tcp_syncookies = 1 81.70.253.133:22: net.ipv6.conf.all.disable_ipv6 = 0 81.70.253.133:22: net.ipv6.conf.default.disable_ipv6 = 0 81.70.253.133:22: net.ipv6.conf.lo.disable_ipv6 = 0 81.70.253.133:22: net.ipv4.conf.all.promote_secondaries = 1 81.70.253.133:22: net.ipv4.conf.default.promote_secondaries = 1 81.70.253.133:22: net.ipv6.neigh.default.gc_thresh3 = 4096 81.70.253.133:22: net.ipv4.neigh.default.gc_thresh3 = 4096 81.70.253.133:22: kernel.printk = 5 4 1 7 81.70.253.133:22: kernel.softlockup_panic = 1 81.70.253.133:22: kernel.sysrq = 1 81.70.253.133:22: Applying /etc/sysctl.d/k8s.conf ... 81.70.253.133:22: net.bridge.bridge-nf-call-ip6tables = 1 81.70.253.133:22: net.bridge.bridge-nf-call-iptables = 1 81.70.253.133:22: net.ipv4.conf.all.rp_filter = 0 81.70.253.133:22: Applying /usr/lib/sysctl.d/protect-links.conf ... 81.70.253.133:22: fs.protected_fifos = 1 81.70.253.133:22: fs.protected_hardlinks = 1 81.70.253.133:22: fs.protected_regular = 2 81.70.253.133:22: fs.protected_symlinks = 1 81.70.253.133:22: * Applying /etc/sysctl.conf ... 81.70.253.133:22: kernel.core_uses_pid = 1 81.70.253.133:22: net.ipv4.ip_forward = 0 81.70.253.133:22: net.ipv6.conf.all.forwarding = 0 81.70.253.133:22: net.ipv4.conf.default.rp_filter = 1 81.70.253.133:22: kernel.msgmnb = 65536 81.70.253.133:22: kernel.msgmax = 65536 81.70.253.133:22: net.ipv4.conf.default.accept_source_route = 0 81.70.253.133:22: net.ipv4.tcp_syncookies = 1 81.70.253.133:22: net.ipv6.conf.all.disable_ipv6 = 0 81.70.253.133:22: net.ipv6.conf.default.disable_ipv6 = 0 81.70.253.133:22: net.ipv6.conf.lo.disable_ipv6 = 0 81.70.253.133:22: net.ipv4.conf.all.promote_secondaries = 1 81.70.253.133:22: net.ipv4.conf.default.promote_secondaries = 1 81.70.253.133:22: net.ipv6.neigh.default.gc_thresh3 = 4096 81.70.253.133:22: net.ipv4.neigh.default.gc_thresh3 = 4096 81.70.253.133:22: kernel.printk = 5 4 1 7 81.70.253.133:22: kernel.softlockup_panic = 1 81.70.253.133:22: kernel.sysrq = 1 81.70.253.133:22: net.ipv4.ip_forward = 1 81.70.253.133:22: INFO [2022-07-31 17:06:37] >> init kube success 81.70.253.133:22: INFO [2022-07-31 17:06:37] >> init containerd rootfs success 2022-07-31 17:06:37 [INFO] Executing pipeline Init in CreateProcessor. 2022-07-31 17:06:37 [INFO] start to copy kubeadm config to master0 2022-07-31 17:06:38 [INFO] start to generate cert and kubeConfig... 5 it/s) 2022-07-31 17:06:38 [INFO] start to generator cert and copy to masters... 2022-07-31 17:06:39 [INFO] apiserver altNames : {map[apiserver.cluster.local:apiserver.cluster.local kubernetes:kubernetes kubernetes.default:kubernetes.default kubernetes.default.svc:kubernetes.default.svc kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local localhost:localhost tencent-81:tencent-81] map[10.103.97.2:10.103.97.2 10.96.0.1:10.96.0.1 127.0.0.1:127.0.0.1 81.70.253.133:81.70.253.133]} 2022-07-31 17:06:39 [INFO] Etcd altnames : {map[localhost:localhost tencent-81:tencent-81] map[127.0.0.1:127.0.0.1 81.70.253.133:81.70.253.133 ::1:::1]}, commonName : tencent-81 2022-07-31 17:06:40 [INFO] start to copy etc pki files to masters 2022-07-31 17:06:45 [INFO] start to create kubeconfig...
2022-07-31 17:06:46 [INFO] start to copy kubeconfig files to masters 2022-07-31 17:06:48 [INFO] start to copy static files to masters 4 it/s) 2022-07-31 17:06:48 [INFO] start to apply registry 81.70.253.133:22: unpacking docker.io/library/registry:2.7.1 (sha256:49bd6b1420deba16b51bd073977ea6ae4000b816a356b12e805a699c4e5d3dba)...done 81.70.253.133:22: a760590eb17ee0109a6a0537d3cff9f079b2b9c2a8507846823173f47227ec90 81.70.253.133:22: INFO [2022-07-31 17:06:50] >> init registry success 2022-07-31 17:06:50 [INFO] start to init master0... 2022-07-31 17:06:50 [INFO] registry auth in node 81.70.253.133:22 81.70.253.133:22: 2022-07-31T17:06:50 info domain sealos.hub:81.70.253.133 append success 81.70.253.133:22: 2022-07-31T17:06:50 info domain apiserver.cluster.local:81.70.253.133 append success 81.70.253.133:22: W0731 17:06:50.746876 290227 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration! 81.70.253.133:22: [init] Using Kubernetes version: v1.24.3 81.70.253.133:22: [preflight] Running pre-flight checks 81.70.253.133:22: [WARNING FileExisting-socat]: socat not found in system path 81.70.253.133:22: [WARNING SystemVerification]: missing optional cgroups: blkio 81.70.253.133:22: [preflight] Pulling images required for setting up a Kubernetes cluster 81.70.253.133:22: [preflight] This might take a minute or two, depending on the speed of your internet connection 81.70.253.133:22: [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' 81.70.253.133:22: error execution phase preflight: [preflight] Some fatal errors occurred: 81.70.253.133:22: [ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-apiserver:v1.24.3: output: time="2022-07-31T17:10:21+08:00" level=fatal msg="pulling image: rpc error: code = Unknown desc = failed to pull and unpack image \"k8s.gcr.io/kube-apiserver:v1.24.3\": failed to resolve reference \"k8s.gcr.io/kube-apiserver:v1.24.3\": failed to do request: Head \"https://k8s.gcr.io/v2/kube-apiserver/manifests/v1.24.3\": dial tcp 64.233.189.82:443: i/o timeout" 81.70.253.133:22: , error: exit status 1 81.70.253.133:22: [ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-controller-manager:v1.24.3: output: time="2022-07-31T17:13:51+08:00" level=fatal msg="pulling image: rpc error: code = Unknown desc = failed to pull and unpack image \"k8s.gcr.io/kube-controller-manager:v1.24.3\": failed to resolve reference \"k8s.gcr.io/kube-controller-manager:v1.24.3\": failed to do request: Head \"https://k8s.gcr.io/v2/kube-controller-manager/manifests/v1.24.3\": dial tcp 108.177.97.82:443: i/o timeout" 81.70.253.133:22: , error: exit status 1 81.70.253.133:22: [ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-scheduler:v1.24.3: output: time="2022-07-31T17:17:21+08:00" level=fatal msg="pulling image: rpc error: code = Unknown desc = failed to pull and unpack image \"k8s.gcr.io/kube-scheduler:v1.24.3\": failed to resolve reference \"k8s.gcr.io/kube-scheduler:v1.24.3\": failed to do request: Head \"https://k8s.gcr.io/v2/kube-scheduler/manifests/v1.24.3\": dial tcp 74.125.203.82:443: i/o timeout" 81.70.253.133:22: , error: exit status 1 81.70.253.133:22: [ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-proxy:v1.24.3: output: time="2022-07-31T17:20:51+08:00" level=fatal msg="pulling image: rpc error: code = Unknown desc = failed to pull and unpack image \"k8s.gcr.io/kube-proxy:v1.24.3\": failed to resolve reference \"k8s.gcr.io/kube-proxy:v1.24.3\": failed to do request: Head \"https://k8s.gcr.io/v2/kube-proxy/manifests/v1.24.3\": dial tcp 64.233.189.82:443: i/o timeout" 81.70.253.133:22: , error: exit status 1 81.70.253.133:22: [ERROR ImagePull]: failed to pull image k8s.gcr.io/pause:3.7: output: time="2022-07-31T17:24:21+08:00" level=fatal msg="pulling image: rpc error: code = Unknown desc = failed to pull and unpack image \"k8s.gcr.io/pause:3.7\": failed to resolve reference \"k8s.gcr.io/pause:3.7\": failed to do request: Head \"https://k8s.gcr.io/v2/pause/manifests/3.7\": dial tcp 108.177.97.82:443: i/o timeout" 81.70.253.133:22: , error: exit status 1 81.70.253.133:22: [ERROR ImagePull]: failed to pull image k8s.gcr.io/etcd:3.5.3-0: output: time="2022-07-31T17:27:51+08:00" level=fatal msg="pulling image: rpc error: code = Unknown desc = failed to pull and unpack image \"k8s.gcr.io/etcd:3.5.3-0\": failed to resolve reference \"k8s.gcr.io/etcd:3.5.3-0\": failed to do request: Head \"https://k8s.gcr.io/v2/etcd/manifests/3.5.3-0\": dial tcp 108.177.97.82:443: i/o timeout" 81.70.253.133:22: , error: exit status 1 81.70.253.133:22: [ERROR ImagePull]: failed to pull image k8s.gcr.io/coredns/coredns:v1.8.6: output: time="2022-07-31T17:31:22+08:00" level=fatal msg="pulling image: rpc error: code = Unknown desc = failed to pull and unpack image \"k8s.gcr.io/coredns/coredns:v1.8.6\": failed to resolve reference \"k8s.gcr.io/coredns/coredns:v1.8.6\": failed to do request: Head \"https://k8s.gcr.io/v2/coredns/coredns/manifests/v1.8.6\": dial tcp 142.250.157.82:443: i/o timeout" 81.70.253.133:22: , error: exit status 1 81.70.253.133:22: [preflight] If you know what you are doing, you can make a check non-fatal with --ignore-preflight-errors=... 81.70.253.133:22: To see the stack trace of this error execute with --v=5 or higher 2022-07-31 17:31:22 [EROR] Applied to cluster error: failed to init init master0 failed, error: failed to execute command(kubeadm init --config=/var/lib/sealos/data/default/etc/kubeadm-init.yaml --skip-certificate-key-print --skip-token-print -v 0 --ignore-preflight-errors=SystemVerification) on host(81.70.253.133:22): output(W0731 17:06:50.746876 290227 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration! [init] Using Kubernetes version: v1.24.3 [preflight] Running pre-flight checks [WARNING FileExisting-socat]: socat not found in system path [WARNING SystemVerification]: missing optional cgroups: blkio [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' error execution phase preflight: [preflight] Some fatal errors occurred: [ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-apiserver:v1.24.3: output: time="2022-07-31T17:10:21+08:00" level=fatal msg="pulling image: rpc error: code = Unknown desc = failed to pull and unpack image \"k8s.gcr.io/kube-apiserver:v1.24.3\": failed to resolve reference \"k8s.gcr.io/kube-apiserver:v1.24.3\": failed to do request: Head \"https://k8s.gcr.io/v2/kube-apiserver/manifests/v1.24.3\": dial tcp 64.233.189.82:443: i/o timeout" , error: exit status 1 [ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-controller-manager:v1.24.3: output: time="2022-07-31T17:13:51+08:00" level=fatal msg="pulling image: rpc error: code = Unknown desc = failed to pull and unpack image \"k8s.gcr.io/kube-controller-manager:v1.24.3\": failed to resolve reference \"k8s.gcr.io/kube-controller-manager:v1.24.3\": failed to do request: Head \"https://k8s.gcr.io/v2/kube-controller-manager/manifests/v1.24.3\": dial tcp 108.177.97.82:443: i/o timeout" , error: exit status 1 [ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-scheduler:v1.24.3: output: time="2022-07-31T17:17:21+08:00" level=fatal msg="pulling image: rpc error: code = Unknown desc = failed to pull and unpack image \"k8s.gcr.io/kube-scheduler:v1.24.3\": failed to resolve reference \"k8s.gcr.io/kube-scheduler:v1.24.3\": failed to do request: Head \"https://k8s.gcr.io/v2/kube-scheduler/manifests/v1.24.3\": dial tcp 74.125.203.82:443: i/o timeout" , error: exit status 1 [ERROR ImagePull]: failed to pull image k8s.gcr.io/kube-proxy:v1.24.3: output: time="2022-07-31T17:20:51+08:00" level=fatal msg="pulling image: rpc error: code = Unknown desc = failed to pull and unpack image \"k8s.gcr.io/kube-proxy:v1.24.3\": failed to resolve reference \"k8s.gcr.io/kube-proxy:v1.24.3\": failed to do request: Head \"https://k8s.gcr.io/v2/kube-proxy/manifests/v1.24.3\": dial tcp 64.233.189.82:443: i/o timeout" , error: exit status 1 [ERROR ImagePull]: failed to pull image k8s.gcr.io/pause:3.7: output: time="2022-07-31T17:24:21+08:00" level=fatal msg="pulling image: rpc error: code = Unknown desc = failed to pull and unpack image \"k8s.gcr.io/pause:3.7\": failed to resolve reference \"k8s.gcr.io/pause:3.7\": failed to do request: Head \"https://k8s.gcr.io/v2/pause/manifests/3.7\": dial tcp 108.177.97.82:443: i/o timeout" , error: exit status 1 [ERROR ImagePull]: failed to pull image k8s.gcr.io/etcd:3.5.3-0: output: time="2022-07-31T17:27:51+08:00" level=fatal msg="pulling image: rpc error: code = Unknown desc = failed to pull and unpack image \"k8s.gcr.io/etcd:3.5.3-0\": failed to resolve reference \"k8s.gcr.io/etcd:3.5.3-0\": failed to do request: Head \"https://k8s.gcr.io/v2/etcd/manifests/3.5.3-0\": dial tcp 108.177.97.82:443: i/o timeout" , error: exit status 1 [ERROR ImagePull]: failed to pull image k8s.gcr.io/coredns/coredns:v1.8.6: output: time="2022-07-31T17:31:22+08:00" level=fatal msg="pulling image: rpc error: code = Unknown desc = failed to pull and unpack image \"k8s.gcr.io/coredns/coredns:v1.8.6\": failed to resolve reference \"k8s.gcr.io/coredns/coredns:v1.8.6\": failed to do request: Head \"https://k8s.gcr.io/v2/coredns/coredns/manifests/v1.8.6\": dial tcp 142.250.157.82:443: i/o timeout" , error: exit status 1 [preflight] If you know what you are doing, you can make a check non-fatal with --ignore-preflight-errors=... To see the stack trace of this error execute with --v=5 or higher), error(Process exited with status 1). Please clean and reinstall

Some reference materials you see eg. the reference of the documentation

请问各位大大这种问题需要如何处理？

cuisongliu commented 2 years ago

如果是centos的话更新最新的k8s版本镜像

caixiaomao commented 2 years ago

如果是centos的话更新最新的k8s版本镜像

image 操作系统是 Debian 11,

cuisongliu commented 2 years ago

kubelet status 看一下

cuisongliu commented 2 years ago

image-cri-shim 日志发一下

zhangguanzhang commented 2 years ago

集群镜像最好还是不要用k8s.gcr.io这种公网的，如果私有化机器容量85%以上镜像被gc了就完蛋

cuisongliu commented 2 years ago

集群镜像最好还是不要用k8s.gcr.io这种公网的，如果私有化机器容量85%以上镜像被gc了就完蛋

无所谓应该是，虽然是这个名字，但是实际在私有仓库拉取的其实。

caixiaomao commented 2 years ago

kubelet status 看一下

image 没起来

zhangguanzhang commented 2 years ago 
journalctl -xe --no-pager -u kubelet
caixiaomao commented 2 years ago 
journalctl -xe --no-pager -u kubelet

执行了没有任何日志，就没有贴 😢

zhangguanzhang commented 2 years ago 
journalctl -xe --no-pager -u kubelet

执行了没有任何日志，就没有贴 😢

systemctl cat --no-pager kubelet

手动模拟，命令行前台启动下看看啥错误

caixiaomao commented 2 years ago 
journalctl -xe --no-pager -u kubelet

执行了没有任何日志，就没有贴 😢

systemctl cat --no-pager kubelet

手动模拟，命令行前台启动下看看啥错误

镜像仓库的好像是没有开防火墙端口，开了之后有其它的错误。日志如下： systemctl status kubelet：

image

journalctl -xe --no-pager -u kubelet：

Aug 01 15:10:31 tencent-81 kubelet[503854]: E0801 15:10:31.171872 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:31 tencent-81 kubelet[503854]: E0801 15:10:31.272255 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:31 tencent-81 kubelet[503854]: E0801 15:10:31.373001 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:31 tencent-81 kubelet[503854]: E0801 15:10:31.473660 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:31 tencent-81 kubelet[503854]: E0801 15:10:31.574112 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:31 tencent-81 kubelet[503854]: E0801 15:10:31.674592 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:31 tencent-81 kubelet[503854]: E0801 15:10:31.775074 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:31 tencent-81 kubelet[503854]: E0801 15:10:31.875760 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:31 tencent-81 kubelet[503854]: E0801 15:10:31.976242 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:32 tencent-81 kubelet[503854]: E0801 15:10:32.076712 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:32 tencent-81 kubelet[503854]: E0801 15:10:32.177124 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:32 tencent-81 kubelet[503854]: E0801 15:10:32.277227 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:32 tencent-81 kubelet[503854]: E0801 15:10:32.377917 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:32 tencent-81 kubelet[503854]: E0801 15:10:32.478593 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:32 tencent-81 kubelet[503854]: E0801 15:10:32.579075 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:32 tencent-81 kubelet[503854]: I0801 15:10:32.606025 503854 kubelet_node_status.go:70] "Attempting to register node" node="tencent-81" Aug 01 15:10:32 tencent-81 kubelet[503854]: E0801 15:10:32.679411 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:32 tencent-81 kubelet[503854]: E0801 15:10:32.779903 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:32 tencent-81 kubelet[503854]: E0801 15:10:32.880785 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:32 tencent-81 kubelet[503854]: E0801 15:10:32.981259 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:33 tencent-81 kubelet[503854]: E0801 15:10:33.081881 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:33 tencent-81 kubelet[503854]: E0801 15:10:33.182752 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:33 tencent-81 kubelet[503854]: E0801 15:10:33.283553 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:33 tencent-81 kubelet[503854]: E0801 15:10:33.384304 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:33 tencent-81 kubelet[503854]: E0801 15:10:33.484992 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:33 tencent-81 kubelet[503854]: E0801 15:10:33.585431 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:33 tencent-81 kubelet[503854]: E0801 15:10:33.685869 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:33 tencent-81 kubelet[503854]: I0801 15:10:33.749054 503854 scope.go:110] "RemoveContainer" containerID="bbc0f892a7af1b6be9bb815ab22d001aaec933f17e89f8228f607ffcecae1d97" Aug 01 15:10:33 tencent-81 kubelet[503854]: E0801 15:10:33.749346 503854 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"etcd\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=etcd pod=etcd-tencent-81_kube-system(6d93d9c376f28acdcdad3369076be65d)\"" pod="kube-system/etcd-tencent-81" podUID=6d93d9c376f28acdcdad3369076be65d Aug 01 15:10:33 tencent-81 kubelet[503854]: E0801 15:10:33.786433 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:33 tencent-81 kubelet[503854]: E0801 15:10:33.887124 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:33 tencent-81 kubelet[503854]: E0801 15:10:33.987584 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:34 tencent-81 kubelet[503854]: E0801 15:10:34.088066 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:34 tencent-81 kubelet[503854]: E0801 15:10:34.103739 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:10:34 tencent-81 kubelet[503854]: E0801 15:10:34.188260 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:34 tencent-81 kubelet[503854]: I0801 15:10:34.237688 503854 scope.go:110] "RemoveContainer" containerID="d1a9f0efc51d530f0860c5133e1df39636584f316313d2ef9b575012933dd29e" Aug 01 15:10:34 tencent-81 kubelet[503854]: E0801 15:10:34.238187 503854 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-apiserver pod=kube-apiserver-tencent-81_kube-system(d8e612d792c5144b9d433b6dac02724d)\"" pod="kube-system/kube-apiserver-tencent-81" podUID=d8e612d792c5144b9d433b6dac02724d Aug 01 15:10:34 tencent-81 kubelet[503854]: E0801 15:10:34.288983 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:34 tencent-81 kubelet[503854]: I0801 15:10:34.325742 503854 scope.go:110] "RemoveContainer" containerID="bbc0f892a7af1b6be9bb815ab22d001aaec933f17e89f8228f607ffcecae1d97" Aug 01 15:10:34 tencent-81 kubelet[503854]: E0801 15:10:34.326059 503854 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"etcd\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=etcd pod=etcd-tencent-81_kube-system(6d93d9c376f28acdcdad3369076be65d)\"" pod="kube-system/etcd-tencent-81" podUID=6d93d9c376f28acdcdad3369076be65d Aug 01 15:10:34 tencent-81 kubelet[503854]: E0801 15:10:34.389924 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:34 tencent-81 kubelet[503854]: E0801 15:10:34.490741 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:34 tencent-81 kubelet[503854]: E0801 15:10:34.591208 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:34 tencent-81 kubelet[503854]: E0801 15:10:34.691678 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:34 tencent-81 kubelet[503854]: E0801 15:10:34.792140 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:34 tencent-81 kubelet[503854]: E0801 15:10:34.892809 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:34 tencent-81 kubelet[503854]: E0801 15:10:34.993278 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:35 tencent-81 kubelet[503854]: E0801 15:10:35.093744 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:35 tencent-81 kubelet[503854]: E0801 15:10:35.194137 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:35 tencent-81 kubelet[503854]: E0801 15:10:35.294745 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:35 tencent-81 kubelet[503854]: E0801 15:10:35.395537 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:35 tencent-81 kubelet[503854]: E0801 15:10:35.495876 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:35 tencent-81 kubelet[503854]: E0801 15:10:35.596214 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:35 tencent-81 kubelet[503854]: E0801 15:10:35.696596 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:35 tencent-81 kubelet[503854]: E0801 15:10:35.796974 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:35 tencent-81 kubelet[503854]: E0801 15:10:35.897659 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:35 tencent-81 kubelet[503854]: E0801 15:10:35.998118 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:36 tencent-81 kubelet[503854]: E0801 15:10:36.098587 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:36 tencent-81 kubelet[503854]: E0801 15:10:36.199308 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:36 tencent-81 kubelet[503854]: E0801 15:10:36.300373 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:36 tencent-81 kubelet[503854]: E0801 15:10:36.401369 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:36 tencent-81 kubelet[503854]: E0801 15:10:36.502028 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:36 tencent-81 kubelet[503854]: E0801 15:10:36.518218 503854 controller.go:144] failed to ensure lease exists, will retry in 7s, error: Get "https://apiserver.cluster.local:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/tencent-81?timeout=10s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Aug 01 15:10:36 tencent-81 kubelet[503854]: E0801 15:10:36.602646 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:36 tencent-81 kubelet[503854]: E0801 15:10:36.703175 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:36 tencent-81 kubelet[503854]: E0801 15:10:36.803618 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:36 tencent-81 kubelet[503854]: E0801 15:10:36.904167 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:37 tencent-81 kubelet[503854]: E0801 15:10:37.004591 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:37 tencent-81 kubelet[503854]: E0801 15:10:37.105021 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:37 tencent-81 kubelet[503854]: E0801 15:10:37.205591 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:37 tencent-81 kubelet[503854]: E0801 15:10:37.306289 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:37 tencent-81 kubelet[503854]: E0801 15:10:37.407075 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:37 tencent-81 kubelet[503854]: E0801 15:10:37.507548 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:37 tencent-81 kubelet[503854]: E0801 15:10:37.607997 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:37 tencent-81 kubelet[503854]: E0801 15:10:37.708461 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:37 tencent-81 kubelet[503854]: E0801 15:10:37.808997 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:37 tencent-81 kubelet[503854]: E0801 15:10:37.909552 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:38 tencent-81 kubelet[503854]: E0801 15:10:38.010049 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:38 tencent-81 kubelet[503854]: E0801 15:10:38.110511 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:38 tencent-81 kubelet[503854]: E0801 15:10:38.211162 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:38 tencent-81 kubelet[503854]: E0801 15:10:38.311913 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:38 tencent-81 kubelet[503854]: E0801 15:10:38.412444 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:38 tencent-81 kubelet[503854]: E0801 15:10:38.513265 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:38 tencent-81 kubelet[503854]: E0801 15:10:38.613742 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:38 tencent-81 kubelet[503854]: E0801 15:10:38.714227 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:38 tencent-81 kubelet[503854]: E0801 15:10:38.814970 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:38 tencent-81 kubelet[503854]: E0801 15:10:38.915038 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:39 tencent-81 kubelet[503854]: E0801 15:10:39.015491 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:39 tencent-81 kubelet[503854]: E0801 15:10:39.024683 503854 eviction_manager.go:254] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"tencent-81\" not found" Aug 01 15:10:39 tencent-81 kubelet[503854]: E0801 15:10:39.104101 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:10:39 tencent-81 kubelet[503854]: E0801 15:10:39.116506 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:39 tencent-81 kubelet[503854]: E0801 15:10:39.217159 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:39 tencent-81 kubelet[503854]: E0801 15:10:39.317917 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:39 tencent-81 kubelet[503854]: E0801 15:10:39.418865 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:39 tencent-81 kubelet[503854]: E0801 15:10:39.519277 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:39 tencent-81 kubelet[503854]: E0801 15:10:39.619829 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:39 tencent-81 kubelet[503854]: E0801 15:10:39.720291 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:39 tencent-81 kubelet[503854]: E0801 15:10:39.820886 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:39 tencent-81 kubelet[503854]: E0801 15:10:39.921435 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:40 tencent-81 kubelet[503854]: E0801 15:10:40.021927 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:40 tencent-81 kubelet[503854]: E0801 15:10:40.122320 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:40 tencent-81 kubelet[503854]: E0801 15:10:40.223406 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:40 tencent-81 kubelet[503854]: E0801 15:10:40.324162 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:40 tencent-81 kubelet[503854]: E0801 15:10:40.424895 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:40 tencent-81 kubelet[503854]: E0801 15:10:40.525736 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:40 tencent-81 kubelet[503854]: E0801 15:10:40.626204 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:40 tencent-81 kubelet[503854]: E0801 15:10:40.726711 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:40 tencent-81 kubelet[503854]: E0801 15:10:40.827330 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:40 tencent-81 kubelet[503854]: E0801 15:10:40.927903 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:41 tencent-81 kubelet[503854]: E0801 15:10:41.028463 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:41 tencent-81 kubelet[503854]: E0801 15:10:41.128922 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:41 tencent-81 kubelet[503854]: E0801 15:10:41.229387 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:41 tencent-81 kubelet[503854]: E0801 15:10:41.330463 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:41 tencent-81 kubelet[503854]: E0801 15:10:41.431032 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:41 tencent-81 kubelet[503854]: E0801 15:10:41.531501 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:41 tencent-81 kubelet[503854]: E0801 15:10:41.632274 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:41 tencent-81 kubelet[503854]: E0801 15:10:41.732715 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:41 tencent-81 kubelet[503854]: E0801 15:10:41.833291 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:41 tencent-81 kubelet[503854]: E0801 15:10:41.933841 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:42 tencent-81 kubelet[503854]: E0801 15:10:42.034316 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:42 tencent-81 kubelet[503854]: E0801 15:10:42.134774 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:42 tencent-81 kubelet[503854]: E0801 15:10:42.235388 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:42 tencent-81 kubelet[503854]: E0801 15:10:42.336024 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:42 tencent-81 kubelet[503854]: E0801 15:10:42.436801 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:42 tencent-81 kubelet[503854]: E0801 15:10:42.537277 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:42 tencent-81 kubelet[503854]: E0801 15:10:42.637917 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:42 tencent-81 kubelet[503854]: E0801 15:10:42.738392 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:42 tencent-81 kubelet[503854]: E0801 15:10:42.839012 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:42 tencent-81 kubelet[503854]: E0801 15:10:42.939573 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:43 tencent-81 kubelet[503854]: E0801 15:10:43.040188 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:43 tencent-81 kubelet[503854]: E0801 15:10:43.140656 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:43 tencent-81 kubelet[503854]: E0801 15:10:43.241388 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:43 tencent-81 kubelet[503854]: E0801 15:10:43.342020 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:43 tencent-81 kubelet[503854]: E0801 15:10:43.442968 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:43 tencent-81 kubelet[503854]: E0801 15:10:43.543113 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:43 tencent-81 kubelet[503854]: E0801 15:10:43.643184 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:43 tencent-81 kubelet[503854]: E0801 15:10:43.743679 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:43 tencent-81 kubelet[503854]: E0801 15:10:43.844413 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:43 tencent-81 kubelet[503854]: E0801 15:10:43.944999 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:44 tencent-81 kubelet[503854]: E0801 15:10:44.045442 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:44 tencent-81 kubelet[503854]: E0801 15:10:44.105461 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:10:44 tencent-81 kubelet[503854]: E0801 15:10:44.145913 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:44 tencent-81 kubelet[503854]: E0801 15:10:44.246758 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:44 tencent-81 kubelet[503854]: E0801 15:10:44.347395 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:44 tencent-81 kubelet[503854]: E0801 15:10:44.448159 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:44 tencent-81 kubelet[503854]: E0801 15:10:44.548980 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:44 tencent-81 kubelet[503854]: E0801 15:10:44.649450 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:44 tencent-81 kubelet[503854]: E0801 15:10:44.749919 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:44 tencent-81 kubelet[503854]: E0801 15:10:44.850585 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:44 tencent-81 kubelet[503854]: E0801 15:10:44.951208 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:45 tencent-81 kubelet[503854]: E0801 15:10:45.051749 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:45 tencent-81 kubelet[503854]: E0801 15:10:45.152236 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:45 tencent-81 kubelet[503854]: E0801 15:10:45.252978 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:45 tencent-81 kubelet[503854]: E0801 15:10:45.353840 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:45 tencent-81 kubelet[503854]: E0801 15:10:45.454624 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:45 tencent-81 kubelet[503854]: E0801 15:10:45.555083 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:45 tencent-81 kubelet[503854]: E0801 15:10:45.655549 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:45 tencent-81 kubelet[503854]: E0801 15:10:45.755963 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:45 tencent-81 kubelet[503854]: E0801 15:10:45.856586 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:45 tencent-81 kubelet[503854]: E0801 15:10:45.957562 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:46 tencent-81 kubelet[503854]: E0801 15:10:46.058031 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:46 tencent-81 kubelet[503854]: E0801 15:10:46.158484 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:46 tencent-81 kubelet[503854]: I0801 15:10:46.237284 503854 scope.go:110] "RemoveContainer" containerID="d1a9f0efc51d530f0860c5133e1df39636584f316313d2ef9b575012933dd29e" Aug 01 15:10:46 tencent-81 kubelet[503854]: E0801 15:10:46.237760 503854 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-apiserver pod=kube-apiserver-tencent-81_kube-system(d8e612d792c5144b9d433b6dac02724d)\"" pod="kube-system/kube-apiserver-tencent-81" podUID=d8e612d792c5144b9d433b6dac02724d Aug 01 15:10:46 tencent-81 kubelet[503854]: E0801 15:10:46.259359 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:46 tencent-81 kubelet[503854]: E0801 15:10:46.360000 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:46 tencent-81 kubelet[503854]: E0801 15:10:46.460667 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:46 tencent-81 kubelet[503854]: E0801 15:10:46.561085 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:46 tencent-81 kubelet[503854]: E0801 15:10:46.661403 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:46 tencent-81 kubelet[503854]: E0801 15:10:46.761762 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:46 tencent-81 kubelet[503854]: E0801 15:10:46.862390 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:46 tencent-81 kubelet[503854]: E0801 15:10:46.962829 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:47 tencent-81 kubelet[503854]: E0801 15:10:47.063308 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:47 tencent-81 kubelet[503854]: E0801 15:10:47.163766 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:47 tencent-81 kubelet[503854]: E0801 15:10:47.264496 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:47 tencent-81 kubelet[503854]: E0801 15:10:47.365118 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:47 tencent-81 kubelet[503854]: E0801 15:10:47.465804 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:47 tencent-81 kubelet[503854]: E0801 15:10:47.566293 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:47 tencent-81 kubelet[503854]: E0801 15:10:47.666776 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:47 tencent-81 kubelet[503854]: E0801 15:10:47.767410 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:47 tencent-81 kubelet[503854]: E0801 15:10:47.868147 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:47 tencent-81 kubelet[503854]: E0801 15:10:47.968619 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:48 tencent-81 kubelet[503854]: E0801 15:10:48.069109 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:48 tencent-81 kubelet[503854]: E0801 15:10:48.169579 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:48 tencent-81 kubelet[503854]: E0801 15:10:48.270339 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:48 tencent-81 kubelet[503854]: W0801 15:10:48.275577 503854 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list v1.CSIDriver: Get "https://apiserver.cluster.local:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 81.70.253.133:6443: i/o timeout Aug 01 15:10:48 tencent-81 kubelet[503854]: I0801 15:10:48.275664 503854 trace.go:205] Trace[370566960]: "Reflector ListAndWatch" name:vendor/k8s.io/client-go/informers/factory.go:134 (01-Aug-2022 15:10:18.274) (total time: 30001ms): Aug 01 15:10:48 tencent-81 kubelet[503854]: Trace[370566960]: ---"Objects listed" error:Get "https://apiserver.cluster.local:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 81.70.253.133:6443: i/o timeout 30001ms (15:10:48.275) Aug 01 15:10:48 tencent-81 kubelet[503854]: Trace[370566960]: [30.001431279s] [30.001431279s] END Aug 01 15:10:48 tencent-81 kubelet[503854]: E0801 15:10:48.275676 503854 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch v1.CSIDriver: failed to list v1.CSIDriver: Get "https://apiserver.cluster.local:6443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 81.70.253.133:6443: i/o timeout Aug 01 15:10:48 tencent-81 kubelet[503854]: E0801 15:10:48.371356 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:48 tencent-81 kubelet[503854]: E0801 15:10:48.472234 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:48 tencent-81 kubelet[503854]: E0801 15:10:48.573132 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:48 tencent-81 kubelet[503854]: E0801 15:10:48.673599 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:48 tencent-81 kubelet[503854]: E0801 15:10:48.774111 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:48 tencent-81 kubelet[503854]: E0801 15:10:48.874206 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:48 tencent-81 kubelet[503854]: E0801 15:10:48.974834 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:49 tencent-81 kubelet[503854]: E0801 15:10:49.025041 503854 eviction_manager.go:254] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"tencent-81\" not found" Aug 01 15:10:49 tencent-81 kubelet[503854]: E0801 15:10:49.075457 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:49 tencent-81 kubelet[503854]: E0801 15:10:49.106161 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:10:49 tencent-81 kubelet[503854]: E0801 15:10:49.175688 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:49 tencent-81 kubelet[503854]: I0801 15:10:49.237050 503854 scope.go:110] "RemoveContainer" containerID="bbc0f892a7af1b6be9bb815ab22d001aaec933f17e89f8228f607ffcecae1d97" Aug 01 15:10:49 tencent-81 kubelet[503854]: E0801 15:10:49.237349 503854 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"etcd\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=etcd pod=etcd-tencent-81_kube-system(6d93d9c376f28acdcdad3369076be65d)\"" pod="kube-system/etcd-tencent-81" podUID=6d93d9c376f28acdcdad3369076be65d Aug 01 15:10:49 tencent-81 kubelet[503854]: E0801 15:10:49.276389 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:49 tencent-81 kubelet[503854]: E0801 15:10:49.377076 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:49 tencent-81 kubelet[503854]: E0801 15:10:49.477673 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:49 tencent-81 kubelet[503854]: E0801 15:10:49.578135 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:49 tencent-81 kubelet[503854]: E0801 15:10:49.678605 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:49 tencent-81 kubelet[503854]: E0801 15:10:49.779106 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:49 tencent-81 kubelet[503854]: E0801 15:10:49.879195 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:49 tencent-81 kubelet[503854]: E0801 15:10:49.979667 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:50 tencent-81 kubelet[503854]: E0801 15:10:50.031970 503854 certificate_manager.go:471] kubernetes.io/kube-apiserver-client-kubelet: Failed while requesting a signed certificate from the control plane: cannot create certificate signing request: Post "https://apiserver.cluster.local:6443/apis/certificates.k8s.io/v1/certificatesigningrequests": dial tcp 81.70.253.133:6443: i/o timeout Aug 01 15:10:50 tencent-81 kubelet[503854]: E0801 15:10:50.080284 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:50 tencent-81 kubelet[503854]: E0801 15:10:50.181250 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:50 tencent-81 kubelet[503854]: E0801 15:10:50.282145 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:50 tencent-81 kubelet[503854]: E0801 15:10:50.383064 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:50 tencent-81 kubelet[503854]: E0801 15:10:50.483679 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:50 tencent-81 kubelet[503854]: E0801 15:10:50.584111 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:50 tencent-81 kubelet[503854]: E0801 15:10:50.684606 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:50 tencent-81 kubelet[503854]: E0801 15:10:50.785115 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:50 tencent-81 kubelet[503854]: E0801 15:10:50.885865 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:50 tencent-81 kubelet[503854]: E0801 15:10:50.986488 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:51 tencent-81 kubelet[503854]: E0801 15:10:51.086981 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:51 tencent-81 kubelet[503854]: E0801 15:10:51.146246 503854 event.go:276] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"tencent-81.1707265abc89fa66", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), DeletionTimestamp:, DeletionGracePeriodSeconds:(int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ZZZ_DeprecatedClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tencent-81", UID:"tencent-81", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"InvalidDiskCapacity", Message:"invalid capacity 0 on image filesystem", Source:v1.EventSource{Component:"kubelet", Host:"tencent-81"}, FirstTimestamp:time.Date(2022, time.August, 1, 14, 59, 18, 861388390, time.Local), LastTimestamp:time.Date(2022, time.August, 1, 14, 59, 18, 861388390, time.Local), Count:1, Type:"Warning", EventTime:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Series:(v1.EventSeries)(nil), Action:"", Related:(v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Post "https://apiserver.cluster.local:6443/api/v1/namespaces/default/events": dial tcp 81.70.253.133:6443: i/o timeout'(may retry after sleeping) Aug 01 15:10:51 tencent-81 kubelet[503854]: E0801 15:10:51.187586 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:51 tencent-81 kubelet[503854]: E0801 15:10:51.287856 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:51 tencent-81 kubelet[503854]: E0801 15:10:51.388911 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:51 tencent-81 kubelet[503854]: E0801 15:10:51.489423 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:51 tencent-81 kubelet[503854]: E0801 15:10:51.589883 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:51 tencent-81 kubelet[503854]: E0801 15:10:51.690358 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:51 tencent-81 kubelet[503854]: E0801 15:10:51.790867 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:51 tencent-81 kubelet[503854]: E0801 15:10:51.891491 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:51 tencent-81 kubelet[503854]: E0801 15:10:51.991968 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:52 tencent-81 kubelet[503854]: E0801 15:10:52.092528 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:52 tencent-81 kubelet[503854]: E0801 15:10:52.192939 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:52 tencent-81 kubelet[503854]: E0801 15:10:52.293552 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:52 tencent-81 kubelet[503854]: E0801 15:10:52.394457 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:52 tencent-81 kubelet[503854]: E0801 15:10:52.494887 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:52 tencent-81 kubelet[503854]: E0801 15:10:52.595770 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:52 tencent-81 kubelet[503854]: E0801 15:10:52.696287 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:52 tencent-81 kubelet[503854]: E0801 15:10:52.796741 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:52 tencent-81 kubelet[503854]: E0801 15:10:52.897624 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:52 tencent-81 kubelet[503854]: E0801 15:10:52.998097 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:53 tencent-81 kubelet[503854]: E0801 15:10:53.098709 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:53 tencent-81 kubelet[503854]: E0801 15:10:53.199171 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:53 tencent-81 kubelet[503854]: E0801 15:10:53.299963 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:53 tencent-81 kubelet[503854]: E0801 15:10:53.400837 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:53 tencent-81 kubelet[503854]: E0801 15:10:53.501448 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:53 tencent-81 kubelet[503854]: E0801 15:10:53.519647 503854 controller.go:144] failed to ensure lease exists, will retry in 7s, error: Get "https://apiserver.cluster.local:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/tencent-81?timeout=10s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Aug 01 15:10:53 tencent-81 kubelet[503854]: E0801 15:10:53.602092 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:53 tencent-81 kubelet[503854]: E0801 15:10:53.702970 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:53 tencent-81 kubelet[503854]: E0801 15:10:53.803605 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:53 tencent-81 kubelet[503854]: E0801 15:10:53.904147 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:54 tencent-81 kubelet[503854]: E0801 15:10:54.004627 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:54 tencent-81 kubelet[503854]: E0801 15:10:54.105089 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:54 tencent-81 kubelet[503854]: E0801 15:10:54.107661 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:10:54 tencent-81 kubelet[503854]: E0801 15:10:54.206188 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:54 tencent-81 kubelet[503854]: E0801 15:10:54.306989 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:54 tencent-81 kubelet[503854]: I0801 15:10:54.308159 503854 status_manager.go:664] "Failed to get status for pod" podUID=6d93d9c376f28acdcdad3369076be65d pod="kube-system/etcd-tencent-81" err="Get \"https://apiserver.cluster.local:6443/api/v1/namespaces/kube-system/pods/etcd-tencent-81\": dial tcp 81.70.253.133:6443: i/o timeout" Aug 01 15:10:54 tencent-81 kubelet[503854]: E0801 15:10:54.407874 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:54 tencent-81 kubelet[503854]: E0801 15:10:54.508253 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:54 tencent-81 kubelet[503854]: E0801 15:10:54.608712 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:54 tencent-81 kubelet[503854]: E0801 15:10:54.709159 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:54 tencent-81 kubelet[503854]: E0801 15:10:54.809758 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:54 tencent-81 kubelet[503854]: E0801 15:10:54.910353 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:55 tencent-81 kubelet[503854]: E0801 15:10:55.010814 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:55 tencent-81 kubelet[503854]: E0801 15:10:55.111257 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:55 tencent-81 kubelet[503854]: E0801 15:10:55.211880 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:55 tencent-81 kubelet[503854]: E0801 15:10:55.312673 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:55 tencent-81 kubelet[503854]: E0801 15:10:55.413695 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:55 tencent-81 kubelet[503854]: E0801 15:10:55.514157 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:55 tencent-81 kubelet[503854]: E0801 15:10:55.614593 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:55 tencent-81 kubelet[503854]: E0801 15:10:55.715434 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:55 tencent-81 kubelet[503854]: E0801 15:10:55.816030 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:55 tencent-81 kubelet[503854]: E0801 15:10:55.916571 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:56 tencent-81 kubelet[503854]: E0801 15:10:56.017022 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:56 tencent-81 kubelet[503854]: E0801 15:10:56.117477 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:56 tencent-81 kubelet[503854]: E0801 15:10:56.218102 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:56 tencent-81 kubelet[503854]: E0801 15:10:56.318831 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:56 tencent-81 kubelet[503854]: E0801 15:10:56.419429 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:56 tencent-81 kubelet[503854]: E0801 15:10:56.519867 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:56 tencent-81 kubelet[503854]: E0801 15:10:56.620310 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:56 tencent-81 kubelet[503854]: E0801 15:10:56.720786 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:56 tencent-81 kubelet[503854]: E0801 15:10:56.821407 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:56 tencent-81 kubelet[503854]: E0801 15:10:56.921950 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:57 tencent-81 kubelet[503854]: E0801 15:10:57.022407 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:57 tencent-81 kubelet[503854]: E0801 15:10:57.122862 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:57 tencent-81 kubelet[503854]: E0801 15:10:57.223486 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:57 tencent-81 kubelet[503854]: I0801 15:10:57.237782 503854 scope.go:110] "RemoveContainer" containerID="d1a9f0efc51d530f0860c5133e1df39636584f316313d2ef9b575012933dd29e" Aug 01 15:10:57 tencent-81 kubelet[503854]: E0801 15:10:57.238287 503854 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-apiserver pod=kube-apiserver-tencent-81_kube-system(d8e612d792c5144b9d433b6dac02724d)\"" pod="kube-system/kube-apiserver-tencent-81" podUID=d8e612d792c5144b9d433b6dac02724d Aug 01 15:10:57 tencent-81 kubelet[503854]: E0801 15:10:57.324315 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:57 tencent-81 kubelet[503854]: E0801 15:10:57.425030 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:57 tencent-81 kubelet[503854]: E0801 15:10:57.525656 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:57 tencent-81 kubelet[503854]: E0801 15:10:57.626074 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:57 tencent-81 kubelet[503854]: E0801 15:10:57.726527 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:57 tencent-81 kubelet[503854]: E0801 15:10:57.827310 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:57 tencent-81 kubelet[503854]: E0801 15:10:57.927900 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:58 tencent-81 kubelet[503854]: E0801 15:10:58.028300 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:58 tencent-81 kubelet[503854]: E0801 15:10:58.128777 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:58 tencent-81 kubelet[503854]: E0801 15:10:58.229390 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:58 tencent-81 kubelet[503854]: E0801 15:10:58.330118 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:58 tencent-81 kubelet[503854]: E0801 15:10:58.431145 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:58 tencent-81 kubelet[503854]: E0801 15:10:58.531584 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:58 tencent-81 kubelet[503854]: E0801 15:10:58.632071 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:58 tencent-81 kubelet[503854]: E0801 15:10:58.732681 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:58 tencent-81 kubelet[503854]: E0801 15:10:58.833422 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:58 tencent-81 kubelet[503854]: E0801 15:10:58.934214 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:59 tencent-81 kubelet[503854]: E0801 15:10:59.025694 503854 eviction_manager.go:254] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"tencent-81\" not found" Aug 01 15:10:59 tencent-81 kubelet[503854]: E0801 15:10:59.034825 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:59 tencent-81 kubelet[503854]: E0801 15:10:59.108985 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:10:59 tencent-81 kubelet[503854]: E0801 15:10:59.135219 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:59 tencent-81 kubelet[503854]: E0801 15:10:59.235827 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:59 tencent-81 kubelet[503854]: E0801 15:10:59.336592 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:59 tencent-81 kubelet[503854]: E0801 15:10:59.437303 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:59 tencent-81 kubelet[503854]: E0801 15:10:59.537773 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:59 tencent-81 kubelet[503854]: E0801 15:10:59.638230 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:59 tencent-81 kubelet[503854]: E0801 15:10:59.738686 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:59 tencent-81 kubelet[503854]: E0801 15:10:59.839294 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:10:59 tencent-81 kubelet[503854]: E0801 15:10:59.939877 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:00 tencent-81 kubelet[503854]: E0801 15:11:00.040335 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:00 tencent-81 kubelet[503854]: E0801 15:11:00.140783 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:00 tencent-81 kubelet[503854]: E0801 15:11:00.240880 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:00 tencent-81 kubelet[503854]: E0801 15:11:00.341478 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:00 tencent-81 kubelet[503854]: E0801 15:11:00.442219 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:00 tencent-81 kubelet[503854]: E0801 15:11:00.542828 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:00 tencent-81 kubelet[503854]: E0801 15:11:00.643329 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:00 tencent-81 kubelet[503854]: E0801 15:11:00.743834 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:00 tencent-81 kubelet[503854]: E0801 15:11:00.844458 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:00 tencent-81 kubelet[503854]: E0801 15:11:00.945089 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:01 tencent-81 kubelet[503854]: E0801 15:11:01.045867 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:01 tencent-81 kubelet[503854]: E0801 15:11:01.146317 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:01 tencent-81 kubelet[503854]: E0801 15:11:01.247195 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:01 tencent-81 kubelet[503854]: E0801 15:11:01.348323 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:01 tencent-81 kubelet[503854]: E0801 15:11:01.449021 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:01 tencent-81 kubelet[503854]: E0801 15:11:01.549507 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:01 tencent-81 kubelet[503854]: E0801 15:11:01.649951 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:01 tencent-81 kubelet[503854]: E0801 15:11:01.750388 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:01 tencent-81 kubelet[503854]: E0801 15:11:01.850975 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:01 tencent-81 kubelet[503854]: E0801 15:11:01.951580 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:02 tencent-81 kubelet[503854]: E0801 15:11:02.052016 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:02 tencent-81 kubelet[503854]: E0801 15:11:02.152475 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:02 tencent-81 kubelet[503854]: E0801 15:11:02.253201 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:02 tencent-81 kubelet[503854]: E0801 15:11:02.353769 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:02 tencent-81 kubelet[503854]: E0801 15:11:02.454681 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:02 tencent-81 kubelet[503854]: E0801 15:11:02.555172 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:02 tencent-81 kubelet[503854]: E0801 15:11:02.606563 503854 kubelet_node_status.go:92] "Unable to register node with API server" err="Post \"https://apiserver.cluster.local:6443/api/v1/nodes\": dial tcp 81.70.253.133:6443: i/o timeout" node="tencent-81" Aug 01 15:11:02 tencent-81 kubelet[503854]: E0801 15:11:02.655760 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:02 tencent-81 kubelet[503854]: E0801 15:11:02.756256 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:02 tencent-81 kubelet[503854]: E0801 15:11:02.856364 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:02 tencent-81 kubelet[503854]: E0801 15:11:02.956909 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:03 tencent-81 kubelet[503854]: E0801 15:11:03.057420 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:03 tencent-81 kubelet[503854]: E0801 15:11:03.157880 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:03 tencent-81 kubelet[503854]: E0801 15:11:03.258562 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:03 tencent-81 kubelet[503854]: E0801 15:11:03.359156 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:03 tencent-81 kubelet[503854]: E0801 15:11:03.460274 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:03 tencent-81 kubelet[503854]: E0801 15:11:03.560698 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:03 tencent-81 kubelet[503854]: E0801 15:11:03.661517 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:03 tencent-81 kubelet[503854]: E0801 15:11:03.762050 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:03 tencent-81 kubelet[503854]: E0801 15:11:03.862668 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:03 tencent-81 kubelet[503854]: E0801 15:11:03.963063 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:04 tencent-81 kubelet[503854]: E0801 15:11:04.063517 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:04 tencent-81 kubelet[503854]: E0801 15:11:04.110217 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:11:04 tencent-81 kubelet[503854]: E0801 15:11:04.164612 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:04 tencent-81 kubelet[503854]: I0801 15:11:04.237157 503854 scope.go:110] "RemoveContainer" containerID="bbc0f892a7af1b6be9bb815ab22d001aaec933f17e89f8228f607ffcecae1d97" Aug 01 15:11:04 tencent-81 kubelet[503854]: E0801 15:11:04.237442 503854 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"etcd\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=etcd pod=etcd-tencent-81_kube-system(6d93d9c376f28acdcdad3369076be65d)\"" pod="kube-system/etcd-tencent-81" podUID=6d93d9c376f28acdcdad3369076be65d Aug 01 15:11:04 tencent-81 kubelet[503854]: E0801 15:11:04.265452 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:04 tencent-81 kubelet[503854]: E0801 15:11:04.366121 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:04 tencent-81 kubelet[503854]: E0801 15:11:04.466996 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:04 tencent-81 kubelet[503854]: W0801 15:11:04.562535 503854 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list v1.RuntimeClass: Get "https://apiserver.cluster.local:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 81.70.253.133:6443: i/o timeout Aug 01 15:11:04 tencent-81 kubelet[503854]: I0801 15:11:04.562612 503854 trace.go:205] Trace[145535232]: "Reflector ListAndWatch" name:vendor/k8s.io/client-go/informers/factory.go:134 (01-Aug-2022 15:10:34.562) (total time: 30000ms): Aug 01 15:11:04 tencent-81 kubelet[503854]: Trace[145535232]: ---"Objects listed" error:Get "https://apiserver.cluster.local:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 81.70.253.133:6443: i/o timeout 30000ms (15:11:04.562) Aug 01 15:11:04 tencent-81 kubelet[503854]: Trace[145535232]: [30.000550178s] [30.000550178s] END Aug 01 15:11:04 tencent-81 kubelet[503854]: E0801 15:11:04.562625 503854 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch v1.RuntimeClass: failed to list v1.RuntimeClass: Get "https://apiserver.cluster.local:6443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 81.70.253.133:6443: i/o timeout Aug 01 15:11:04 tencent-81 kubelet[503854]: E0801 15:11:04.567582 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:04 tencent-81 kubelet[503854]: E0801 15:11:04.668069 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:04 tencent-81 kubelet[503854]: E0801 15:11:04.768545 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:04 tencent-81 kubelet[503854]: E0801 15:11:04.869194 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:04 tencent-81 kubelet[503854]: E0801 15:11:04.969651 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:05 tencent-81 kubelet[503854]: E0801 15:11:05.070121 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:05 tencent-81 kubelet[503854]: E0801 15:11:05.170758 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:05 tencent-81 kubelet[503854]: E0801 15:11:05.271328 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:05 tencent-81 kubelet[503854]: E0801 15:11:05.371939 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:05 tencent-81 kubelet[503854]: E0801 15:11:05.472284 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:05 tencent-81 kubelet[503854]: E0801 15:11:05.572756 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:05 tencent-81 kubelet[503854]: E0801 15:11:05.673242 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:05 tencent-81 kubelet[503854]: E0801 15:11:05.773729 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:05 tencent-81 kubelet[503854]: E0801 15:11:05.874443 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:05 tencent-81 kubelet[503854]: E0801 15:11:05.974923 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:06 tencent-81 kubelet[503854]: E0801 15:11:06.075405 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:06 tencent-81 kubelet[503854]: E0801 15:11:06.175906 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:06 tencent-81 kubelet[503854]: E0801 15:11:06.276845 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:06 tencent-81 kubelet[503854]: E0801 15:11:06.377518 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:06 tencent-81 kubelet[503854]: W0801 15:11:06.449399 503854 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list v1.Node: Get "https://apiserver.cluster.local:6443/api/v1/nodes?fieldSelector=metadata.name%3Dtencent-81&limit=500&resourceVersion=0": dial tcp 81.70.253.133:6443: i/o timeout Aug 01 15:11:06 tencent-81 kubelet[503854]: I0801 15:11:06.449475 503854 trace.go:205] Trace[1235295913]: "Reflector ListAndWatch" name:vendor/k8s.io/client-go/informers/factory.go:134 (01-Aug-2022 15:10:36.448) (total time: 30000ms): Aug 01 15:11:06 tencent-81 kubelet[503854]: Trace[1235295913]: ---"Objects listed" error:Get "https://apiserver.cluster.local:6443/api/v1/nodes?fieldSelector=metadata.name%3Dtencent-81&limit=500&resourceVersion=0": dial tcp 81.70.253.133:6443: i/o timeout 30000ms (15:11:06.449) Aug 01 15:11:06 tencent-81 kubelet[503854]: Trace[1235295913]: [30.000950864s] [30.000950864s] END Aug 01 15:11:06 tencent-81 kubelet[503854]: E0801 15:11:06.449486 503854 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch v1.Node: failed to list v1.Node: Get "https://apiserver.cluster.local:6443/api/v1/nodes?fieldSelector=metadata.name%3Dtencent-81&limit=500&resourceVersion=0": dial tcp 81.70.253.133:6443: i/o timeout Aug 01 15:11:06 tencent-81 kubelet[503854]: E0801 15:11:06.477617 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:06 tencent-81 kubelet[503854]: E0801 15:11:06.578135 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:06 tencent-81 kubelet[503854]: E0801 15:11:06.678636 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:06 tencent-81 kubelet[503854]: E0801 15:11:06.779193 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:06 tencent-81 kubelet[503854]: E0801 15:11:06.879867 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:06 tencent-81 kubelet[503854]: E0801 15:11:06.980354 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:07 tencent-81 kubelet[503854]: E0801 15:11:07.080839 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:07 tencent-81 kubelet[503854]: E0801 15:11:07.181260 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:07 tencent-81 kubelet[503854]: E0801 15:11:07.282361 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:07 tencent-81 kubelet[503854]: E0801 15:11:07.383113 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:07 tencent-81 kubelet[503854]: E0801 15:11:07.483727 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:07 tencent-81 kubelet[503854]: E0801 15:11:07.584132 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:07 tencent-81 kubelet[503854]: E0801 15:11:07.684619 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:07 tencent-81 kubelet[503854]: E0801 15:11:07.785125 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:07 tencent-81 kubelet[503854]: E0801 15:11:07.885859 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:07 tencent-81 kubelet[503854]: E0801 15:11:07.986343 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:08 tencent-81 kubelet[503854]: E0801 15:11:08.086818 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:08 tencent-81 kubelet[503854]: E0801 15:11:08.187301 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:08 tencent-81 kubelet[503854]: E0801 15:11:08.288078 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:08 tencent-81 kubelet[503854]: E0801 15:11:08.389095 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:08 tencent-81 kubelet[503854]: E0801 15:11:08.489906 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:08 tencent-81 kubelet[503854]: E0801 15:11:08.590418 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:08 tencent-81 kubelet[503854]: E0801 15:11:08.690906 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:08 tencent-81 kubelet[503854]: E0801 15:11:08.791393 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:08 tencent-81 kubelet[503854]: E0801 15:11:08.892318 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:08 tencent-81 kubelet[503854]: E0801 15:11:08.992790 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:09 tencent-81 kubelet[503854]: E0801 15:11:09.025971 503854 eviction_manager.go:254] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"tencent-81\" not found" Aug 01 15:11:09 tencent-81 kubelet[503854]: E0801 15:11:09.093402 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:09 tencent-81 kubelet[503854]: E0801 15:11:09.111175 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:11:09 tencent-81 kubelet[503854]: E0801 15:11:09.193677 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:09 tencent-81 kubelet[503854]: E0801 15:11:09.294438 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:09 tencent-81 kubelet[503854]: E0801 15:11:09.395501 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:09 tencent-81 kubelet[503854]: E0801 15:11:09.496144 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:09 tencent-81 kubelet[503854]: E0801 15:11:09.596570 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:09 tencent-81 kubelet[503854]: I0801 15:11:09.607486 503854 kubelet_node_status.go:70] "Attempting to register node" node="tencent-81" Aug 01 15:11:09 tencent-81 kubelet[503854]: E0801 15:11:09.696933 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:09 tencent-81 kubelet[503854]: E0801 15:11:09.797679 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:09 tencent-81 kubelet[503854]: E0801 15:11:09.898634 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:09 tencent-81 kubelet[503854]: E0801 15:11:09.999035 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:10 tencent-81 kubelet[503854]: E0801 15:11:10.099494 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:10 tencent-81 kubelet[503854]: E0801 15:11:10.199827 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:10 tencent-81 kubelet[503854]: I0801 15:11:10.237290 503854 scope.go:110] "RemoveContainer" containerID="d1a9f0efc51d530f0860c5133e1df39636584f316313d2ef9b575012933dd29e" Aug 01 15:11:10 tencent-81 kubelet[503854]: E0801 15:11:10.238513 503854 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-apiserver pod=kube-apiserver-tencent-81_kube-system(d8e612d792c5144b9d433b6dac02724d)\"" pod="kube-system/kube-apiserver-tencent-81" podUID=d8e612d792c5144b9d433b6dac02724d Aug 01 15:11:10 tencent-81 kubelet[503854]: E0801 15:11:10.300752 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:10 tencent-81 kubelet[503854]: E0801 15:11:10.401605 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:10 tencent-81 kubelet[503854]: E0801 15:11:10.502069 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:10 tencent-81 kubelet[503854]: E0801 15:11:10.521291 503854 controller.go:144] failed to ensure lease exists, will retry in 7s, error: Get "https://apiserver.cluster.local:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/tencent-81?timeout=10s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Aug 01 15:11:10 tencent-81 kubelet[503854]: E0801 15:11:10.602768 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:10 tencent-81 kubelet[503854]: E0801 15:11:10.703233 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:10 tencent-81 kubelet[503854]: E0801 15:11:10.803708 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:10 tencent-81 kubelet[503854]: E0801 15:11:10.904267 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:11 tencent-81 kubelet[503854]: E0801 15:11:11.004872 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:11 tencent-81 kubelet[503854]: E0801 15:11:11.105292 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:11 tencent-81 kubelet[503854]: E0801 15:11:11.205754 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:11 tencent-81 kubelet[503854]: E0801 15:11:11.306154 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:11 tencent-81 kubelet[503854]: E0801 15:11:11.406792 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:11 tencent-81 kubelet[503854]: E0801 15:11:11.507259 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:11 tencent-81 kubelet[503854]: E0801 15:11:11.607716 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:11 tencent-81 kubelet[503854]: E0801 15:11:11.708176 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:11 tencent-81 kubelet[503854]: E0801 15:11:11.808778 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:11 tencent-81 kubelet[503854]: E0801 15:11:11.909348 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:12 tencent-81 kubelet[503854]: E0801 15:11:12.009836 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:12 tencent-81 kubelet[503854]: E0801 15:11:12.110319 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:12 tencent-81 kubelet[503854]: E0801 15:11:12.210784 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:12 tencent-81 kubelet[503854]: E0801 15:11:12.311854 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:12 tencent-81 kubelet[503854]: E0801 15:11:12.412508 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:12 tencent-81 kubelet[503854]: E0801 15:11:12.513005 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:12 tencent-81 kubelet[503854]: E0801 15:11:12.613445 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:12 tencent-81 kubelet[503854]: E0801 15:11:12.713923 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:12 tencent-81 kubelet[503854]: E0801 15:11:12.814616 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:12 tencent-81 kubelet[503854]: E0801 15:11:12.915348 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:13 tencent-81 kubelet[503854]: E0801 15:11:13.015792 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:13 tencent-81 kubelet[503854]: E0801 15:11:13.116355 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:13 tencent-81 kubelet[503854]: E0801 15:11:13.216809 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:13 tencent-81 kubelet[503854]: E0801 15:11:13.317433 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:13 tencent-81 kubelet[503854]: E0801 15:11:13.418066 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:13 tencent-81 kubelet[503854]: E0801 15:11:13.518687 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:13 tencent-81 kubelet[503854]: E0801 15:11:13.619135 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:13 tencent-81 kubelet[503854]: E0801 15:11:13.719607 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:13 tencent-81 kubelet[503854]: E0801 15:11:13.819687 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:13 tencent-81 kubelet[503854]: E0801 15:11:13.920241 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:14 tencent-81 kubelet[503854]: E0801 15:11:14.020718 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:14 tencent-81 kubelet[503854]: E0801 15:11:14.111902 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:11:14 tencent-81 kubelet[503854]: E0801 15:11:14.121090 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:14 tencent-81 kubelet[503854]: E0801 15:11:14.221712 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:14 tencent-81 kubelet[503854]: E0801 15:11:14.322400 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:14 tencent-81 kubelet[503854]: E0801 15:11:14.422933 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:14 tencent-81 kubelet[503854]: E0801 15:11:14.523329 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:14 tencent-81 kubelet[503854]: E0801 15:11:14.623798 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:14 tencent-81 kubelet[503854]: E0801 15:11:14.724243 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:14 tencent-81 kubelet[503854]: E0801 15:11:14.824877 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:14 tencent-81 kubelet[503854]: E0801 15:11:14.925443 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:15 tencent-81 kubelet[503854]: E0801 15:11:15.025923 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:15 tencent-81 kubelet[503854]: E0801 15:11:15.126322 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:15 tencent-81 kubelet[503854]: E0801 15:11:15.227085 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:15 tencent-81 kubelet[503854]: E0801 15:11:15.327851 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:15 tencent-81 kubelet[503854]: E0801 15:11:15.428403 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:15 tencent-81 kubelet[503854]: E0801 15:11:15.528852 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:15 tencent-81 kubelet[503854]: E0801 15:11:15.629312 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:15 tencent-81 kubelet[503854]: E0801 15:11:15.729764 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:15 tencent-81 kubelet[503854]: E0801 15:11:15.830384 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:15 tencent-81 kubelet[503854]: E0801 15:11:15.930964 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:16 tencent-81 kubelet[503854]: E0801 15:11:16.031480 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:16 tencent-81 kubelet[503854]: E0801 15:11:16.131910 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:16 tencent-81 kubelet[503854]: E0801 15:11:16.232602 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:16 tencent-81 kubelet[503854]: E0801 15:11:16.333406 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:16 tencent-81 kubelet[503854]: E0801 15:11:16.434267 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:16 tencent-81 kubelet[503854]: E0801 15:11:16.534716 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:16 tencent-81 kubelet[503854]: E0801 15:11:16.635160 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:16 tencent-81 kubelet[503854]: E0801 15:11:16.735664 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:16 tencent-81 kubelet[503854]: E0801 15:11:16.836240 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:16 tencent-81 kubelet[503854]: E0801 15:11:16.936774 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:17 tencent-81 kubelet[503854]: E0801 15:11:17.037304 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:17 tencent-81 kubelet[503854]: E0801 15:11:17.137767 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:17 tencent-81 kubelet[503854]: I0801 15:11:17.237835 503854 scope.go:110] "RemoveContainer" containerID="bbc0f892a7af1b6be9bb815ab22d001aaec933f17e89f8228f607ffcecae1d97" Aug 01 15:11:17 tencent-81 kubelet[503854]: E0801 15:11:17.238149 503854 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"etcd\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=etcd pod=etcd-tencent-81_kube-system(6d93d9c376f28acdcdad3369076be65d)\"" pod="kube-system/etcd-tencent-81" podUID=6d93d9c376f28acdcdad3369076be65d Aug 01 15:11:17 tencent-81 kubelet[503854]: E0801 15:11:17.238149 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:17 tencent-81 kubelet[503854]: E0801 15:11:17.338727 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:17 tencent-81 kubelet[503854]: E0801 15:11:17.439442 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:17 tencent-81 kubelet[503854]: E0801 15:11:17.540044 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:17 tencent-81 kubelet[503854]: E0801 15:11:17.640535 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:17 tencent-81 kubelet[503854]: E0801 15:11:17.740994 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:17 tencent-81 kubelet[503854]: E0801 15:11:17.841609 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:17 tencent-81 kubelet[503854]: E0801 15:11:17.942210 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:18 tencent-81 kubelet[503854]: E0801 15:11:18.042676 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:18 tencent-81 kubelet[503854]: E0801 15:11:18.143163 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:18 tencent-81 kubelet[503854]: E0801 15:11:18.243964 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:18 tencent-81 kubelet[503854]: E0801 15:11:18.344530 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:18 tencent-81 kubelet[503854]: E0801 15:11:18.445444 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:18 tencent-81 kubelet[503854]: E0801 15:11:18.545951 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:18 tencent-81 kubelet[503854]: E0801 15:11:18.646432 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:18 tencent-81 kubelet[503854]: E0801 15:11:18.746916 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:18 tencent-81 kubelet[503854]: E0801 15:11:18.847941 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:18 tencent-81 kubelet[503854]: E0801 15:11:18.948592 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:19 tencent-81 kubelet[503854]: E0801 15:11:19.026507 503854 eviction_manager.go:254] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"tencent-81\" not found" Aug 01 15:11:19 tencent-81 kubelet[503854]: E0801 15:11:19.049618 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:19 tencent-81 kubelet[503854]: E0801 15:11:19.112728 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:11:19 tencent-81 kubelet[503854]: E0801 15:11:19.149892 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:19 tencent-81 kubelet[503854]: E0801 15:11:19.250624 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:19 tencent-81 kubelet[503854]: E0801 15:11:19.351179 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:19 tencent-81 kubelet[503854]: E0801 15:11:19.452039 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:19 tencent-81 kubelet[503854]: E0801 15:11:19.552520 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:19 tencent-81 kubelet[503854]: E0801 15:11:19.652979 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:19 tencent-81 kubelet[503854]: E0801 15:11:19.753439 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:19 tencent-81 kubelet[503854]: E0801 15:11:19.854089 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:19 tencent-81 kubelet[503854]: E0801 15:11:19.954782 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:20 tencent-81 kubelet[503854]: E0801 15:11:20.055247 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:20 tencent-81 kubelet[503854]: E0801 15:11:20.155853 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:20 tencent-81 kubelet[503854]: E0801 15:11:20.256767 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:20 tencent-81 kubelet[503854]: E0801 15:11:20.357375 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:20 tencent-81 kubelet[503854]: E0801 15:11:20.457995 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:20 tencent-81 kubelet[503854]: E0801 15:11:20.558422 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:20 tencent-81 kubelet[503854]: E0801 15:11:20.659274 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:20 tencent-81 kubelet[503854]: E0801 15:11:20.760107 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:20 tencent-81 kubelet[503854]: E0801 15:11:20.860863 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:20 tencent-81 kubelet[503854]: E0801 15:11:20.961262 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:21 tencent-81 kubelet[503854]: E0801 15:11:21.061775 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:21 tencent-81 kubelet[503854]: E0801 15:11:21.162195 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:21 tencent-81 kubelet[503854]: I0801 15:11:21.237780 503854 scope.go:110] "RemoveContainer" containerID="d1a9f0efc51d530f0860c5133e1df39636584f316313d2ef9b575012933dd29e" Aug 01 15:11:21 tencent-81 kubelet[503854]: E0801 15:11:21.238263 503854 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-apiserver pod=kube-apiserver-tencent-81_kube-system(d8e612d792c5144b9d433b6dac02724d)\"" pod="kube-system/kube-apiserver-tencent-81" podUID=d8e612d792c5144b9d433b6dac02724d Aug 01 15:11:21 tencent-81 kubelet[503854]: E0801 15:11:21.262403 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:21 tencent-81 kubelet[503854]: E0801 15:11:21.362974 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:21 tencent-81 kubelet[503854]: E0801 15:11:21.463938 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:21 tencent-81 kubelet[503854]: E0801 15:11:21.564410 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:21 tencent-81 kubelet[503854]: E0801 15:11:21.664890 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:21 tencent-81 kubelet[503854]: E0801 15:11:21.765375 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:21 tencent-81 kubelet[503854]: E0801 15:11:21.866148 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:21 tencent-81 kubelet[503854]: E0801 15:11:21.966631 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:22 tencent-81 kubelet[503854]: E0801 15:11:22.032050 503854 certificate_manager.go:471] kubernetes.io/kube-apiserver-client-kubelet: Failed while requesting a signed certificate from the control plane: cannot create certificate signing request: Post "https://apiserver.cluster.local:6443/apis/certificates.k8s.io/v1/certificatesigningrequests": dial tcp 81.70.253.133:6443: i/o timeout Aug 01 15:11:22 tencent-81 kubelet[503854]: E0801 15:11:22.067319 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:22 tencent-81 kubelet[503854]: E0801 15:11:22.167799 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:22 tencent-81 kubelet[503854]: E0801 15:11:22.268552 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:22 tencent-81 kubelet[503854]: E0801 15:11:22.369133 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:22 tencent-81 kubelet[503854]: E0801 15:11:22.469796 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:22 tencent-81 kubelet[503854]: E0801 15:11:22.570288 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:22 tencent-81 kubelet[503854]: E0801 15:11:22.670770 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:22 tencent-81 kubelet[503854]: E0801 15:11:22.771243 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:22 tencent-81 kubelet[503854]: E0801 15:11:22.872144 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:22 tencent-81 kubelet[503854]: E0801 15:11:22.972622 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:23 tencent-81 kubelet[503854]: E0801 15:11:23.073224 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:23 tencent-81 kubelet[503854]: E0801 15:11:23.173639 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:23 tencent-81 kubelet[503854]: E0801 15:11:23.274229 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:23 tencent-81 kubelet[503854]: E0801 15:11:23.374932 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:23 tencent-81 kubelet[503854]: E0801 15:11:23.475848 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:23 tencent-81 kubelet[503854]: E0801 15:11:23.576329 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:23 tencent-81 kubelet[503854]: E0801 15:11:23.677187 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:23 tencent-81 kubelet[503854]: E0801 15:11:23.777756 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:23 tencent-81 kubelet[503854]: E0801 15:11:23.878338 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:23 tencent-81 kubelet[503854]: E0801 15:11:23.978782 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:24 tencent-81 kubelet[503854]: E0801 15:11:24.079367 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:24 tencent-81 kubelet[503854]: E0801 15:11:24.114144 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:11:24 tencent-81 kubelet[503854]: E0801 15:11:24.179657 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:24 tencent-81 kubelet[503854]: E0801 15:11:24.280412 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:24 tencent-81 kubelet[503854]: E0801 15:11:24.381020 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:24 tencent-81 kubelet[503854]: E0801 15:11:24.481700 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:24 tencent-81 kubelet[503854]: E0801 15:11:24.582143 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:24 tencent-81 kubelet[503854]: E0801 15:11:24.682613 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:24 tencent-81 kubelet[503854]: E0801 15:11:24.783083 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:24 tencent-81 kubelet[503854]: E0801 15:11:24.883768 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:24 tencent-81 kubelet[503854]: E0801 15:11:24.984237 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:25 tencent-81 kubelet[503854]: E0801 15:11:25.084730 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:25 tencent-81 kubelet[503854]: E0801 15:11:25.185123 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:25 tencent-81 kubelet[503854]: E0801 15:11:25.285854 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:25 tencent-81 kubelet[503854]: E0801 15:11:25.386473 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:25 tencent-81 kubelet[503854]: E0801 15:11:25.487081 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:25 tencent-81 kubelet[503854]: E0801 15:11:25.587554 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:25 tencent-81 kubelet[503854]: E0801 15:11:25.688096 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:25 tencent-81 kubelet[503854]: E0801 15:11:25.788581 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:25 tencent-81 kubelet[503854]: E0801 15:11:25.889262 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:25 tencent-81 kubelet[503854]: E0801 15:11:25.989705 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:26 tencent-81 kubelet[503854]: E0801 15:11:26.090157 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:26 tencent-81 kubelet[503854]: E0801 15:11:26.190748 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:26 tencent-81 kubelet[503854]: E0801 15:11:26.291489 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:26 tencent-81 kubelet[503854]: E0801 15:11:26.392418 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:26 tencent-81 kubelet[503854]: E0801 15:11:26.492832 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:26 tencent-81 kubelet[503854]: E0801 15:11:26.593276 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:26 tencent-81 kubelet[503854]: E0801 15:11:26.693759 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:26 tencent-81 kubelet[503854]: E0801 15:11:26.794172 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:26 tencent-81 kubelet[503854]: E0801 15:11:26.894854 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:26 tencent-81 kubelet[503854]: E0801 15:11:26.995323 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:27 tencent-81 kubelet[503854]: E0801 15:11:27.095794 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:27 tencent-81 kubelet[503854]: E0801 15:11:27.196256 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:27 tencent-81 kubelet[503854]: E0801 15:11:27.297026 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:27 tencent-81 kubelet[503854]: E0801 15:11:27.397276 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:27 tencent-81 kubelet[503854]: E0801 15:11:27.497660 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:27 tencent-81 kubelet[503854]: E0801 15:11:27.522860 503854 controller.go:144] failed to ensure lease exists, will retry in 7s, error: Get "https://apiserver.cluster.local:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/tencent-81?timeout=10s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Aug 01 15:11:27 tencent-81 kubelet[503854]: E0801 15:11:27.598194 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:27 tencent-81 kubelet[503854]: E0801 15:11:27.698585 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:27 tencent-81 kubelet[503854]: E0801 15:11:27.798990 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:27 tencent-81 kubelet[503854]: E0801 15:11:27.899692 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:28 tencent-81 kubelet[503854]: E0801 15:11:28.000140 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:28 tencent-81 kubelet[503854]: E0801 15:11:28.100610 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:28 tencent-81 kubelet[503854]: E0801 15:11:28.201070 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:28 tencent-81 kubelet[503854]: E0801 15:11:28.301815 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:28 tencent-81 kubelet[503854]: E0801 15:11:28.402042 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:28 tencent-81 kubelet[503854]: E0801 15:11:28.502701 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:28 tencent-81 kubelet[503854]: E0801 15:11:28.603160 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:28 tencent-81 kubelet[503854]: E0801 15:11:28.703637 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:28 tencent-81 kubelet[503854]: E0801 15:11:28.804518 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:28 tencent-81 kubelet[503854]: E0801 15:11:28.905274 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:29 tencent-81 kubelet[503854]: E0801 15:11:29.005724 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:29 tencent-81 kubelet[503854]: E0801 15:11:29.026924 503854 eviction_manager.go:254] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"tencent-81\" not found" Aug 01 15:11:29 tencent-81 kubelet[503854]: E0801 15:11:29.106288 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:29 tencent-81 kubelet[503854]: E0801 15:11:29.115000 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:11:29 tencent-81 kubelet[503854]: E0801 15:11:29.206626 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:29 tencent-81 kubelet[503854]: E0801 15:11:29.307619 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:29 tencent-81 kubelet[503854]: E0801 15:11:29.408388 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:29 tencent-81 kubelet[503854]: E0801 15:11:29.508707 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:29 tencent-81 kubelet[503854]: E0801 15:11:29.609168 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:29 tencent-81 kubelet[503854]: E0801 15:11:29.709621 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:29 tencent-81 kubelet[503854]: E0801 15:11:29.810180 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:29 tencent-81 kubelet[503854]: E0801 15:11:29.910733 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:30 tencent-81 kubelet[503854]: E0801 15:11:30.011203 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:30 tencent-81 kubelet[503854]: E0801 15:11:30.111689 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:30 tencent-81 kubelet[503854]: E0801 15:11:30.212433 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:30 tencent-81 kubelet[503854]: E0801 15:11:30.313398 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:30 tencent-81 kubelet[503854]: E0801 15:11:30.414351 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:30 tencent-81 kubelet[503854]: E0801 15:11:30.515099 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:30 tencent-81 kubelet[503854]: E0801 15:11:30.615536 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:30 tencent-81 kubelet[503854]: E0801 15:11:30.715993 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:30 tencent-81 kubelet[503854]: E0801 15:11:30.816656 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:30 tencent-81 kubelet[503854]: E0801 15:11:30.917269 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:31 tencent-81 kubelet[503854]: E0801 15:11:31.017855 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:31 tencent-81 kubelet[503854]: E0801 15:11:31.118320 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:31 tencent-81 kubelet[503854]: E0801 15:11:31.147540 503854 event.go:276] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"tencent-81.1707265abc89fa66", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), DeletionTimestamp:, DeletionGracePeriodSeconds:(int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ZZZ_DeprecatedClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"tencent-81", UID:"tencent-81", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"InvalidDiskCapacity", Message:"invalid capacity 0 on image filesystem", Source:v1.EventSource{Component:"kubelet", Host:"tencent-81"}, FirstTimestamp:time.Date(2022, time.August, 1, 14, 59, 18, 861388390, time.Local), LastTimestamp:time.Date(2022, time.August, 1, 14, 59, 18, 861388390, time.Local), Count:1, Type:"Warning", EventTime:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Series:(v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Post "https://apiserver.cluster.local:6443/api/v1/namespaces/default/events": dial tcp 81.70.253.133:6443: i/o timeout'(may retry after sleeping) Aug 01 15:11:31 tencent-81 kubelet[503854]: E0801 15:11:31.219031 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:31 tencent-81 kubelet[503854]: I0801 15:11:31.237494 503854 scope.go:110] "RemoveContainer" containerID="bbc0f892a7af1b6be9bb815ab22d001aaec933f17e89f8228f607ffcecae1d97" Aug 01 15:11:31 tencent-81 kubelet[503854]: E0801 15:11:31.237810 503854 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"etcd\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=etcd pod=etcd-tencent-81_kube-system(6d93d9c376f28acdcdad3369076be65d)\"" pod="kube-system/etcd-tencent-81" podUID=6d93d9c376f28acdcdad3369076be65d Aug 01 15:11:31 tencent-81 kubelet[503854]: E0801 15:11:31.319933 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:31 tencent-81 kubelet[503854]: E0801 15:11:31.420620 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:31 tencent-81 kubelet[503854]: E0801 15:11:31.521058 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:31 tencent-81 kubelet[503854]: E0801 15:11:31.621499 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:31 tencent-81 kubelet[503854]: E0801 15:11:31.721933 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:31 tencent-81 kubelet[503854]: E0801 15:11:31.822465 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:31 tencent-81 kubelet[503854]: E0801 15:11:31.922980 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:32 tencent-81 kubelet[503854]: E0801 15:11:32.023436 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:32 tencent-81 kubelet[503854]: E0801 15:11:32.123877 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:32 tencent-81 kubelet[503854]: E0801 15:11:32.224273 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:32 tencent-81 kubelet[503854]: I0801 15:11:32.237637 503854 scope.go:110] "RemoveContainer" containerID="d1a9f0efc51d530f0860c5133e1df39636584f316313d2ef9b575012933dd29e" Aug 01 15:11:32 tencent-81 kubelet[503854]: E0801 15:11:32.238132 503854 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-apiserver pod=kube-apiserver-tencent-81_kube-system(d8e612d792c5144b9d433b6dac02724d)\"" pod="kube-system/kube-apiserver-tencent-81" podUID=d8e612d792c5144b9d433b6dac02724d Aug 01 15:11:32 tencent-81 kubelet[503854]: E0801 15:11:32.325188 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:32 tencent-81 kubelet[503854]: E0801 15:11:32.425954 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:32 tencent-81 kubelet[503854]: E0801 15:11:32.526421 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:32 tencent-81 kubelet[503854]: E0801 15:11:32.626890 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:32 tencent-81 kubelet[503854]: E0801 15:11:32.727291 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:32 tencent-81 kubelet[503854]: E0801 15:11:32.828051 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:32 tencent-81 kubelet[503854]: E0801 15:11:32.928603 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:33 tencent-81 kubelet[503854]: E0801 15:11:33.029211 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:33 tencent-81 kubelet[503854]: E0801 15:11:33.129681 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:33 tencent-81 kubelet[503854]: E0801 15:11:33.230564 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:33 tencent-81 kubelet[503854]: E0801 15:11:33.331213 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:33 tencent-81 kubelet[503854]: E0801 15:11:33.432241 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:33 tencent-81 kubelet[503854]: E0801 15:11:33.532769 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:33 tencent-81 kubelet[503854]: E0801 15:11:33.633218 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:33 tencent-81 kubelet[503854]: E0801 15:11:33.733688 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:33 tencent-81 kubelet[503854]: E0801 15:11:33.834425 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:33 tencent-81 kubelet[503854]: E0801 15:11:33.934984 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:34 tencent-81 kubelet[503854]: E0801 15:11:34.035441 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:34 tencent-81 kubelet[503854]: E0801 15:11:34.116349 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:11:34 tencent-81 kubelet[503854]: E0801 15:11:34.135555 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:34 tencent-81 kubelet[503854]: E0801 15:11:34.236100 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:34 tencent-81 kubelet[503854]: E0801 15:11:34.336723 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:34 tencent-81 kubelet[503854]: E0801 15:11:34.437462 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:34 tencent-81 kubelet[503854]: E0801 15:11:34.538074 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:34 tencent-81 kubelet[503854]: E0801 15:11:34.638517 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:34 tencent-81 kubelet[503854]: E0801 15:11:34.738990 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:34 tencent-81 kubelet[503854]: E0801 15:11:34.839698 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:34 tencent-81 kubelet[503854]: E0801 15:11:34.940290 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:35 tencent-81 kubelet[503854]: E0801 15:11:35.040789 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:35 tencent-81 kubelet[503854]: E0801 15:11:35.141246 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:35 tencent-81 kubelet[503854]: E0801 15:11:35.242157 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:35 tencent-81 kubelet[503854]: E0801 15:11:35.342761 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:35 tencent-81 kubelet[503854]: E0801 15:11:35.443204 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:35 tencent-81 kubelet[503854]: E0801 15:11:35.543625 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:35 tencent-81 kubelet[503854]: E0801 15:11:35.644092 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:35 tencent-81 kubelet[503854]: E0801 15:11:35.744581 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:35 tencent-81 kubelet[503854]: E0801 15:11:35.845177 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:35 tencent-81 kubelet[503854]: E0801 15:11:35.945778 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:36 tencent-81 kubelet[503854]: E0801 15:11:36.046238 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:36 tencent-81 kubelet[503854]: E0801 15:11:36.146718 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:36 tencent-81 kubelet[503854]: E0801 15:11:36.247762 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:36 tencent-81 kubelet[503854]: E0801 15:11:36.348436 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:36 tencent-81 kubelet[503854]: W0801 15:11:36.429237 503854 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list v1.Service: Get "https://apiserver.cluster.local:6443/api/v1/services?limit=500&resourceVersion=0": dial tcp 81.70.253.133:6443: i/o timeout Aug 01 15:11:36 tencent-81 kubelet[503854]: I0801 15:11:36.429326 503854 trace.go:205] Trace[88323491]: "Reflector ListAndWatch" name:vendor/k8s.io/client-go/informers/factory.go:134 (01-Aug-2022 15:11:06.428) (total time: 30000ms): Aug 01 15:11:36 tencent-81 kubelet[503854]: Trace[88323491]: ---"Objects listed" error:Get "https://apiserver.cluster.local:6443/api/v1/services?limit=500&resourceVersion=0": dial tcp 81.70.253.133:6443: i/o timeout 30000ms (15:11:36.429) Aug 01 15:11:36 tencent-81 kubelet[503854]: Trace[88323491]: [30.000310643s] [30.000310643s] END Aug 01 15:11:36 tencent-81 kubelet[503854]: E0801 15:11:36.429340 503854 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch v1.Service: failed to list *v1.Service: Get "https://apiserver.cluster.local:6443/api/v1/services?limit=500&resourceVersion=0": dial tcp 81.70.253.133:6443: i/o timeout Aug 01 15:11:36 tencent-81 kubelet[503854]: E0801 15:11:36.449398 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:36 tencent-81 kubelet[503854]: E0801 15:11:36.549863 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:36 tencent-81 kubelet[503854]: E0801 15:11:36.650326 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:36 tencent-81 kubelet[503854]: E0801 15:11:36.750809 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:36 tencent-81 kubelet[503854]: E0801 15:11:36.851381 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:36 tencent-81 kubelet[503854]: E0801 15:11:36.951932 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:37 tencent-81 kubelet[503854]: E0801 15:11:37.052392 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:37 tencent-81 kubelet[503854]: E0801 15:11:37.152848 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:37 tencent-81 kubelet[503854]: E0801 15:11:37.253620 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:37 tencent-81 kubelet[503854]: E0801 15:11:37.354172 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:37 tencent-81 kubelet[503854]: E0801 15:11:37.454378 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:37 tencent-81 kubelet[503854]: E0801 15:11:37.554859 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:37 tencent-81 kubelet[503854]: E0801 15:11:37.655314 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:37 tencent-81 kubelet[503854]: E0801 15:11:37.755787 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:37 tencent-81 kubelet[503854]: E0801 15:11:37.856371 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:37 tencent-81 kubelet[503854]: E0801 15:11:37.957429 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:38 tencent-81 kubelet[503854]: E0801 15:11:38.057917 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:38 tencent-81 kubelet[503854]: E0801 15:11:38.158304 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:38 tencent-81 kubelet[503854]: E0801 15:11:38.259230 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:38 tencent-81 kubelet[503854]: E0801 15:11:38.359913 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:38 tencent-81 kubelet[503854]: E0801 15:11:38.460800 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:38 tencent-81 kubelet[503854]: E0801 15:11:38.561216 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:38 tencent-81 kubelet[503854]: E0801 15:11:38.661549 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:38 tencent-81 kubelet[503854]: E0801 15:11:38.761938 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:38 tencent-81 kubelet[503854]: E0801 15:11:38.862805 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:38 tencent-81 kubelet[503854]: E0801 15:11:38.963281 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:39 tencent-81 kubelet[503854]: E0801 15:11:39.027492 503854 eviction_manager.go:254] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"tencent-81\" not found" Aug 01 15:11:39 tencent-81 kubelet[503854]: E0801 15:11:39.063754 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:39 tencent-81 kubelet[503854]: E0801 15:11:39.117632 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:11:39 tencent-81 kubelet[503854]: E0801 15:11:39.164108 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:39 tencent-81 kubelet[503854]: E0801 15:11:39.264845 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:39 tencent-81 kubelet[503854]: E0801 15:11:39.365456 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:39 tencent-81 kubelet[503854]: E0801 15:11:39.466235 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:39 tencent-81 kubelet[503854]: E0801 15:11:39.566713 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:39 tencent-81 kubelet[503854]: E0801 15:11:39.607939 503854 kubelet_node_status.go:92] "Unable to register node with API server" err="Post \"https://apiserver.cluster.local:6443/api/v1/nodes\": dial tcp 81.70.253.133:6443: i/o timeout" node="tencent-81" Aug 01 15:11:39 tencent-81 kubelet[503854]: E0801 15:11:39.667390 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:39 tencent-81 kubelet[503854]: E0801 15:11:39.767863 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:39 tencent-81 kubelet[503854]: E0801 15:11:39.868509 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:39 tencent-81 kubelet[503854]: E0801 15:11:39.969000 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:40 tencent-81 kubelet[503854]: E0801 15:11:40.069483 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:40 tencent-81 kubelet[503854]: E0801 15:11:40.170504 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:40 tencent-81 kubelet[503854]: E0801 15:11:40.270828 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:40 tencent-81 kubelet[503854]: E0801 15:11:40.371449 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:40 tencent-81 kubelet[503854]: E0801 15:11:40.472109 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:40 tencent-81 kubelet[503854]: E0801 15:11:40.572556 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:40 tencent-81 kubelet[503854]: E0801 15:11:40.673094 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:40 tencent-81 kubelet[503854]: E0801 15:11:40.773560 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:40 tencent-81 kubelet[503854]: E0801 15:11:40.874297 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:40 tencent-81 kubelet[503854]: E0801 15:11:40.974864 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:41 tencent-81 kubelet[503854]: E0801 15:11:41.075332 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:41 tencent-81 kubelet[503854]: E0801 15:11:41.175945 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:41 tencent-81 kubelet[503854]: E0801 15:11:41.276310 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:41 tencent-81 kubelet[503854]: E0801 15:11:41.376850 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:41 tencent-81 kubelet[503854]: E0801 15:11:41.477926 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:41 tencent-81 kubelet[503854]: E0801 15:11:41.578407 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:41 tencent-81 kubelet[503854]: E0801 15:11:41.678886 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:41 tencent-81 kubelet[503854]: E0801 15:11:41.779351 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:41 tencent-81 kubelet[503854]: E0801 15:11:41.880012 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:41 tencent-81 kubelet[503854]: E0801 15:11:41.980838 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:42 tencent-81 kubelet[503854]: E0801 15:11:42.081285 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:42 tencent-81 kubelet[503854]: E0801 15:11:42.181712 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:42 tencent-81 kubelet[503854]: I0801 15:11:42.237006 503854 scope.go:110] "RemoveContainer" containerID="bbc0f892a7af1b6be9bb815ab22d001aaec933f17e89f8228f607ffcecae1d97" Aug 01 15:11:42 tencent-81 kubelet[503854]: E0801 15:11:42.237325 503854 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"etcd\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=etcd pod=etcd-tencent-81_kube-system(6d93d9c376f28acdcdad3369076be65d)\"" pod="kube-system/etcd-tencent-81" podUID=6d93d9c376f28acdcdad3369076be65d Aug 01 15:11:42 tencent-81 kubelet[503854]: E0801 15:11:42.282341 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:42 tencent-81 kubelet[503854]: E0801 15:11:42.382904 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:42 tencent-81 kubelet[503854]: E0801 15:11:42.483656 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:42 tencent-81 kubelet[503854]: E0801 15:11:42.584116 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:42 tencent-81 kubelet[503854]: E0801 15:11:42.684580 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:42 tencent-81 kubelet[503854]: E0801 15:11:42.785080 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:42 tencent-81 kubelet[503854]: E0801 15:11:42.885945 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:42 tencent-81 kubelet[503854]: E0801 15:11:42.986394 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:43 tencent-81 kubelet[503854]: E0801 15:11:43.087369 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:43 tencent-81 kubelet[503854]: E0801 15:11:43.187809 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:43 tencent-81 kubelet[503854]: E0801 15:11:43.288389 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:43 tencent-81 kubelet[503854]: E0801 15:11:43.389131 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:43 tencent-81 kubelet[503854]: E0801 15:11:43.489799 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:43 tencent-81 kubelet[503854]: E0801 15:11:43.590642 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:43 tencent-81 kubelet[503854]: E0801 15:11:43.691153 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:43 tencent-81 kubelet[503854]: E0801 15:11:43.791757 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:43 tencent-81 kubelet[503854]: E0801 15:11:43.892553 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:43 tencent-81 kubelet[503854]: E0801 15:11:43.993033 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:44 tencent-81 kubelet[503854]: E0801 15:11:44.093539 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:44 tencent-81 kubelet[503854]: E0801 15:11:44.119166 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:11:44 tencent-81 kubelet[503854]: E0801 15:11:44.194594 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:44 tencent-81 kubelet[503854]: E0801 15:11:44.295266 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:44 tencent-81 kubelet[503854]: E0801 15:11:44.396078 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:44 tencent-81 kubelet[503854]: E0801 15:11:44.496761 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:44 tencent-81 kubelet[503854]: E0801 15:11:44.524961 503854 controller.go:144] failed to ensure lease exists, will retry in 7s, error: Get "https://apiserver.cluster.local:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/tencent-81?timeout=10s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Aug 01 15:11:44 tencent-81 kubelet[503854]: E0801 15:11:44.597371 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:44 tencent-81 kubelet[503854]: E0801 15:11:44.697773 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:44 tencent-81 kubelet[503854]: E0801 15:11:44.798153 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:44 tencent-81 kubelet[503854]: E0801 15:11:44.898727 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:44 tencent-81 kubelet[503854]: E0801 15:11:44.999083 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:45 tencent-81 kubelet[503854]: E0801 15:11:45.099465 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:45 tencent-81 kubelet[503854]: E0801 15:11:45.200167 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:45 tencent-81 kubelet[503854]: I0801 15:11:45.237521 503854 scope.go:110] "RemoveContainer" containerID="d1a9f0efc51d530f0860c5133e1df39636584f316313d2ef9b575012933dd29e" Aug 01 15:11:45 tencent-81 kubelet[503854]: E0801 15:11:45.238039 503854 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=kube-apiserver pod=kube-apiserver-tencent-81_kube-system(d8e612d792c5144b9d433b6dac02724d)\"" pod="kube-system/kube-apiserver-tencent-81" podUID=d8e612d792c5144b9d433b6dac02724d Aug 01 15:11:45 tencent-81 kubelet[503854]: E0801 15:11:45.300900 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:45 tencent-81 kubelet[503854]: E0801 15:11:45.401995 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:45 tencent-81 kubelet[503854]: E0801 15:11:45.502533 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:45 tencent-81 kubelet[503854]: E0801 15:11:45.603003 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:45 tencent-81 kubelet[503854]: E0801 15:11:45.703459 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:45 tencent-81 kubelet[503854]: E0801 15:11:45.803928 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:45 tencent-81 kubelet[503854]: E0801 15:11:45.904487 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:46 tencent-81 kubelet[503854]: E0801 15:11:46.004935 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:46 tencent-81 kubelet[503854]: E0801 15:11:46.105750 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:46 tencent-81 kubelet[503854]: E0801 15:11:46.206375 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:46 tencent-81 kubelet[503854]: E0801 15:11:46.307044 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:46 tencent-81 kubelet[503854]: E0801 15:11:46.407788 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:46 tencent-81 kubelet[503854]: E0801 15:11:46.508451 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:46 tencent-81 kubelet[503854]: E0801 15:11:46.608900 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:46 tencent-81 kubelet[503854]: I0801 15:11:46.609823 503854 kubelet_node_status.go:70] "Attempting to register node" node="tencent-81" Aug 01 15:11:46 tencent-81 kubelet[503854]: E0801 15:11:46.709238 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:46 tencent-81 kubelet[503854]: E0801 15:11:46.809827 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:46 tencent-81 kubelet[503854]: E0801 15:11:46.910369 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:47 tencent-81 kubelet[503854]: E0801 15:11:47.010841 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:47 tencent-81 kubelet[503854]: E0801 15:11:47.111298 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:47 tencent-81 kubelet[503854]: E0801 15:11:47.211777 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:47 tencent-81 kubelet[503854]: E0801 15:11:47.312528 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:47 tencent-81 kubelet[503854]: E0801 15:11:47.413518 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:47 tencent-81 kubelet[503854]: E0801 15:11:47.513999 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:47 tencent-81 kubelet[503854]: E0801 15:11:47.614455 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:47 tencent-81 kubelet[503854]: E0801 15:11:47.714917 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:47 tencent-81 kubelet[503854]: E0801 15:11:47.815448 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:47 tencent-81 kubelet[503854]: E0801 15:11:47.916040 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:48 tencent-81 kubelet[503854]: E0801 15:11:48.016517 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:48 tencent-81 kubelet[503854]: E0801 15:11:48.117010 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:48 tencent-81 kubelet[503854]: E0801 15:11:48.217485 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:48 tencent-81 kubelet[503854]: E0801 15:11:48.318345 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:48 tencent-81 kubelet[503854]: E0801 15:11:48.419097 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:48 tencent-81 kubelet[503854]: E0801 15:11:48.519872 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:48 tencent-81 kubelet[503854]: E0801 15:11:48.620279 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:48 tencent-81 kubelet[503854]: E0801 15:11:48.720729 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:48 tencent-81 kubelet[503854]: E0801 15:11:48.821324 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:48 tencent-81 kubelet[503854]: E0801 15:11:48.922248 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:49 tencent-81 kubelet[503854]: E0801 15:11:49.022723 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:49 tencent-81 kubelet[503854]: E0801 15:11:49.027892 503854 eviction_manager.go:254] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"tencent-81\" not found" Aug 01 15:11:49 tencent-81 kubelet[503854]: E0801 15:11:49.120027 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:11:49 tencent-81 kubelet[503854]: E0801 15:11:49.123219 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:49 tencent-81 kubelet[503854]: E0801 15:11:49.223671 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:49 tencent-81 kubelet[503854]: E0801 15:11:49.324477 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:49 tencent-81 kubelet[503854]: E0801 15:11:49.425162 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:49 tencent-81 kubelet[503854]: E0801 15:11:49.526069 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:49 tencent-81 kubelet[503854]: E0801 15:11:49.626525 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:49 tencent-81 kubelet[503854]: E0801 15:11:49.727017 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:49 tencent-81 kubelet[503854]: E0801 15:11:49.827597 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:49 tencent-81 kubelet[503854]: E0801 15:11:49.928164 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:50 tencent-81 kubelet[503854]: E0801 15:11:50.029038 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:50 tencent-81 kubelet[503854]: E0801 15:11:50.129489 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:50 tencent-81 kubelet[503854]: E0801 15:11:50.230412 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:50 tencent-81 kubelet[503854]: E0801 15:11:50.331295 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:50 tencent-81 kubelet[503854]: E0801 15:11:50.432049 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:50 tencent-81 kubelet[503854]: E0801 15:11:50.532850 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:50 tencent-81 kubelet[503854]: E0801 15:11:50.633383 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:50 tencent-81 kubelet[503854]: E0801 15:11:50.733867 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:50 tencent-81 kubelet[503854]: E0801 15:11:50.834415 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:50 tencent-81 kubelet[503854]: E0801 15:11:50.935039 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:51 tencent-81 kubelet[503854]: E0801 15:11:51.035761 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:51 tencent-81 kubelet[503854]: E0801 15:11:51.136269 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:51 tencent-81 kubelet[503854]: E0801 15:11:51.236729 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:51 tencent-81 kubelet[503854]: E0801 15:11:51.336981 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:51 tencent-81 kubelet[503854]: E0801 15:11:51.437727 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:51 tencent-81 kubelet[503854]: E0801 15:11:51.538238 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:51 tencent-81 kubelet[503854]: E0801 15:11:51.638698 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:51 tencent-81 kubelet[503854]: E0801 15:11:51.739132 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:51 tencent-81 kubelet[503854]: E0801 15:11:51.839631 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:51 tencent-81 kubelet[503854]: E0801 15:11:51.940225 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:52 tencent-81 kubelet[503854]: E0801 15:11:52.040678 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:52 tencent-81 kubelet[503854]: E0801 15:11:52.141100 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:52 tencent-81 kubelet[503854]: E0801 15:11:52.241824 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:52 tencent-81 kubelet[503854]: E0801 15:11:52.342381 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:52 tencent-81 kubelet[503854]: E0801 15:11:52.443072 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:52 tencent-81 kubelet[503854]: E0801 15:11:52.543523 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:52 tencent-81 kubelet[503854]: E0801 15:11:52.643984 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:52 tencent-81 kubelet[503854]: E0801 15:11:52.744874 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:52 tencent-81 kubelet[503854]: E0801 15:11:52.845526 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:52 tencent-81 kubelet[503854]: E0801 15:11:52.946112 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:53 tencent-81 kubelet[503854]: E0801 15:11:53.046717 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:53 tencent-81 kubelet[503854]: E0801 15:11:53.147180 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:53 tencent-81 kubelet[503854]: I0801 15:11:53.237850 503854 scope.go:110] "RemoveContainer" containerID="bbc0f892a7af1b6be9bb815ab22d001aaec933f17e89f8228f607ffcecae1d97" Aug 01 15:11:53 tencent-81 kubelet[503854]: E0801 15:11:53.238180 503854 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"etcd\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=etcd pod=etcd-tencent-81_kube-system(6d93d9c376f28acdcdad3369076be65d)\"" pod="kube-system/etcd-tencent-81" podUID=6d93d9c376f28acdcdad3369076be65d Aug 01 15:11:53 tencent-81 kubelet[503854]: E0801 15:11:53.247359 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:53 tencent-81 kubelet[503854]: E0801 15:11:53.348021 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:53 tencent-81 kubelet[503854]: E0801 15:11:53.449030 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:53 tencent-81 kubelet[503854]: E0801 15:11:53.549879 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:53 tencent-81 kubelet[503854]: E0801 15:11:53.650316 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:53 tencent-81 kubelet[503854]: E0801 15:11:53.750940 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:53 tencent-81 kubelet[503854]: E0801 15:11:53.851526 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:53 tencent-81 kubelet[503854]: E0801 15:11:53.952115 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:54 tencent-81 kubelet[503854]: E0801 15:11:54.031682 503854 certificate_manager.go:471] kubernetes.io/kube-apiserver-client-kubelet: Failed while requesting a signed certificate from the control plane: cannot create certificate signing request: Post "https://apiserver.cluster.local:6443/apis/certificates.k8s.io/v1/certificatesigningrequests": dial tcp 81.70.253.133:6443: i/o timeout Aug 01 15:11:54 tencent-81 kubelet[503854]: E0801 15:11:54.052821 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:54 tencent-81 kubelet[503854]: E0801 15:11:54.120764 503854 kubelet.go:2349] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized" Aug 01 15:11:54 tencent-81 kubelet[503854]: E0801 15:11:54.153051 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:54 tencent-81 kubelet[503854]: E0801 15:11:54.253821 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:54 tencent-81 kubelet[503854]: E0801 15:11:54.354439 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:54 tencent-81 kubelet[503854]: E0801 15:11:54.455302 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:54 tencent-81 kubelet[503854]: E0801 15:11:54.555783 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:54 tencent-81 kubelet[503854]: E0801 15:11:54.656261 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:54 tencent-81 kubelet[503854]: E0801 15:11:54.756769 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:54 tencent-81 kubelet[503854]: E0801 15:11:54.857406 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:54 tencent-81 kubelet[503854]: E0801 15:11:54.957978 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:55 tencent-81 kubelet[503854]: E0801 15:11:55.058464 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:55 tencent-81 kubelet[503854]: E0801 15:11:55.158925 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:55 tencent-81 kubelet[503854]: E0801 15:11:55.259602 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:55 tencent-81 kubelet[503854]: E0801 15:11:55.360205 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found" Aug 01 15:11:55 tencent-81 kubelet[503854]: E0801 15:11:55.460969 503854 kubelet.go:2424] "Error getting node" err="node \"tencent-81\" not found"

caixiaomao commented 2 years ago

sealos 安装日志如下：

$ sealos run labring/kubernetes:v1.24.3 --masters 81.70.253.133 --pk /home/tools/sealos/caixiaomao 2022-08-01 14:44:09 [INFO] Start to create a new cluster: master [81.70.253.133], worker [] 2022-08-01 14:44:09 [INFO] Executing pipeline Check in CreateProcessor. 2022-08-01 14:44:09 [INFO] checker:hostname [81.70.253.133:22] 2022-08-01 14:44:09 [INFO] checker:timeSync [81.70.253.133:22] 2022-08-01 14:44:09 [INFO] Executing pipeline PreProcess in CreateProcessor. 32b8fcc13f968a4054ad0e69beaa1b6e35c74e8bed6494e2af64cfbcd89db884 default-elgynbib 2022-08-01 14:44:10 [INFO] Executing pipeline RunConfig in CreateProcessor. 2022-08-01 14:44:10 [INFO] Executing pipeline MountRootfs in CreateProcessor. 81.70.253.133:22: INFO [2022-08-01 14:54:41] >> check root,port,cri success
81.70.253.133:22: Created symlink /etc/systemd/system/multi-user.target.wants/containerd.service → /etc/systemd/system/containerd.service. 81.70.253.133:22: INFO [2022-08-01 14:54:43] >> Health check containerd! 81.70.253.133:22: INFO [2022-08-01 14:54:44] >> containerd is running 81.70.253.133:22: INFO [2022-08-01 14:54:44] >> init containerd success 81.70.253.133:22: Created symlink /etc/systemd/system/multi-user.target.wants/image-cri-shim.service → /etc/systemd/system/image-cri-shim.service. 81.70.253.133:22: INFO [2022-08-01 14:54:44] >> Health check image-cri-shim! 81.70.253.133:22: INFO [2022-08-01 14:54:44] >> image-cri-shim is running 81.70.253.133:22: INFO [2022-08-01 14:54:44] >> init shim success 81.70.253.133:22: Applying /usr/lib/sysctl.d/50-pid-max.conf ... 81.70.253.133:22: kernel.pid_max = 4194304 81.70.253.133:22: Applying /etc/sysctl.d/99-sysctl.conf ... 81.70.253.133:22: kernel.core_uses_pid = 1 81.70.253.133:22: net.ipv4.ip_forward = 0 81.70.253.133:22: net.ipv6.conf.all.forwarding = 0 81.70.253.133:22: net.ipv4.conf.default.rp_filter = 1 81.70.253.133:22: kernel.msgmnb = 65536 81.70.253.133:22: kernel.msgmax = 65536 81.70.253.133:22: net.ipv4.conf.default.accept_source_route = 0 81.70.253.133:22: net.ipv4.tcp_syncookies = 1 81.70.253.133:22: net.ipv6.conf.all.disable_ipv6 = 0 81.70.253.133:22: net.ipv6.conf.default.disable_ipv6 = 0 81.70.253.133:22: net.ipv6.conf.lo.disable_ipv6 = 0 81.70.253.133:22: net.ipv4.conf.all.promote_secondaries = 1 81.70.253.133:22: net.ipv4.conf.default.promote_secondaries = 1 81.70.253.133:22: net.ipv6.neigh.default.gc_thresh3 = 4096 81.70.253.133:22: net.ipv4.neigh.default.gc_thresh3 = 4096 81.70.253.133:22: kernel.printk = 5 4 1 7 81.70.253.133:22: kernel.softlockup_panic = 1 81.70.253.133:22: kernel.sysrq = 1 81.70.253.133:22: Applying /etc/sysctl.d/k8s.conf ... 81.70.253.133:22: net.bridge.bridge-nf-call-ip6tables = 1 81.70.253.133:22: net.bridge.bridge-nf-call-iptables = 1 81.70.253.133:22: net.ipv4.conf.all.rp_filter = 0 81.70.253.133:22: Applying /usr/lib/sysctl.d/protect-links.conf ... 81.70.253.133:22: fs.protected_fifos = 1 81.70.253.133:22: fs.protected_hardlinks = 1 81.70.253.133:22: fs.protected_regular = 2 81.70.253.133:22: fs.protected_symlinks = 1 81.70.253.133:22: * Applying /etc/sysctl.conf ... 81.70.253.133:22: kernel.core_uses_pid = 1 81.70.253.133:22: net.ipv4.ip_forward = 0 81.70.253.133:22: net.ipv6.conf.all.forwarding = 0 81.70.253.133:22: net.ipv4.conf.default.rp_filter = 1 81.70.253.133:22: kernel.msgmnb = 65536 81.70.253.133:22: kernel.msgmax = 65536 81.70.253.133:22: net.ipv4.conf.default.accept_source_route = 0 81.70.253.133:22: net.ipv4.tcp_syncookies = 1 81.70.253.133:22: net.ipv6.conf.all.disable_ipv6 = 0 81.70.253.133:22: net.ipv6.conf.default.disable_ipv6 = 0 81.70.253.133:22: net.ipv6.conf.lo.disable_ipv6 = 0 81.70.253.133:22: net.ipv4.conf.all.promote_secondaries = 1 81.70.253.133:22: net.ipv4.conf.default.promote_secondaries = 1 81.70.253.133:22: net.ipv6.neigh.default.gc_thresh3 = 4096 81.70.253.133:22: net.ipv4.neigh.default.gc_thresh3 = 4096 81.70.253.133:22: kernel.printk = 5 4 1 7 81.70.253.133:22: kernel.softlockup_panic = 1 81.70.253.133:22: kernel.sysrq = 1 81.70.253.133:22: net.ipv4.ip_forward = 1 81.70.253.133:22: INFO [2022-08-01 14:54:44] >> init kube success 81.70.253.133:22: INFO [2022-08-01 14:54:44] >> init containerd rootfs success 2022-08-01 14:54:44 [INFO] Executing pipeline Init in CreateProcessor. 2022-08-01 14:54:44 [INFO] start to copy kubeadm config to master0 2022-08-01 14:54:45 [INFO] start to generate cert and kubeConfig... 5 it/s) 2022-08-01 14:54:45 [INFO] start to generator cert and copy to masters... 2022-08-01 14:54:45 [INFO] apiserver altNames : {map[apiserver.cluster.local:apiserver.cluster.local kubernetes:kubernetes kubernetes.default:kubernetes.default kubernetes.default.svc:kubernetes.default.svc kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local localhost:localhost tencent-81:tencent-81] map[10.103.97.2:10.103.97.2 10.96.0.1:10.96.0.1 127.0.0.1:127.0.0.1 81.70.253.133:81.70.253.133]} 2022-08-01 14:54:45 [INFO] Etcd altnames : {map[localhost:localhost tencent-81:tencent-81] map[127.0.0.1:127.0.0.1 81.70.253.133:81.70.253.133 ::1:::1]}, commonName : tencent-81 2022-08-01 14:54:47 [INFO] start to copy etc pki files to masters 2022-08-01 14:54:52 [INFO] start to create kubeconfig...
2022-08-01 14:54:53 [INFO] start to copy kubeconfig files to masters 2022-08-01 14:54:54 [INFO] start to copy static files to masters 5 it/s) 2022-08-01 14:54:54 [INFO] start to apply registry 81.70.253.133:22: unpacking docker.io/library/registry:2.7.1 (sha256:49bd6b1420deba16b51bd073977ea6ae4000b816a356b12e805a699c4e5d3dba)...done 81.70.253.133:22: b138a56f4ff30fcb419f3a83a3fc418bfb12f10dd9d40abf03b55da1e60397a5 81.70.253.133:22: INFO [2022-08-01 14:54:56] >> init registry success 2022-08-01 14:54:56 [INFO] start to init master0... 2022-08-01 14:54:56 [INFO] registry auth in node 81.70.253.133:22 81.70.253.133:22: 2022-08-01T14:54:56 info domain sealos.hub:81.70.253.133 append success 81.70.253.133:22: 2022-08-01T14:54:56 info domain apiserver.cluster.local:81.70.253.133 append success 81.70.253.133:22: W0801 14:54:57.098553 502918 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration! 81.70.253.133:22: [init] Using Kubernetes version: v1.24.3 81.70.253.133:22: [preflight] Running pre-flight checks 81.70.253.133:22: [WARNING FileExisting-socat]: socat not found in system path 81.70.253.133:22: [WARNING SystemVerification]: missing optional cgroups: blkio 81.70.253.133:22: [preflight] Pulling images required for setting up a Kubernetes cluster 81.70.253.133:22: [preflight] This might take a minute or two, depending on the speed of your internet connection 81.70.253.133:22: [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' 81.70.253.133:22: [certs] Using certificateDir folder "/etc/kubernetes/pki" 81.70.253.133:22: [certs] Using existing ca certificate authority 81.70.253.133:22: [certs] Using existing apiserver certificate and key on disk 81.70.253.133:22: [certs] Using existing apiserver-kubelet-client certificate and key on disk 81.70.253.133:22: [certs] Using existing front-proxy-ca certificate authority 81.70.253.133:22: [certs] Using existing front-proxy-client certificate and key on disk 81.70.253.133:22: [certs] Using existing etcd/ca certificate authority 81.70.253.133:22: [certs] Using existing etcd/server certificate and key on disk 81.70.253.133:22: [certs] Using existing etcd/peer certificate and key on disk 81.70.253.133:22: [certs] Using existing etcd/healthcheck-client certificate and key on disk 81.70.253.133:22: [certs] Using existing apiserver-etcd-client certificate and key on disk 81.70.253.133:22: [certs] Using the existing "sa" key 81.70.253.133:22: [kubeconfig] Using kubeconfig folder "/etc/kubernetes" 81.70.253.133:22: [kubeconfig] Using existing kubeconfig file: "/etc/kubernetes/admin.conf" 81.70.253.133:22: [kubeconfig] Using existing kubeconfig file: "/etc/kubernetes/kubelet.conf" 81.70.253.133:22: W0801 14:59:17.879291 502918 kubeconfig.go:249] a kubeconfig file "/etc/kubernetes/controller-manager.conf" exists already but has an unexpected API Server URL: expected: https://81.70.253.133:6443, got: https://apiserver.cluster.local:6443 81.70.253.133:22: [kubeconfig] Using existing kubeconfig file: "/etc/kubernetes/controller-manager.conf" 81.70.253.133:22: W0801 14:59:18.010543 502918 kubeconfig.go:249] a kubeconfig file "/etc/kubernetes/scheduler.conf" exists already but has an unexpected API Server URL: expected: https://81.70.253.133:6443, got: https://apiserver.cluster.local:6443 81.70.253.133:22: [kubeconfig] Using existing kubeconfig file: "/etc/kubernetes/scheduler.conf" 81.70.253.133:22: [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" 81.70.253.133:22: [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" 81.70.253.133:22: [kubelet-start] Starting the kubelet 81.70.253.133:22: [control-plane] Using manifest folder "/etc/kubernetes/manifests" 81.70.253.133:22: [control-plane] Creating static Pod manifest for "kube-apiserver" 81.70.253.133:22: [control-plane] Creating static Pod manifest for "kube-controller-manager" 81.70.253.133:22: [control-plane] Creating static Pod manifest for "kube-scheduler" 81.70.253.133:22: [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests" 81.70.253.133:22: [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s 81.70.253.133:22: [kubelet-check] Initial timeout of 40s passed. 81.70.253.133:22: 81.70.253.133:22: Unfortunately, an error has occurred: 81.70.253.133:22: timed out waiting for the condition 81.70.253.133:22: 81.70.253.133:22: This error is likely caused by: 81.70.253.133:22: - The kubelet is not running 81.70.253.133:22: - The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled) 81.70.253.133:22: 81.70.253.133:22: If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands: 81.70.253.133:22: - 'systemctl status kubelet' 81.70.253.133:22: - 'journalctl -xeu kubelet' 81.70.253.133:22: 81.70.253.133:22: Additionally, a control plane component may have crashed or exited when started by the container runtime. 81.70.253.133:22: To troubleshoot, list all containers using your preferred container runtimes CLI. 81.70.253.133:22: Here is one example how you may list all running Kubernetes containers by using crictl: 81.70.253.133:22: - 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock ps -a | grep kube | grep -v pause' 81.70.253.133:22: Once you have found the failing container, you can inspect its logs with: 81.70.253.133:22: - 'crictl --runtime-endpoint unix:///run/containerd/containerd.sock logs CONTAINERID' 81.70.253.133:22: error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster 81.70.253.133:22: To see the stack trace of this error execute with --v=5 or higher 2022-08-01 15:03:47 [EROR] Applied to cluster error: failed to init init master0 failed, error: failed to execute command(kubeadm init --config=/var/lib/sealos/data/default/etc/kubeadm-init.yaml --skip-certificate-key-print --skip-token-print -v 0 --ignore-preflight-errors=SystemVerification) on host(81.70.253.133:22): output(W0801 14:54:57.098553 502918 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/run/containerd/containerd.sock". Please update your configuration! [init] Using Kubernetes version: v1.24.3 [preflight] Running pre-flight checks [WARNING FileExisting-socat]: socat not found in system path [WARNING SystemVerification]: missing optional cgroups: blkio [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' [certs] Using certificateDir folder "/etc/kubernetes/pki" [certs] Using existing ca certificate authority [certs] Using existing apiserver certificate and key on disk [certs] Using existing apiserver-kubelet-client certificate and key on disk [certs] Using existing front-proxy-ca certificate authority [certs] Using existing front-proxy-client certificate and key on disk [certs] Using existing etcd/ca certificate authority [certs] Using existing etcd/server certificate and key on disk [certs] Using existing etcd/peer certificate and key on disk [certs] Using existing etcd/healthcheck-client certificate and key on disk [certs] Using existing apiserver-etcd-client certificate and key on disk [certs] Using the existing "sa" key [kubeconfig] Using kubeconfig folder "/etc/kubernetes" [kubeconfig] Using existing kubeconfig file: "/etc/kubernetes/admin.conf" [kubeconfig] Using existing kubeconfig file: "/etc/kubernetes/kubelet.conf" W0801 14:59:17.879291 502918 kubeconfig.go:249] a kubeconfig file "/etc/kubernetes/controller-manager.conf" exists already but has an unexpected API Server URL: expected: https://81.70.253.133:6443, got: https://apiserver.cluster.local:6443 [kubeconfig] Using existing kubeconfig file: "/etc/kubernetes/controller-manager.conf" W0801 14:59:18.010543 502918 kubeconfig.go:249] a kubeconfig file "/etc/kubernetes/scheduler.conf" exists already but has an unexpected API Server URL: expected: https://81.70.253.133:6443, got: https://apiserver.cluster.local:6443 [kubeconfig] Using existing kubeconfig file: "/etc/kubernetes/scheduler.conf" [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" [kubelet-start] Starting the kubelet [control-plane] Using manifest folder "/etc/kubernetes/manifests" [control-plane] Creating static Pod manifest for "kube-apiserver" [control-plane] Creating static Pod manifest for "kube-controller-manager" [control-plane] Creating static Pod manifest for "kube-scheduler" [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests" [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s [kubelet-check] Initial timeout of 40s passed.

Unfortunately, an error has occurred: timed out waiting for the condition

This error is likely caused by:

If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

Additionally, a control plane component may have crashed or exited when started by the container runtime. To troubleshoot, list all containers using your preferred container runtimes CLI. Here is one example how you may list all running Kubernetes containers by using crictl:

cuisongliu commented 2 years ago

crictl images crictl ps -a 都执行一下看一下

caixiaomao commented 2 years ago

crictl images crictl ps -a 都执行一下看一下

image

image

caixiaomao commented 2 years ago

etcd 启动失败，看日志报错如下：

$ crictl logs 5c56895a3c89f
{"level":"info","ts":"2022-08-01T12:24:12.254Z","caller":"etcdmain/etcd.go:73","msg":"Running: ","args":["etcd","--advertise-client-urls=https://81.70.253.133:2379","--cert-file=/etc/kubernetes/pki/etcd/server.crt","--client-cert-auth=true","--data-dir=/var/lib/etcd","--experimental-initial-corrupt-check=true","--initial-advertise-peer-urls=https://81.70.253.133:2380","--initial-cluster=tencent-81=https://81.70.253.133:2380","--key-file=/etc/kubernetes/pki/etcd/server.key","--listen-client-urls=https://127.0.0.1:2379,https://81.70.253.133:2379","--listen-metrics-urls=http://0.0.0.0:2381","--listen-peer-urls=https://81.70.253.133:2380","--name=tencent-81","--peer-cert-file=/etc/kubernetes/pki/etcd/peer.crt","--peer-client-cert-auth=true","--peer-key-file=/etc/kubernetes/pki/etcd/peer.key","--peer-trusted-ca-file=/etc/kubernetes/pki/etcd/ca.crt","--snapshot-count=10000","--trusted-ca-file=/etc/kubernetes/pki/etcd/ca.crt"]} {"level":"info","ts":"2022-08-01T12:24:12.254Z","caller":"embed/etcd.go:131","msg":"configuring peer listeners","listen-peer-urls":["https://81.70.253.133:2380"]} {"level":"info","ts":"2022-08-01T12:24:12.254Z","caller":"embed/etcd.go:479","msg":"starting with peer TLS","tls-info":"cert = /etc/kubernetes/pki/etcd/peer.crt, key = /etc/kubernetes/pki/etcd/peer.key, client-cert=, client-key=, trusted-ca = /etc/kubernetes/pki/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]} {"level":"info","ts":"2022-08-01T12:24:12.254Z","caller":"embed/etcd.go:368","msg":"closing etcd server","name":"tencent-81","data-dir":"/var/lib/etcd","advertise-peer-urls":["https://81.70.253.133:2380"],"advertise-client-urls":["https://81.70.253.133:2379"]} {"level":"info","ts":"2022-08-01T12:24:12.254Z","caller":"embed/etcd.go:370","msg":"closed etcd server","name":"tencent-81","data-dir":"/var/lib/etcd","advertise-peer-urls":["https://81.70.253.133:2380"],"advertise-client-urls":["https://81.70.253.133:2379"]} {"level":"warn","ts":"2022-08-01T12:24:12.255Z","caller":"etcdmain/etcd.go:146","msg":"failed to start etcd","error":"listen tcp 81.70.253.133:2380: bind: cannot assign requested address"} {"level":"fatal","ts":"2022-08-01T12:24:12.255Z","caller":"etcdmain/etcd.go:204","msg":"discovery failed","error":"listen tcp 81.70.253.133:2380: bind: cannot assign requested address","stacktrace":"go.etcd.io/etcd/server/v3/etcdmain.startEtcdOrProxyV2\n\t/go/src/go.etcd.io/etcd/release/etcd/server/etcdmain/etcd.go:204\ngo.etcd.io/etcd/server/v3/etcdmain.Main\n\t/go/src/go.etcd.io/etcd/release/etcd/server/etcdmain/main.go:40\nmain.main\n\t/go/src/go.etcd.io/etcd/release/etcd/server/main.go:32\nruntime.main\n\t/go/gos/go1.16.15/src/runtime/proc.go:225"}

caixiaomao commented 2 years ago

etcd 启动失败，看日志报错如下：

$ crictl logs 5c56895a3c89f {"level":"info","ts":"2022-08-01T12:24:12.254Z","caller":"etcdmain/etcd.go:73","msg":"Running: ","args":["etcd","--advertise-client-urls=https://81.70.253.133:2379","--cert-file=/etc/kubernetes/pki/etcd/server.crt","--client-cert-auth=true","--data-dir=/var/lib/etcd","--experimental-initial-corrupt-check=true","--initial-advertise-peer-urls=https://81.70.253.133:2380","--initial-cluster=tencent-81=https://81.70.253.133:2380","--key-file=/etc/kubernetes/pki/etcd/server.key","--listen-client-urls=https://127.0.0.1:2379,https://81.70.253.133:2379","--listen-metrics-urls=http://0.0.0.0:2381","--listen-peer-urls=https://81.70.253.133:2380","--name=tencent-81","--peer-cert-file=/etc/kubernetes/pki/etcd/peer.crt","--peer-client-cert-auth=true","--peer-key-file=/etc/kubernetes/pki/etcd/peer.key","--peer-trusted-ca-file=/etc/kubernetes/pki/etcd/ca.crt","--snapshot-count=10000","--trusted-ca-file=/etc/kubernetes/pki/etcd/ca.crt"]} {"level":"info","ts":"2022-08-01T12:24:12.254Z","caller":"embed/etcd.go:131","msg":"configuring peer listeners","listen-peer-urls":["https://81.70.253.133:2380"]} {"level":"info","ts":"2022-08-01T12:24:12.254Z","caller":"embed/etcd.go:479","msg":"starting with peer TLS","tls-info":"cert = /etc/kubernetes/pki/etcd/peer.crt, key = /etc/kubernetes/pki/etcd/peer.key, client-cert=, client-key=, trusted-ca = /etc/kubernetes/pki/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]} {"level":"info","ts":"2022-08-01T12:24:12.254Z","caller":"embed/etcd.go:368","msg":"closing etcd server","name":"tencent-81","data-dir":"/var/lib/etcd","advertise-peer-urls":["https://81.70.253.133:2380"],"advertise-client-urls":["https://81.70.253.133:2379"]} {"level":"info","ts":"2022-08-01T12:24:12.254Z","caller":"embed/etcd.go:370","msg":"closed etcd server","name":"tencent-81","data-dir":"/var/lib/etcd","advertise-peer-urls":["https://81.70.253.133:2380"],"advertise-client-urls":["https://81.70.253.133:2379"]} {"level":"warn","ts":"2022-08-01T12:24:12.255Z","caller":"etcdmain/etcd.go:146","msg":"failed to start etcd","error":"listen tcp 81.70.253.133:2380: bind: cannot assign requested address"} {"level":"fatal","ts":"2022-08-01T12:24:12.255Z","caller":"etcdmain/etcd.go:204","msg":"discovery failed","error":"listen tcp 81.70.253.133:2380: bind: cannot assign requested address","stacktrace":"go.etcd.io/etcd/server/v3/etcdmain.startEtcdOrProxyV2\n\t/go/src/go.etcd.io/etcd/release/etcd/server/etcdmain/etcd.go:204\ngo.etcd.io/etcd/server/v3/etcdmain.Main\n\t/go/src/go.etcd.io/etcd/release/etcd/server/etcdmain/main.go:40\nmain.main\n\t/go/src/go.etcd.io/etcd/release/etcd/server/main.go:32\nruntime.main\n\t/go/gos/go1.16.15/src/runtime/proc.go:225"}

查了相关资料，云厂商的公网ip可能会存在类似问题，目前监听的就是是公网 ip，是不是可能是这个导致的？

zhangguanzhang commented 2 years ago

公有云的公网ip是nat的，不会配置在网卡上，这个确实是生成的etcd配置有问题

caixiaomao commented 2 years ago

公有云的公网ip是nat的，不会配置在网卡上，这个确实是生成的etcd配置有问题

好吧，我看看怎么解决，谢谢啦

mxdlzg commented 6 months ago

所以是怎么解决的。。

sealos-ci-robot commented 6 months ago

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

So how was it solved. .