search

spidernet-io / spiderpool

Underlay and RDMA network solution of the Kubernetes, for bare metal, VM and any public cloud
https://spidernet-io.github.io/spiderpool/
Apache License 2.0
514 stars 73 forks source link

Nightly K8s Matrix CI 2024-05-08: Failed #3474

Closed github-actions[bot] closed 2 months ago

github-actions[bot] commented 2 months ago

action url: https://github.com/spidernet-io/spiderpool/actions/runs/9007830988

ty-dc commented 2 months ago

Occasional problems

case: status should be NotReady if neither kubeadm-config configMap nor kube-controller-manager pod can be found

Reason for failure: Change the label of kube-controller-manager, expecting the kube-controller-manager Pod to run with label kube-controller-manager1. But in the end, the Pod failed to run as expected.

  [FAILED] Timed out after 300.000s.
  Expected
      <bool>: false
  to be true
  In [It] at: /home/runner/work/spiderpool/spiderpool/test/e2e/spidercoordinator/spidercoordinator_test.go:544
-------- kubectl get pod -A -o wide
NAMESPACE            NAME                                                         READY   STATUS             RESTARTS        AGE     IP              NODE                                 NOMINATED NODE   READINESS GATES   LABELS
default              test-pod-7584cdbdb6-p4h55                                    1/1     Running            0               12m     10.243.78.9     spiderpool0508201122-worker          <none>           <none>            app=test-pod,pod-template-hash=7584cdbdb6
kruise-system        kruise-controller-manager-56ffb6c997-6f8zw                   1/1     Running            0               15m     10.243.114.65   spiderpool0508201122-control-plane   <none>           <none>            control-plane=controller-manager,pod-template-hash=56ffb6c997
kruise-system        kruise-controller-manager-56ffb6c997-fts6m                   1/1     Running            0               7m31s   10.243.114.72   spiderpool0508201122-control-plane   <none>           <none>            control-plane=controller-manager,pod-template-hash=56ffb6c997
kruise-system        kruise-daemon-hbs5z                                          0/1     CrashLoopBackOff   7 (4m26s ago)   15m     172.18.0.3      spiderpool0508201122-worker          <none>           <none>            control-plane=daemon,controller-revision-hash=67f487f586,pod-template-generation=1
kruise-system        kruise-daemon-jlrk7                                          0/1     CrashLoopBackOff   7 (4m29s ago)   15m     172.18.0.2      spiderpool0508201122-control-plane   <none>           <none>            control-plane=daemon,controller-revision-hash=67f487f586,pod-template-generation=1
kube-system          calico-kube-controllers-57894446c5-gcwcp                     1/1     Running            0               17m     10.233.78.1     spiderpool0508201122-worker          <none>           <none>            k8s-app=calico-kube-controllers,pod-template-hash=57894446c5
kube-system          calico-node-lvjdm                                            1/1     Running            0               17m     172.18.0.3      spiderpool0508201122-worker          <none>           <none>            controller-revision-hash=666d8fdd9c,k8s-app=calico-node,pod-template-generation=2
kube-system          calico-node-mmjpp                                            1/1     Running            0               17m     172.18.0.2      spiderpool0508201122-control-plane   <none>           <none>            controller-revision-hash=666d8fdd9c,k8s-app=calico-node,pod-template-generation=2
kube-system          coredns-78fcd69978-6z54w                                     1/1     Running            0               18m     10.233.114.66   spiderpool0508201122-control-plane   <none>           <none>            k8s-app=kube-dns,pod-template-hash=78fcd69978
kube-system          coredns-78fcd69978-h8wkk                                     1/1     Running            0               18m     10.233.114.67   spiderpool0508201122-control-plane   <none>           <none>            k8s-app=kube-dns,pod-template-hash=78fcd69978
kube-system          etcd-spiderpool0508201122-control-plane                      1/1     Running            0               19m     172.18.0.2      spiderpool0508201122-control-plane   <none>           <none>            component=etcd,tier=control-plane
kube-system          kdoctor-agent-t79v2                                          1/1     Running            0               14m     10.243.114.66   spiderpool0508201122-control-plane   <none>           <none>            app.kubernetes.io/component=kdoctor-agent,app.kubernetes.io/instance=kdoctor,app.kubernetes.io/name=kdoctor-agent,controller-revision-hash=5d9c4c45bf,pod-template-generation=1
kube-system          kdoctor-agent-ttp8v                                          1/1     Running            0               14m     10.243.78.2     spiderpool0508201122-worker          <none>           <none>            app.kubernetes.io/component=kdoctor-agent,app.kubernetes.io/instance=kdoctor,app.kubernetes.io/name=kdoctor-agent,controller-revision-hash=5d9c4c45bf,pod-template-generation=1
kube-system          kdoctor-controller-65548df4b6-27htm                          1/1     Running            0               14m     10.243.78.3     spiderpool0508201122-worker          <none>           <none>            app.kubernetes.io/component=kdoctor-controller,app.kubernetes.io/instance=kdoctor,app.kubernetes.io/name=kdoctor-controller,pod-template-hash=65548df4b6
kube-system          kdoctor-netreach-one-macvlan-overlay-232-81014624-sjfgb      1/1     Running            0               9m10s   10.243.78.59    spiderpool0508201122-worker          <none>           <none>            app.kubernetes.io/component=kdoctor-agent,app.kubernetes.io/instance=kdoctor,app.kubernetes.io/name=kdoctor-netreach-one-macvlan-overlay-232-81014624,controller-revision-hash=7d6fb856d7,pod-template-generation=1
kube-system          kdoctor-netreach-one-macvlan-overlay-232-81014624-zrfjb      1/1     Running            0               9m10s   10.243.114.71   spiderpool0508201122-control-plane   <none>           <none>            app.kubernetes.io/component=kdoctor-agent,app.kubernetes.io/instance=kdoctor,app.kubernetes.io/name=kdoctor-netreach-one-macvlan-overlay-232-81014624,controller-revision-hash=7d6fb856d7,pod-template-generation=1
kube-system          kdoctor-netreach-two-macvlan-overlay-2441-120286362-6vmtz    1/1     Running            0               7m31s   10.243.78.60    spiderpool0508201122-worker          <none>           <none>            app.kubernetes.io/component=kdoctor-agent,app.kubernetes.io/instance=kdoctor,app.kubernetes.io/name=kdoctor-netreach-two-macvlan-overlay-2441-120286362,controller-revision-hash=7bcbc95f86,pod-template-generation=1
kube-system          kdoctor-netreach-two-macvlan-overlay-2441-120286362-lc66d    0/1     Pending            0               7m31s   <none>          <none>                               <none>           <none>            app.kubernetes.io/component=kdoctor-agent,app.kubernetes.io/instance=kdoctor,app.kubernetes.io/name=kdoctor-netreach-two-macvlan-overlay-2441-120286362,controller-revision-hash=7bcbc95f86,pod-template-generation=1
kube-system          kube-apiserver-spiderpool0508201122-control-plane            1/1     Running            0               19m     172.18.0.2      spiderpool0508201122-control-plane   <none>           <none>            component=kube-apiserver,tier=control-plane
kube-system          kube-controller-manager-spiderpool0508201122-control-plane   1/1     Running            0               19m     172.18.0.2      spiderpool0508201122-control-plane   <none>           <none>            component=kube-controller-manager,tier=control-plane
kube-system          kube-proxy-jd7qv                                             1/1     Running            0               18m     172.18.0.3      spiderpool0508201122-worker          <none>           <none>            controller-revision-hash=6996498d6c,k8s-app=kube-proxy,pod-template-generation=1
kube-system          kube-proxy-pxrtz                                             1/1     Running            0               18m     172.18.0.2      spiderpool0508201122-control-plane   <none>           <none>            controller-revision-hash=6996498d6c,k8s-app=kube-proxy,pod-template-generation=1
kube-system          kube-scheduler-spiderpool0508201122-control-plane            1/1     Running            0               19m     172.18.0.2      spiderpool0508201122-control-plane   <none>           <none>            component=kube-scheduler,tier=control-plane
kube-system          spiderpool-agent-7gc95                                       1/1     Running            0               16m     172.18.0.3      spiderpool0508201122-worker          <none>           <none>            app.kubernetes.io/component=spiderpool-agent,app.kubernetes.io/instance=spiderpool,app.kubernetes.io/name=spiderpool,controller-revision-hash=6d66d8f4bc,pod-template-generation=1
kube-system          spiderpool-agent-lc5fg                                       1/1     Running            0               16m     172.18.0.2      spiderpool0508201122-control-plane   <none>           <none>            app.kubernetes.io/component=spiderpool-agent,app.kubernetes.io/instance=spiderpool,app.kubernetes.io/name=spiderpool,controller-revision-hash=6d66d8f4bc,pod-template-generation=1
kube-system          spiderpool-controller-6db4667f97-md2ff                       1/1     Running            0               16m     172.18.0.2      spiderpool0508201122-control-plane   <none>           <none>            app.kubernetes.io/component=spiderpool-controller,app.kubernetes.io/instance=spiderpool,app.kubernetes.io/name=spiderpool,pod-template-hash=6db4667f97
kube-system          spiderpool-controller-6db4667f97-xpwz7                       1/1     Running            0               16m     172.18.0.3      spiderpool0508201122-worker          <none>           <none>            app.kubernetes.io/component=spiderpool-controller,app.kubernetes.io/instance=spiderpool,app.kubernetes.io/name=spiderpool,pod-template-hash=6db4667f97
kube-system          spiderpool-init                                              0/1     Completed          0               16m     172.18.0.3      spiderpool0508201122-worker          <none>           <none>            app.kubernetes.io/component=spiderpool-init,app.kubernetes.io/instance=spiderpool,app.kubernetes.io/managed-by=Helm,app.kubernetes.io/name=spiderpool
kube-system          spiderpool-rdma-shared-device-plugin-5rgjx                   1/1     Running            0               16m     172.18.0.2      spiderpool0508201122-control-plane   <none>           <none>            app.kubernetes.io/component=spiderpool-rdma-shared-device-plugin,app.kubernetes.io/instance=spiderpool,app.kubernetes.io/name=spiderpool,app=spiderpool-rdma-shared-device-plugin,controller-revision-hash=754747fcc5,name=multus,pod-template-generation=1
kube-system          spiderpool-rdma-shared-device-plugin-nldbw                   1/1     Running            0               16m     172.18.0.3      spiderpool0508201122-worker          <none>           <none>            app.kubernetes.io/component=spiderpool-rdma-shared-device-plugin,app.kubernetes.io/instance=spiderpool,app.kubernetes.io/name=spiderpool,app=spiderpool-rdma-shared-device-plugin,controller-revision-hash=754747fcc5,name=multus,pod-template-generation=1
kube-system          spiderpool-sriov-operator-56bb4fd847-d6g8l                   1/1     Running            0               16m     172.18.0.3      spiderpool0508201122-worker          <none>           <none>            app.kubernetes.io/component=spiderpool-sriov-operator,app.kubernetes.io/instance=spiderpool,app.kubernetes.io/name=spiderpool,pod-template-hash=56bb4fd847
kube-system          sriov-network-config-daemon-bwzfq                            3/3     Running            0               15m     172.18.0.2      spiderpool0508201122-control-plane   <none>           <none>            app=sriov-network-config-daemon,component=network,controller-revision-hash=68b5f6987c,openshift.io/component=network,pod-template-generation=1,type=infra
kube-system          sriov-network-config-daemon-kht5w                            3/3     Running            0               15m     172.18.0.3      spiderpool0508201122-worker          <none>           <none>            app=sriov-network-config-daemon,component=network,controller-revision-hash=68b5f6987c,openshift.io/component=network,pod-template-generation=1,type=infra
kubevirt             virt-api-6ff95fb98d-kxtkx                                    1/1     Running            0               13m     10.243.78.6     spiderpool0508201122-worker          <none>           <none>            app.kubernetes.io/component=kubevirt,app.kubernetes.io/managed-by=virt-operator,app.kubernetes.io/version=v1.2.0,kubevirt.io=virt-api,pod-template-hash=6ff95fb98d,prometheus.kubevirt.io=true
kubevirt             virt-api-6ff95fb98d-qm6ls                                    1/1     Running            0               13m     10.243.114.68   spiderpool0508201122-control-plane   <none>           <none>            app.kubernetes.io/component=kubevirt,app.kubernetes.io/managed-by=virt-operator,app.kubernetes.io/version=v1.2.0,kubevirt.io=virt-api,pod-template-hash=6ff95fb98d,prometheus.kubevirt.io=true
kubevirt             virt-controller-59b74f794b-59f46                             1/1     Running            0               12m     10.243.78.8     spiderpool0508201122-worker          <none>           <none>            app.kubernetes.io/component=kubevirt,app.kubernetes.io/managed-by=virt-operator,app.kubernetes.io/version=v1.2.0,kubevirt.io=virt-controller,pod-template-hash=59b74f794b,prometheus.kubevirt.io=true
kubevirt             virt-controller-59b74f794b-dqbx9                             1/1     Running            0               12m     10.243.114.69   spiderpool0508201122-control-plane   <none>           <none>            app.kubernetes.io/component=kubevirt,app.kubernetes.io/managed-by=virt-operator,app.kubernetes.io/version=v1.2.0,kubevirt.io=virt-controller,pod-template-hash=59b74f794b,prometheus.kubevirt.io=true
kubevirt             virt-handler-89vjt                                           1/1     Running            0               12m     10.243.114.70   spiderpool0508201122-control-plane   <none>           <none>            app.kubernetes.io/component=kubevirt,app.kubernetes.io/managed-by=virt-operator,app.kubernetes.io/version=v1.2.0,controller-revision-hash=6b4f6b7fd9,kubevirt.io=virt-handler,pod-template-generation=1,prometheus.kubevirt.io=true
kubevirt             virt-handler-xqlsq                                           1/1     Running            0               12m     10.243.78.7     spiderpool0508201122-worker          <none>           <none>            app.kubernetes.io/component=kubevirt,app.kubernetes.io/managed-by=virt-operator,app.kubernetes.io/version=v1.2.0,controller-revision-hash=6b4f6b7fd9,kubevirt.io=virt-handler,pod-template-generation=1,prometheus.kubevirt.io=true
kubevirt             virt-operator-cfd9f9c6c-cxlfv                                1/1     Running            0               13m     10.243.78.4     spiderpool0508201122-worker          <none>           <none>            kubevirt.io=virt-operator,name=virt-operator,pod-template-hash=cfd9f9c6c,prometheus.kubevirt.io=true
kubevirt             virt-operator-cfd9f9c6c-jzfth                                1/1     Running            0               13m     10.243.114.67   spiderpool0508201122-control-plane   <none>           <none>            kubevirt.io=virt-operator,name=virt-operator,pod-template-hash=cfd9f9c6c,prometheus.kubevirt.io=true
local-path-storage   local-path-provisioner-74567d47b4-9n2dm                      1/1     Running            0               18m     10.233.114.68   spiderpool0508201122-control-plane   <none>           <none>            app=local-path-provisioner,pod-template-hash=74567d47b4
ns-eb72f11fcf        dep-name-41df5f3aca-7ccbb7968b-cxlnw                         1/1     Running            0               6m6s    172.18.40.128   spiderpool0508201122-control-plane   <none>           <none>            app=dep-name-41df5f3aca,pod-template-hash=7ccbb7968b

Solution: kube-controller-manager-spiderpool0508201122-control-plane It does not restart and change the label as expected. So it failed? Check whether setting label is successful?