search

zengzhengrong / k0s-stack

k0s argo stack is pretty simple setup kubernetes by use docker compose
7 stars 1 forks source link

Update image to v1.25.2-k0s.0 start failed #6

Open zengzhengrong opened 1 year ago

zengzhengrong commented 1 year ago 
kubectl.exe get pod -A
NAMESPACE     NAME                                                READY   STATUS              RESTARTS      AGE
kube-system   coredns-5d5b5b96f9-xnxkf                            0/1     Pending             0             21m
kube-system   konnectivity-agent-mzccl                            0/1     ContainerCreating   0             21m
kube-system   kube-proxy-8bsq7                                    1/1     Running             0             21m
kube-system   kube-router-dls5n                                   0/1     CrashLoopBackOff    6 (46s ago)   21m
kube-system   metrics-server-7c555fc57f-vbpwc                     0/1     Pending             0             21m

Container logs

time="2022-11-05 10:48:32" level=info msg="E1105 10:48:32.577276     148 kuberuntime_manager.go:772] \"CreatePodSandbox for pod failed\" err=\"rpc error: code = Unknown desc = failed to setup network for sandbox \\\"06042d2449076328ffd814f121b5406ad7ef263fce1d25cd1d8e68b7e97cc8d8\\\": plugin type=\\\"bridge\\\" name=\\\"kubernetes\\\" failed (add): no IP ranges specified\" pod=\"kube-system/konnectivity-agent-mzccl\"" component=kubelet
time="2022-11-05 10:48:32" level=info msg="E1105 10:48:32.577330     148 pod_workers.go:965] \"Error syncing pod, skipping\" err=\"failed to \\\"CreatePodSandbox\\\" for \\\"konnectivity-agent-mzccl_kube-system(d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6)\\\" with CreatePodSandboxError: \\\"Failed to create sandbox for pod \\\\\\\"konnectivity-agent-mzccl_kube-system(d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6)\\\\\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\\\\\"06042d2449076328ffd814f121b5406ad7ef263fce1d25cd1d8e68b7e97cc8d8\\\\\\\": plugin type=\\\\\\\"bridge\\\\\\\" name=\\\\\\\"kubernetes\\\\\\\" failed (add): no IP ranges specified\\\"\" pod=\"kube-system/konnectivity-agent-mzccl\" podUID=d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6" component=kubelet
time="2022-11-05 10:48:34" level=info msg="current cfg matches existing, not gonna do anything" component=coredns
time="2022-11-05 10:48:34" level=info msg="I1105 10:48:34.453210     148 scope.go:115] \"RemoveContainer\" containerID=\"3c439cefaa9735f79d41adc7aa81772c24551ff80ffc41004c100efd038773db\"" component=kubelet
time="2022-11-05 10:48:34" level=info msg="time=\"2022-11-05T10:48:34.463019200+08:00\" level=info msg=\"CreateContainer within sandbox \\\"958b9f54fd758cf4e3279e24fce1f0440e9d1c73bbdd1555eb9bca0756e32100\\\" for container &ContainerMetadata{Name:kube-router,Attempt:7,}\"" component=containerd
time="2022-11-05 10:48:34" level=info msg="time=\"2022-11-05T10:48:34.504622900+08:00\" level=info msg=\"CreateContainer within sandbox \\\"958b9f54fd758cf4e3279e24fce1f0440e9d1c73bbdd1555eb9bca0756e32100\\\" for &ContainerMetadata{Name:kube-router,Attempt:7,} returns container id \\\"07d4d4e2ccab5743d47ff0dbcb68e3e3055798d6c84077874e4f1ba47d298665\\\"\"" component=containerd
time="2022-11-05 10:48:34" level=info msg="time=\"2022-11-05T10:48:34.506307100+08:00\" level=info msg=\"StartContainer for \\\"07d4d4e2ccab5743d47ff0dbcb68e3e3055798d6c84077874e4f1ba47d298665\\\"\"" component=containerd
time="2022-11-05 10:48:34" level=info msg="time=\"2022-11-05T10:48:34.701011500+08:00\" level=info msg=\"StartContainer for \\\"07d4d4e2ccab5743d47ff0dbcb68e3e3055798d6c84077874e4f1ba47d298665\\\" returns successfully\"" component=containerd
time="2022-11-05 10:48:36" level=info msg="I1105 10:48:36.029080     148 eviction_manager.go:340] \"Eviction manager: attempting to reclaim\" resourceName=\"ephemeral-storage\"" component=kubelet
time="2022-11-05 10:48:36" level=info msg="I1105 10:48:36.029155     148 container_gc.go:85] \"Attempting to delete unused containers\"" component=kubelet
time="2022-11-05 10:48:36" level=info msg="I1105 10:48:36.032106     148 image_gc_manager.go:327] \"Attempting to delete unused images\"" component=kubelet
time="2022-11-05 10:48:36" level=info msg="I1105 10:48:36.043172     148 eviction_manager.go:351] \"Eviction manager: must evict pod(s) to reclaim\" resourceName=\"ephemeral-storage\"" component=kubelet
time="2022-11-05 10:48:36" level=info msg="I1105 10:48:36.043367     148 eviction_manager.go:369] \"Eviction manager: pods ranked for eviction\" pods=[kube-system/konnectivity-agent-mzccl kube-system/kube-proxy-8bsq7 kube-system/kube-router-dls5n]" component=kubelet
time="2022-11-05 10:48:36" level=info msg="E1105 10:48:36.043408     148 eviction_manager.go:562] \"Eviction manager: cannot evict a critical pod\" pod=\"kube-system/konnectivity-agent-mzccl\"" component=kubelet
time="2022-11-05 10:48:36" level=info msg="E1105 10:48:36.043421     148 eviction_manager.go:562] \"Eviction manager: cannot evict a critical pod\" pod=\"kube-system/kube-proxy-8bsq7\"" component=kubelet
time="2022-11-05 10:48:36" level=info msg="E1105 10:48:36.043428     148 eviction_manager.go:562] \"Eviction manager: cannot evict a critical pod\" pod=\"kube-system/kube-router-dls5n\"" component=kubelet
time="2022-11-05 10:48:36" level=info msg="I1105 10:48:36.043438     148 eviction_manager.go:392] \"Eviction manager: unable to evict any pods from the node\"" component=kubelet
time="2022-11-05 10:48:44" level=info msg="current cfg matches existing, not gonna do anything" component=coredns
time="2022-11-05 10:48:44" level=info msg="E1105 10:48:44.207764     119 resource_quota_controller.go:417] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request" component=kube-controller-manager
time="2022-11-05 10:48:44" level=info msg="W1105 10:48:44.853300     119 garbagecollector.go:752] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]" component=kube-controller-manager
time="2022-11-05 10:48:46" level=info msg="I1105 10:48:46.054891     148 eviction_manager.go:340] \"Eviction manager: attempting to reclaim\" resourceName=\"ephemeral-storage\"" component=kubelet
time="2022-11-05 10:48:46" level=info msg="I1105 10:48:46.054952     148 container_gc.go:85] \"Attempting to delete unused containers\"" component=kubelet
time="2022-11-05 10:48:46" level=info msg="I1105 10:48:46.056367     148 image_gc_manager.go:327] \"Attempting to delete unused images\"" component=kubelet
time="2022-11-05 10:48:46" level=info msg="I1105 10:48:46.065537     148 eviction_manager.go:351] \"Eviction manager: must evict pod(s) to reclaim\" resourceName=\"ephemeral-storage\"" component=kubelet
time="2022-11-05 10:48:46" level=info msg="I1105 10:48:46.065594     148 eviction_manager.go:369] \"Eviction manager: pods ranked for eviction\" pods=[kube-system/konnectivity-agent-mzccl kube-system/kube-proxy-8bsq7 kube-system/kube-router-dls5n]" component=kubelet
time="2022-11-05 10:48:46" level=info msg="E1105 10:48:46.065608     148 eviction_manager.go:562] \"Eviction manager: cannot evict a critical pod\" pod=\"kube-system/konnectivity-agent-mzccl\"" component=kubelet
time="2022-11-05 10:48:46" level=info msg="E1105 10:48:46.065619     148 eviction_manager.go:562] \"Eviction manager: cannot evict a critical pod\" pod=\"kube-system/kube-proxy-8bsq7\"" component=kubelet
time="2022-11-05 10:48:46" level=info msg="E1105 10:48:46.065626     148 eviction_manager.go:562] \"Eviction manager: cannot evict a critical pod\" pod=\"kube-system/kube-router-dls5n\"" component=kubelet
time="2022-11-05 10:48:46" level=info msg="I1105 10:48:46.065633     148 eviction_manager.go:392] \"Eviction manager: unable to evict any pods from the node\"" component=kubelet
time="2022-11-05 10:48:47" level=info msg="time=\"2022-11-05T10:48:47.448896800+08:00\" level=info msg=\"RunPodSandbox for &PodSandboxMetadata{Name:konnectivity-agent-mzccl,Uid:d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6,Namespace:kube-system,Attempt:0,}\"" component=containerd
time="2022-11-05 10:48:47" level=info msg="time=\"2022-11-05T10:48:47.586968500+08:00\" level=error msg=\"Failed to destroy network for sandbox \\\"519890a5ea4ce5b613b86ea081a4a7fa371300a39e714f45af1c5d5391152f76\\\"\" error=\"plugin type=\\\"bridge\\\" name=\\\"kubernetes\\\" failed (delete): no IP ranges specified\"" component=containerd
time="2022-11-05 10:48:47" level=info msg="time=\"2022-11-05T10:48:47.587433200+08:00\" level=error msg=\"RunPodSandbox for &PodSandboxMetadata{Name:konnectivity-agent-mzccl,Uid:d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6,Namespace:kube-system,Attempt:0,} failed, error\" error=\"failed to setup network for sandbox \\\"519890a5ea4ce5b613b86ea081a4a7fa371300a39e714f45af1c5d5391152f76\\\": plugin type=\\\"bridge\\\" name=\\\"kubernetes\\\" failed (add): no IP ranges specified\"" component=containerd
time="2022-11-05 10:48:47" level=info msg="E1105 10:48:47.588125     148 remote_runtime.go:222] \"RunPodSandbox from runtime service failed\" err=\"rpc error: code = Unknown desc = failed to setup network for sandbox \\\"519890a5ea4ce5b613b86ea081a4a7fa371300a39e714f45af1c5d5391152f76\\\": plugin type=\\\"bridge\\\" name=\\\"kubernetes\\\" failed (add): no IP ranges specified\"" component=kubelet
time="2022-11-05 10:48:47" level=info msg="E1105 10:48:47.588291     148 kuberuntime_sandbox.go:71] \"Failed to create sandbox for pod\" err=\"rpc error: code = Unknown desc = failed to setup network for sandbox \\\"519890a5ea4ce5b613b86ea081a4a7fa371300a39e714f45af1c5d5391152f76\\\": plugin type=\\\"bridge\\\" name=\\\"kubernetes\\\" failed (add): no IP ranges specified\" pod=\"kube-system/konnectivity-agent-mzccl\"" component=kubelet
time="2022-11-05 10:48:47" level=info msg="E1105 10:48:47.588343     148 kuberuntime_manager.go:772] \"CreatePodSandbox for pod failed\" err=\"rpc error: code = Unknown desc = failed to setup network for sandbox \\\"519890a5ea4ce5b613b86ea081a4a7fa371300a39e714f45af1c5d5391152f76\\\": plugin type=\\\"bridge\\\" name=\\\"kubernetes\\\" failed (add): no IP ranges specified\" pod=\"kube-system/konnectivity-agent-mzccl\"" component=kubelet
time="2022-11-05 10:48:47" level=info msg="E1105 10:48:47.588504     148 pod_workers.go:965] \"Error syncing pod, skipping\" err=\"failed to \\\"CreatePodSandbox\\\" for \\\"konnectivity-agent-mzccl_kube-system(d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6)\\\" with CreatePodSandboxError: \\\"Failed to create sandbox for pod \\\\\\\"konnectivity-agent-mzccl_kube-system(d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6)\\\\\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\\\\\"519890a5ea4ce5b613b86ea081a4a7fa371300a39e714f45af1c5d5391152f76\\\\\\\": plugin type=\\\\\\\"bridge\\\\\\\" name=\\\\\\\"kubernetes\\\\\\\" failed (add): no IP ranges specified\\\"\" pod=\"kube-system/konnectivity-agent-mzccl\" podUID=d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6" component=kubelet

Describe Logs

kubectl.exe describe pod/konnectivity-agent-mzccl -n kube-system
Name:                 konnectivity-agent-mzccl
Namespace:            kube-system
Priority:             2000000000
Priority Class Name:  system-cluster-critical
Service Account:      konnectivity-agent
Node:                 k0s/172.17.0.4
Start Time:           Sat, 05 Nov 2022 10:22:57 +0800
Labels:               controller-revision-hash=655d6bbd94
                      k8s-app=konnectivity-agent
                      pod-template-generation=2
Annotations:          prometheus.io/port: 8093
                      prometheus.io/scrape: true
Status:               Pending
IP:
IPs:                  <none>
Controlled By:        DaemonSet/konnectivity-agent
Containers:
  konnectivity-agent:
    Container ID:
    Image:         quay.io/k0sproject/apiserver-network-proxy-agent:0.0.32-k0s1
    Image ID:
    Port:          <none>
    Host Port:     <none>
    Command:
      /proxy-agent
    Args:
      --logtostderr=true
      --ca-cert=/var/run/secrets/kubernetes.io/serviceaccount/ca.crt
      --proxy-server-host=172.17.0.4
      --proxy-server-port=8132
      --service-account-token-path=/var/run/secrets/tokens/konnectivity-agent-token
      --agent-identifiers=host=$(NODE_IP)
      --agent-id=$(NODE_IP)
    State:          Waiting
      Reason:       ContainerCreating
    Ready:          False
    Restart Count:  0
    Liveness:       http-get http://:8093/healthz delay=15s timeout=15s period=10s #success=1 #failure=3
    Environment:
      K0S_CONTROLLER_COUNT:  1
      NODE_IP:                (v1:status.hostIP)
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-pfj26 (ro)
      /var/run/secrets/tokens from konnectivity-agent-token (rw)
Conditions:
  Type              Status
  Initialized       True
  Ready             False
  ContainersReady   False
  PodScheduled      True
Volumes:
  konnectivity-agent-token:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3600
  kube-api-access-pfj26:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              kubernetes.io/os=linux
Tolerations:                 op=Exists
                             node.kubernetes.io/disk-pressure:NoSchedule op=Exists
                             node.kubernetes.io/memory-pressure:NoSchedule op=Exists
                             node.kubernetes.io/not-ready:NoExecute op=Exists
                             node.kubernetes.io/pid-pressure:NoSchedule op=Exists
                             node.kubernetes.io/unreachable:NoExecute op=Exists
                             node.kubernetes.io/unschedulable:NoSchedule op=Exists
Events:
  Type     Reason                  Age                  From               Message
  ----     ------                  ----                 ----               -------
  Normal   Scheduled               21m                  default-scheduler  Successfully assigned kube-system/konnectivity-agent-mzccl to k0s
  Warning  NetworkNotReady         16m (x152 over 21m)  kubelet            network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
  Warning  FailedCreatePodSandBox  97s (x43 over 11m)   kubelet            (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8a8b6b64db65338719983249dbad6d758e12441801743c753f273b46d9c180ba": plugin type="bridge" name="kubernetes" failed (add): no IP ranges specified
zengzhengrong commented 1 year ago

https://github.com/k0sproject/k0s/issues/2361