kubernetes / minikube

Run Kubernetes locally
https://minikube.sigs.k8s.io/
Apache License 2.0
29.22k stars 4.87k forks source link

minikube couldn't initialize a Kubernetes cluster #14813

Closed bitpeng closed 8 months ago

bitpeng commented 2 years ago

What Happened?

$$ lsb_release LSB Version: :core-4.1-amd64:core-4.1-noarch:cxx-4.1-amd64:cxx-4.1-noarch:desktop-4.1-amd64:desktop-4.1-noarch:languages-4.1-amd64:languages-4.1-noarch:printing-4.1-amd64:printing-4.1-noarch [chensq20@dev-nmg-huhehaote4-devtest-214 ~]$ -a -bash: -a: command not found [chensq20@dev-nmg-huhehaote4-devtest-214 ~]$ lsb_release -a LSB Version: :core-4.1-amd64:core-4.1-noarch:cxx-4.1-amd64:cxx-4.1-noarch:desktop-4.1-amd64:desktop-4.1-noarch:languages-4.1-amd64:languages-4.1-noarch:printing-4.1-amd64:printing-4.1-noarch Distributor ID: CentOS Description: CentOS Linux release 7.9.2009 (Core) Release: 7.9.2009 Codename: Core

$$ docker version Client: Docker Engine - Community Version: 20.10.17 API version: 1.41 Go version: go1.17.11 Git commit: 100c701 Built: Mon Jun 6 23:05:12 2022 OS/Arch: linux/amd64 Context: default Experimental: true

Server: Docker Engine - Community Engine: Version: 20.10.17 API version: 1.41 (minimum version 1.12) Go version: go1.17.11 Git commit: a89b842 Built: Mon Jun 6 23:03:33 2022 OS/Arch: linux/amd64 Experimental: false containerd: Version: 1.6.7 GitCommit: 0197261a30bf81f1ee8e6a4dd2dea0ef95d67ccb runc: Version: 1.1.3 GitCommit: v1.1.3-0-g6724737 docker-init: Version: 0.19.0 GitCommit: de40ad0

$$ minikube start --image-repository=registry.cn-hangzhou.aliyuncs.com/google_containers

Unfortunately, an error has occurred: timed out waiting for the condition

This error is likely caused by:

If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

Additionally, a control plane component may have crashed or exited when started by the container runtime. To troubleshoot, list all containers using your preferred container runtimes CLI. Here is one example how you may list all running Kubernetes containers by using crictl:

stderr: W0818 13:32:48.291504 1717 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration! [WARNING FileContent--proc-sys-net-bridge-bridge-nf-call-iptables]: /proc/sys/net/bridge/bridge-nf-call-iptables does not exist [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/3.10.0-1160.36.2.el7.x86_64\n", err: exit status 1 [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster To see the stack trace of this error execute with --v=5 or higher

Attach the log file

` [Service] ExecStart= ExecStart=/var/lib/minikube/binaries/v1.24.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=/var/run/cri-dockerd.sock --hostname-override=minikube --image-service-endpoint=/var/run/cri-dockerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2 --pod-infra-container-image=registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.7 --runtime-request-timeout=15m

[Install] config: {KubernetesVersion:v1.24.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository:registry.cn-hangzhou.aliyuncs.com/google_containers LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} I0818 21:32:38.376831 313848 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.3 I0818 21:32:38.387205 313848 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.24.3: Process exited with status 2 stdout:

stderr: ls: cannot access '/var/lib/minikube/binaries/v1.24.3': No such file or directory

Initiating transfer... I0818 21:32:38.387259 313848 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.24.3 I0818 21:32:38.397259 313848 download.go:101] Downloading: https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.3/bin/linux/amd64/kubectl?checksum=file:https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.3/bin/linux/amd64/kubectl.sha256 -> /home/chensq20/.minikube/cache/linux/amd64/v1.24.3/kubectl I0818 21:32:38.397266 313848 download.go:101] Downloading: https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.3/bin/linux/amd64/kubelet?checksum=file:https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.3/bin/linux/amd64/kubelet.sha256 -> /home/chensq20/.minikube/cache/linux/amd64/v1.24.3/kubelet I0818 21:32:38.397605 313848 download.go:101] Downloading: https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.3/bin/linux/amd64/kubeadm?checksum=file:https://kubernetes.oss-cn-hangzhou.aliyuncs.com/kubernetes-release/release/v1.24.3/bin/linux/amd64/kubeadm.sha256 -> /home/chensq20/.minikube/cache/linux/amd64/v1.24.3/kubeadm I0818 21:32:41.323246 313848 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.24.3/kubeadm I0818 21:32:41.328471 313848 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.24.3/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.24.3/kubeadm: Process exited with status 1 stdout:

stderr: stat: cannot stat '/var/lib/minikube/binaries/v1.24.3/kubeadm': No such file or directory I0818 21:32:41.328492 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/cache/linux/amd64/v1.24.3/kubeadm --> /var/lib/minikube/binaries/v1.24.3/kubeadm (44376064 bytes) I0818 21:32:41.394168 313848 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.24.3/kubectl I0818 21:32:41.404296 313848 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.24.3/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.24.3/kubectl: Process exited with status 1 stdout:

stderr: stat: cannot stat '/var/lib/minikube/binaries/v1.24.3/kubectl': No such file or directory I0818 21:32:41.404316 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/cache/linux/amd64/v1.24.3/kubectl --> /var/lib/minikube/binaries/v1.24.3/kubectl (45711360 bytes) I0818 21:32:44.450092 313848 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet I0818 21:32:45.024595 313848 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.24.3/kubelet I0818 21:32:45.028503 313848 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.24.3/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.24.3/kubelet: Process exited with status 1 stdout:

stderr: stat: cannot stat '/var/lib/minikube/binaries/v1.24.3/kubelet': No such file or directory I0818 21:32:45.028521 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/cache/linux/amd64/v1.24.3/kubelet --> /var/lib/minikube/binaries/v1.24.3/kubelet (116013432 bytes) I0818 21:32:46.329002 313848 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube I0818 21:32:46.338096 313848 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (560 bytes) I0818 21:32:46.705365 313848 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes) I0818 21:32:46.723082 313848 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2100 bytes) I0818 21:32:46.739762 313848 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts I0818 21:32:46.743794 313848 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts"" I0818 21:32:46.755130 313848 certs.go:54] Setting up /home/chensq20/.minikube/profiles/minikube for IP: 192.168.49.2 I0818 21:32:46.755168 313848 certs.go:187] generating minikubeCA CA: /home/chensq20/.minikube/ca.key I0818 21:32:47.078945 313848 crypto.go:156] Writing cert to /home/chensq20/.minikube/ca.crt ... I0818 21:32:47.078960 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/ca.crt: {Name:mk437a7d469ad05e27f99ab5c18a9079bee12624 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.079162 313848 crypto.go:164] Writing key to /home/chensq20/.minikube/ca.key ... I0818 21:32:47.079168 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/ca.key: {Name:mk532552802f8673f18b1d9880401206b0e5d950 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.079273 313848 certs.go:187] generating proxyClientCA CA: /home/chensq20/.minikube/proxy-client-ca.key I0818 21:32:47.253641 313848 crypto.go:156] Writing cert to /home/chensq20/.minikube/proxy-client-ca.crt ... I0818 21:32:47.253656 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/proxy-client-ca.crt: {Name:mk1be8b8cb5952a31abc60d1bc8c8f33f356d3e0 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.253863 313848 crypto.go:164] Writing key to /home/chensq20/.minikube/proxy-client-ca.key ... I0818 21:32:47.253869 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/proxy-client-ca.key: {Name:mk6118c07eba2de0814a7a581ed6d3317172217f Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.254030 313848 certs.go:302] generating minikube-user signed cert: /home/chensq20/.minikube/profiles/minikube/client.key I0818 21:32:47.254047 313848 crypto.go:68] Generating cert /home/chensq20/.minikube/profiles/minikube/client.crt with IP's: [] I0818 21:32:47.446200 313848 crypto.go:156] Writing cert to /home/chensq20/.minikube/profiles/minikube/client.crt ... I0818 21:32:47.446215 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/profiles/minikube/client.crt: {Name:mk74f5f9c6060b1b85ad4d2d5fe39f5e591dcb7a Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.446423 313848 crypto.go:164] Writing key to /home/chensq20/.minikube/profiles/minikube/client.key ... I0818 21:32:47.446429 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/profiles/minikube/client.key: {Name:mkf4ba52783165daa15018125df61c54d91c7426 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.446516 313848 certs.go:302] generating minikube signed cert: /home/chensq20/.minikube/profiles/minikube/apiserver.key.dd3b5fb2 I0818 21:32:47.446529 313848 crypto.go:68] Generating cert /home/chensq20/.minikube/profiles/minikube/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1] I0818 21:32:47.578832 313848 crypto.go:156] Writing cert to /home/chensq20/.minikube/profiles/minikube/apiserver.crt.dd3b5fb2 ... I0818 21:32:47.578846 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/profiles/minikube/apiserver.crt.dd3b5fb2: {Name:mkc9b0ce79bceaa349f61fda59dab7759147db5c Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.579001 313848 crypto.go:164] Writing key to /home/chensq20/.minikube/profiles/minikube/apiserver.key.dd3b5fb2 ... I0818 21:32:47.579007 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/profiles/minikube/apiserver.key.dd3b5fb2: {Name:mk2a6de824f789d01a818139a449e2676463b24e Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.579091 313848 certs.go:320] copying /home/chensq20/.minikube/profiles/minikube/apiserver.crt.dd3b5fb2 -> /home/chensq20/.minikube/profiles/minikube/apiserver.crt I0818 21:32:47.579188 313848 certs.go:324] copying /home/chensq20/.minikube/profiles/minikube/apiserver.key.dd3b5fb2 -> /home/chensq20/.minikube/profiles/minikube/apiserver.key I0818 21:32:47.579247 313848 certs.go:302] generating aggregator signed cert: /home/chensq20/.minikube/profiles/minikube/proxy-client.key I0818 21:32:47.579261 313848 crypto.go:68] Generating cert /home/chensq20/.minikube/profiles/minikube/proxy-client.crt with IP's: [] I0818 21:32:47.903200 313848 crypto.go:156] Writing cert to /home/chensq20/.minikube/profiles/minikube/proxy-client.crt ... I0818 21:32:47.903218 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/profiles/minikube/proxy-client.crt: {Name:mk2c5a4e3166834fad7e89b6fbd6e3a5882e7f4d Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.903444 313848 crypto.go:164] Writing key to /home/chensq20/.minikube/profiles/minikube/proxy-client.key ... I0818 21:32:47.903450 313848 lock.go:35] WriteFile acquiring /home/chensq20/.minikube/profiles/minikube/proxy-client.key: {Name:mkcea6bd810f17ff98a91ec5b2819dc83789ae3d Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0818 21:32:47.903645 313848 certs.go:388] found cert: /home/chensq20/.minikube/certs/home/chensq20/.minikube/certs/ca-key.pem (1679 bytes) I0818 21:32:47.903679 313848 certs.go:388] found cert: /home/chensq20/.minikube/certs/home/chensq20/.minikube/certs/ca.pem (1082 bytes) I0818 21:32:47.903750 313848 certs.go:388] found cert: /home/chensq20/.minikube/certs/home/chensq20/.minikube/certs/cert.pem (1127 bytes) I0818 21:32:47.903779 313848 certs.go:388] found cert: /home/chensq20/.minikube/certs/home/chensq20/.minikube/certs/key.pem (1679 bytes) I0818 21:32:47.904566 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/profiles/minikube/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes) I0818 21:32:47.928309 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/profiles/minikube/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes) I0818 21:32:47.951258 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/profiles/minikube/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes) I0818 21:32:47.975071 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/profiles/minikube/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes) I0818 21:32:47.999716 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes) I0818 21:32:48.023451 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes) I0818 21:32:48.046518 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes) I0818 21:32:48.069805 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes) I0818 21:32:48.092393 313848 ssh_runner.go:362] scp /home/chensq20/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes) I0818 21:32:48.122498 313848 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes) I0818 21:32:48.141232 313848 ssh_runner.go:195] Run: openssl version I0818 21:32:48.147371 313848 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem" I0818 21:32:48.157766 313848 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem I0818 21:32:48.162015 313848 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Aug 18 13:32 /usr/share/ca-certificates/minikubeCA.pem I0818 21:32:48.162043 313848 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem I0818 21:32:48.169983 313848 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0" I0818 21:32:48.182946 313848 kubeadm.go:395] StartCluster: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:registry.cn-hangzhou.aliyuncs.com/google_containers/kicbase:v0.0.33@sha256:73b259e144d926189cf169ae5b46bbec4e08e4e2f2bd87296054c3244f70feb8 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository:registry.cn-hangzhou.aliyuncs.com/google_containers LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.24.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/chensq20:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:} I0818 21:32:48.183044 313848 sshrunner.go:195] Run: docker ps --filter status=paused --filter=name=k8s.*(kube-system) --format={{.ID}} I0818 21:32:48.223878 313848 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd I0818 21:32:48.232734 313848 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml I0818 21:32:48.240947 313848 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver I0818 21:32:48.240976 313848 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf I0818 21:32:48.248818 313848 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2 stdout:

stderr: ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory I0818 21:32:48.248849 313848 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables" I0818 21:32:48.634566 313848 out.go:204] - Generating certificates and keys ... I0818 21:32:51.435003 313848 out.go:204] - Booting up control plane ... W0818 21:36:51.443611 313848 out.go:239] ! initialization failed, will try again: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables": Process exited with status 1 stdout: [init] Using Kubernetes version: v1.24.3 [preflight] Running pre-flight checks [preflight] The system verification failed. Printing the output from the verification: KERNEL_VERSION: 3.10.0-1160.36.2.el7.x86_64 OS: Linux CGROUPS_CPU: enabled CGROUPS_CPUACCT: enabled CGROUPS_CPUSET: enabled CGROUPS_DEVICES: enabled CGROUPS_FREEZER: enabled CGROUPS_MEMORY: enabled CGROUPS_PIDS: enabled CGROUPS_HUGETLB: enabled CGROUPS_BLKIO: enabled [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' [certs] Using certificateDir folder "/var/lib/minikube/certs" [certs] Using existing ca certificate authority [certs] Using existing apiserver certificate and key on disk [certs] Generating "apiserver-kubelet-client" certificate and key [certs] Generating "front-proxy-ca" certificate and key [certs] Generating "front-proxy-client" certificate and key [certs] Generating "etcd/ca" certificate and key [certs] Generating "etcd/server" certificate and key [certs] etcd/server serving cert is signed for DNS names [localhost minikube] and IPs [192.168.49.2 127.0.0.1 ::1] [certs] Generating "etcd/peer" certificate and key [certs] etcd/peer serving cert is signed for DNS names [localhost minikube] and IPs [192.168.49.2 127.0.0.1 ::1] [certs] Generating "etcd/healthcheck-client" certificate and key [certs] Generating "apiserver-etcd-client" certificate and key [certs] Generating "sa" key and public key [kubeconfig] Using kubeconfig folder "/etc/kubernetes" [kubeconfig] Writing "admin.conf" kubeconfig file [kubeconfig] Writing "kubelet.conf" kubeconfig file [kubeconfig] Writing "controller-manager.conf" kubeconfig file [kubeconfig] Writing "scheduler.conf" kubeconfig file [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" [kubelet-start] Starting the kubelet [control-plane] Using manifest folder "/etc/kubernetes/manifests" [control-plane] Creating static Pod manifest for "kube-apiserver" [control-plane] Creating static Pod manifest for "kube-controller-manager" [control-plane] Creating static Pod manifest for "kube-scheduler" [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests" [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s [kubelet-check] Initial timeout of 40s passed.

Unfortunately, an error has occurred: timed out waiting for the condition

This error is likely caused by:

If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:

Additionally, a control plane component may have crashed or exited when started by the container runtime. To troubleshoot, list all containers using your preferred container runtimes CLI. Here is one example how you may list all running Kubernetes containers by using crictl:

stderr: W0818 13:32:48.291504 1717 initconfiguration.go:120] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration! [WARNING FileContent--proc-sys-net-bridge-bridge-nf-call-iptables]: /proc/sys/net/bridge/bridge-nf-call-iptables does not exist [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/3.10.0-1160.36.2.el7.x86_64\n", err: exit status 1 [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster To see the stack trace of this error execute with --v=5 or higher

I0818 21:36:51.443814 313848 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.3:$PATH" kubeadm reset --cri-socket /var/run/cri-dockerd.sock --force" I0818 21:36:52.390344 313848 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet I0818 21:36:52.401653 313848 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver I0818 21:36:52.401685 313848 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf I0818 21:36:52.409771 313848 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2 stdout:

stderr: ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory I0818 21:36:52.409800 313848 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables" I0818 21:36:53.293323 313848 out.go:204] - Generating certificates and keys ... I0818 21:36:53.731987 313848 out.go:204] - Booting up control plane ...

Operating System

No response

Driver

No response

bitpeng commented 2 years ago

logs.txt

x-giraffee commented 2 years ago

same problem, confusing me —>kubelet service is not enabled

fireinrain commented 2 years ago

same problem, confusing me —>kubelet service is not enabled

I got the same problem.

klaases commented 1 year ago

Hi @bitpeng – for additional assistance, please consider reaching out to the minikube community:

https://minikube.sigs.k8s.io/community/

We also offer support through Slack, Groups, and office hours.

/triage needs-information /kind support

k8s-triage-robot commented 1 year ago

The Kubernetes project currently lacks enough contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

spowelljr commented 1 year ago

Hi @bitpeng, the cause is the docker container-runtime is trying to pull something from k8s.gcr.io but because you're in China it's blocked and it's causing your minikube to fail starting. We should investigate why it's trying to access it.

ComradeProgrammer commented 1 year ago

/remove-lifecycle stale

shamablyat commented 1 year ago

same problem

ComradeProgrammer commented 1 year ago

I thiink there is a workaround: Fall back to kubernetes v1.23.8 or lower

Use minikube start --image-mirror-country='cn' --kubernetes-version=v1.23.8 or minikube start --image-repository=registry.cn-hangzhou.aliyuncs.com/google_containers --kubernetes-version=v1.23.8 Minikube will work.

To be honest, I don't know why this is happening at all...(I have explained what I found to @spowelljr)

k8s-triage-robot commented 1 year ago

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

k8s-triage-robot commented 1 year ago

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle rotten

k8s-triage-robot commented 8 months ago

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs.

This bot triages issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/close not-planned

k8s-ci-robot commented 8 months ago

@k8s-triage-robot: Closing this issue, marking it as "Not Planned".

In response to [this](https://github.com/kubernetes/minikube/issues/14813#issuecomment-1899564684): >The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs. > >This bot triages issues according to the following rules: >- After 90d of inactivity, `lifecycle/stale` is applied >- After 30d of inactivity since `lifecycle/stale` was applied, `lifecycle/rotten` is applied >- After 30d of inactivity since `lifecycle/rotten` was applied, the issue is closed > >You can: >- Reopen this issue with `/reopen` >- Mark this issue as fresh with `/remove-lifecycle rotten` >- Offer to help out with [Issue Triage][1] > >Please send feedback to sig-contributor-experience at [kubernetes/community](https://github.com/kubernetes/community). > >/close not-planned > >[1]: https://www.kubernetes.dev/docs/guide/issue-triage/ Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.