kubernetes / minikube

Run Kubernetes locally
https://minikube.sigs.k8s.io/
Apache License 2.0
29.33k stars 4.88k forks source link

❌ Exiting due to K8S_INSTALL_FAILED #16985

Closed adilwahla closed 6 months ago

adilwahla commented 1 year ago

What Happened?

❌ Exiting due to K8S_INSTALL_FAILED: Failed to update cluster: updating control plane: downloading binaries: downloading kubelet: download failed: https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubelet.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubelet.sha256 Dst:/home/adil/.minikube/cache/linux/amd64/v1.27.3/kubelet.download Pwd: Mode:2 Umask:---------- Detectors:[0x3f98710 0x3f98710 0x3f98710 0x3f98710 0x3f98710 0x3f98710 0x3f98710] Decompressors:map[bz2:0xc000604ed0 gz:0xc000604ed8 tar:0xc000604e80 tar.bz2:0xc000604e90 tar.gz:0xc000604ea0 tar.xz:0xc000604eb0 tar.zst:0xc000604ec0 tbz2:0xc000604e90 tgz:0xc000604ea0 txz:0xc000604eb0 tzst:0xc000604ec0 xz:0xc000604ee0 zip:0xc000604ef0 zst:0xc000604ee8] Getters:map[file:0xc00047f900 http:0xc001425270 https:0xc0014252c0] Dir:false ProgressListener:0x3f538e0 Insecure:false DisableSymlinks:false Options:[0x1d22da0]}: Get "https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubelet": remote error: tls: handshake failure

Attach the log file

Audit <== --------- ------------------- ---------- ------ --------- --------------------- --------------------- Command Args Profile User Version Start Time End Time
start minikube adil v1.31.1 02 Aug 23 02:51 PKT
config set driver docker minikube adil v1.31.1 02 Aug 23 03:01 PKT 02 Aug 23 03:01 PKT
start minikube adil v1.31.1 02 Aug 23 03:01 PKT
start minikube adil v1.31.1 02 Aug 23 03:07 PKT
--------- ------------------- ---------- ------ --------- --------------------- ---------------------

==> Last Start <== Log file created at: 2023/08/02 03:07:22 Running on machine: DESKTOP-SEIHCD2 Binary: Built with gc go1.20.6 for linux/amd64 Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg I0802 03:07:22.109568 6167 out.go:296] Setting OutFile to fd 1 ... I0802 03:07:22.109843 6167 out.go:348] isatty.IsTerminal(1) = true I0802 03:07:22.109850 6167 out.go:309] Setting ErrFile to fd 2... I0802 03:07:22.109860 6167 out.go:348] isatty.IsTerminal(2) = true I0802 03:07:22.110326 6167 root.go:338] Updating PATH: /home/adil/.minikube/bin I0802 03:07:22.111187 6167 out.go:303] Setting JSON to false I0802 03:07:22.111896 6167 start.go:128] hostinfo: {"hostname":"DESKTOP-SEIHCD2","uptime":10091,"bootTime":1690917551,"procs":53,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"5.15.90.1-microsoft-standard-WSL2","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"guest","hostId":"c2d32509-f658-4349-9f80-43b3f8142f5b"} I0802 03:07:22.111968 6167 start.go:138] virtualization: guest I0802 03:07:22.116155 6167 out.go:177] 😄 minikube v1.31.1 on Ubuntu 22.04 (amd64) I0802 03:07:22.130046 6167 notify.go:220] Checking for updates... I0802 03:07:22.130488 6167 config.go:182] Loaded profile config "minikube": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3 I0802 03:07:22.131622 6167 driver.go:373] Setting default libvirt URI to qemu:///system I0802 03:07:22.163791 6167 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community I0802 03:07:22.163854 6167 cli_runner.go:164] Run: docker system info --format "{{json .}}" I0802 03:07:22.196251 6167 info.go:266] docker info: {ID:8ff6982a-5ced-420c-b313-927b2acc90cb Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:45 SystemTime:2023-08-02 03:07:22.184324447 +0500 PKT LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.90.1-microsoft-standard-WSL2 OperatingSystem:Ubuntu 22.04.2 LTS OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:4 MemTotal:4016852992 GenericResources: DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:DESKTOP-SEIHCD2 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-buildx: no such file or directory Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx ShadowedPaths:[/usr/libexec/docker/cli-plugins/docker-buildx]] map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-compose: no such file or directory Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose ShadowedPaths:[/usr/libexec/docker/cli-plugins/docker-compose]] map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-dev: no such file or directory Name:dev Path:/usr/local/lib/docker/cli-plugins/docker-dev] map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-extension: no such file or directory Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension] map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-init: no such file or directory Name:init Path:/usr/local/lib/docker/cli-plugins/docker-init] map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-sbom: no such file or directory Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom] map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-scan: no such file or directory Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan] map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-scout: no such file or directory Name:scout Path:/usr/local/lib/docker/cli-plugins/docker-scout]] Warnings:}} I0802 03:07:22.196391 6167 docker.go:294] overlay module found I0802 03:07:22.203920 6167 out.go:177] ✨ Using the docker driver based on existing profile I0802 03:07:22.207929 6167 start.go:298] selected driver: docker I0802 03:07:22.207966 6167 start.go:898] validating driver "docker" against &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:docker.io/kicbase/stable:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/adil:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0} I0802 03:07:22.208076 6167 start.go:909] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: Version:} I0802 03:07:22.208282 6167 cli_runner.go:164] Run: docker system info --format "{{json .}}" I0802 03:07:22.245792 6167 info.go:266] docker info: {ID:8ff6982a-5ced-420c-b313-927b2acc90cb Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:45 SystemTime:2023-08-02 03:07:22.233207834 +0500 PKT LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.90.1-microsoft-standard-WSL2 OperatingSystem:Ubuntu 22.04.2 LTS OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:4 MemTotal:4016852992 GenericResources: DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:DESKTOP-SEIHCD2 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-buildx: no such file or directory Name:buildx Path:/usr/local/lib/docker/cli-plugins/docker-buildx ShadowedPaths:[/usr/libexec/docker/cli-plugins/docker-buildx]] map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-compose: no such file or directory Name:compose Path:/usr/local/lib/docker/cli-plugins/docker-compose ShadowedPaths:[/usr/libexec/docker/cli-plugins/docker-compose]] map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-dev: no such file or directory Name:dev Path:/usr/local/lib/docker/cli-plugins/docker-dev] map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-extension: no such file or directory Name:extension Path:/usr/local/lib/docker/cli-plugins/docker-extension] map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-init: no such file or directory Name:init Path:/usr/local/lib/docker/cli-plugins/docker-init] map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-sbom: no such file or directory Name:sbom Path:/usr/local/lib/docker/cli-plugins/docker-sbom] map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-scan: no such file or directory Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan] map[Err:failed to fetch metadata: fork/exec /usr/local/lib/docker/cli-plugins/docker-scout: no such file or directory Name:scout Path:/usr/local/lib/docker/cli-plugins/docker-scout]] Warnings:}} I0802 03:07:22.246432 6167 cni.go:84] Creating CNI manager for "" I0802 03:07:22.246444 6167 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge I0802 03:07:22.246483 6167 start_flags.go:319] config: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:docker.io/kicbase/stable:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/adil:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0} I0802 03:07:22.254986 6167 out.go:177] 👍 Starting control plane node minikube in cluster minikube I0802 03:07:22.260372 6167 cache.go:122] Beginning downloading kic base image for docker with docker I0802 03:07:22.265562 6167 out.go:177] 🚜 Pulling base image ... I0802 03:07:22.271583 6167 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker I0802 03:07:22.271658 6167 preload.go:148] Found local preload: /home/adil/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-amd64.tar.lz4 I0802 03:07:22.271667 6167 cache.go:57] Caching tarball of preloaded images I0802 03:07:22.271872 6167 preload.go:174] Found /home/adil/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download I0802 03:07:22.271873 6167 image.go:79] Checking for docker.io/kicbase/stable:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon I0802 03:07:22.271893 6167 cache.go:60] Finished verifying existence of preloaded tar for v1.27.3 on docker I0802 03:07:22.272019 6167 profile.go:148] Saving config to /home/adil/.minikube/profiles/minikube/config.json ... I0802 03:07:22.299410 6167 image.go:83] Found docker.io/kicbase/stable:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon, skipping pull I0802 03:07:22.299430 6167 cache.go:145] docker.io/kicbase/stable:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 exists in daemon, skipping load I0802 03:07:22.299469 6167 cache.go:195] Successfully downloaded all kic artifacts I0802 03:07:22.299498 6167 start.go:365] acquiring machines lock for minikube: {Name:mkd7422f72dd00d2f5cee3c19c7c2a27c798b2e6 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0802 03:07:22.299612 6167 start.go:369] acquired machines lock for "minikube" in 95.1µs I0802 03:07:22.299627 6167 start.go:96] Skipping create...Using existing machine configuration I0802 03:07:22.299631 6167 fix.go:54] fixHost starting: I0802 03:07:22.299887 6167 cli_runner.go:164] Run: docker container inspect minikube --format={{.State.Status}} I0802 03:07:22.324253 6167 fix.go:102] recreateIfNeeded on minikube: state=Running err= W0802 03:07:22.324273 6167 fix.go:128] unexpected machine state, will restart: I0802 03:07:22.328799 6167 out.go:177] 🏃 Updating the running docker "minikube" container ... I0802 03:07:22.333939 6167 machine.go:88] provisioning docker machine ... I0802 03:07:22.333962 6167 ubuntu.go:169] provisioning hostname "minikube" I0802 03:07:22.334034 6167 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0802 03:07:22.361538 6167 main.go:141] libmachine: Using SSH client type: native I0802 03:07:22.362107 6167 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x80eb00] 0x811ba0 [] 0s} 127.0.0.1 32772 } I0802 03:07:22.362114 6167 main.go:141] libmachine: About to run SSH command: sudo hostname minikube && echo "minikube" | sudo tee /etc/hostname I0802 03:07:22.536874 6167 main.go:141] libmachine: SSH cmd err, output: : minikube

I0802 03:07:22.536959 6167 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0802 03:07:22.557321 6167 main.go:141] libmachine: Using SSH client type: native I0802 03:07:22.557995 6167 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x80eb00] 0x811ba0 [] 0s} 127.0.0.1 32772 } I0802 03:07:22.558008 6167 main.go:141] libmachine: About to run SSH command:

            if ! grep -xq '.*\sminikube' /etc/hosts; then
                    if grep -xq '127.0.1.1\s.*' /etc/hosts; then
                            sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 minikube/g' /etc/hosts;
                    else
                            echo '127.0.1.1 minikube' | sudo tee -a /etc/hosts;
                    fi
            fi

I0802 03:07:22.692828 6167 main.go:141] libmachine: SSH cmd err, output: : I0802 03:07:22.692844 6167 ubuntu.go:175] set auth options {CertDir:/home/adil/.minikube CaCertPath:/home/adil/.minikube/certs/ca.pem CaPrivateKeyPath:/home/adil/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/adil/.minikube/machines/server.pem ServerKeyPath:/home/adil/.minikube/machines/server-key.pem ClientKeyPath:/home/adil/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/adil/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/adil/.minikube} I0802 03:07:22.692885 6167 ubuntu.go:177] setting up certificates I0802 03:07:22.692903 6167 provision.go:83] configureAuth start I0802 03:07:22.692974 6167 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" minikube I0802 03:07:22.711255 6167 provision.go:138] copyHostCerts I0802 03:07:22.711303 6167 exec_runner.go:144] found /home/adil/.minikube/ca.pem, removing ... I0802 03:07:22.711308 6167 exec_runner.go:203] rm: /home/adil/.minikube/ca.pem I0802 03:07:22.711395 6167 exec_runner.go:151] cp: /home/adil/.minikube/certs/ca.pem --> /home/adil/.minikube/ca.pem (1070 bytes) I0802 03:07:22.711524 6167 exec_runner.go:144] found /home/adil/.minikube/cert.pem, removing ... I0802 03:07:22.711527 6167 exec_runner.go:203] rm: /home/adil/.minikube/cert.pem I0802 03:07:22.711570 6167 exec_runner.go:151] cp: /home/adil/.minikube/certs/cert.pem --> /home/adil/.minikube/cert.pem (1115 bytes) I0802 03:07:22.711631 6167 exec_runner.go:144] found /home/adil/.minikube/key.pem, removing ... I0802 03:07:22.711634 6167 exec_runner.go:203] rm: /home/adil/.minikube/key.pem I0802 03:07:22.711677 6167 exec_runner.go:151] cp: /home/adil/.minikube/certs/key.pem --> /home/adil/.minikube/key.pem (1679 bytes) I0802 03:07:22.711759 6167 provision.go:112] generating server cert: /home/adil/.minikube/machines/server.pem ca-key=/home/adil/.minikube/certs/ca.pem private-key=/home/adil/.minikube/certs/ca-key.pem org=adil.minikube san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube minikube] I0802 03:07:23.128091 6167 provision.go:172] copyRemoteCerts I0802 03:07:23.128140 6167 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker I0802 03:07:23.128195 6167 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0802 03:07:23.150834 6167 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/adil/.minikube/machines/minikube/id_rsa Username:docker} I0802 03:07:23.260713 6167 ssh_runner.go:362] scp /home/adil/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes) I0802 03:07:23.312887 6167 ssh_runner.go:362] scp /home/adil/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1070 bytes) I0802 03:07:23.366629 6167 ssh_runner.go:362] scp /home/adil/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes) I0802 03:07:23.418128 6167 provision.go:86] duration metric: configureAuth took 725.211807ms I0802 03:07:23.418147 6167 ubuntu.go:193] setting minikube options for container-runtime I0802 03:07:23.418304 6167 config.go:182] Loaded profile config "minikube": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3 I0802 03:07:23.418373 6167 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0802 03:07:23.439106 6167 main.go:141] libmachine: Using SSH client type: native I0802 03:07:23.439603 6167 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x80eb00] 0x811ba0 [] 0s} 127.0.0.1 32772 } I0802 03:07:23.439624 6167 main.go:141] libmachine: About to run SSH command: df --output=fstype / | tail -n 1 I0802 03:07:23.577318 6167 main.go:141] libmachine: SSH cmd err, output: : overlay

I0802 03:07:23.577337 6167 ubuntu.go:71] root file system type: overlay I0802 03:07:23.577561 6167 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ... I0802 03:07:23.577665 6167 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0802 03:07:23.614163 6167 main.go:141] libmachine: Using SSH client type: native I0802 03:07:23.614670 6167 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x80eb00] 0x811ba0 [] 0s} 127.0.0.1 32772 } I0802 03:07:23.614732 6167 main.go:141] libmachine: About to run SSH command: sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com BindsTo=containerd.service After=network-online.target firewalld.service containerd.service Wants=network-online.target Requires=docker.socket StartLimitBurst=3 StartLimitIntervalSec=60

[Service] Type=notify Restart=on-failure

This file is a systemd drop-in unit that inherits from the base dockerd configuration.

The base configuration already specifies an 'ExecStart=...' command. The first directive

here is to clear out that command inherited from the base configuration. Without this,

the command from the base configuration and the command specified here are treated as

a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

will catch this invalid input and refuse to start the service with an error like:

Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

container runtimes. If left unlimited, it may result in OOM issues with MySQL.

ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP \$MAINPID

Having non-zero Limit*s causes performance problems due to accounting overhead

in the kernel. We recommend using cgroups to do container-local accounting.

LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity

Uncomment TasksMax if your systemd version supports it.

Only systemd 226 and above support this version.

TasksMax=infinity TimeoutStartSec=0

set delegate yes so that systemd does not reset the cgroups of docker containers

Delegate=yes

kill only the docker process, not all processes in the cgroup

KillMode=process

[Install] WantedBy=multi-user.target " | sudo tee /lib/systemd/system/docker.service.new I0802 03:07:23.818871 6167 main.go:141] libmachine: SSH cmd err, output: : [Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com BindsTo=containerd.service After=network-online.target firewalld.service containerd.service Wants=network-online.target Requires=docker.socket StartLimitBurst=3 StartLimitIntervalSec=60

[Service] Type=notify Restart=on-failure

This file is a systemd drop-in unit that inherits from the base dockerd configuration.

The base configuration already specifies an 'ExecStart=...' command. The first directive

here is to clear out that command inherited from the base configuration. Without this,

the command from the base configuration and the command specified here are treated as

a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

will catch this invalid input and refuse to start the service with an error like:

Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

container runtimes. If left unlimited, it may result in OOM issues with MySQL.

ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP $MAINPID

Having non-zero Limit*s causes performance problems due to accounting overhead

in the kernel. We recommend using cgroups to do container-local accounting.

LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity

Uncomment TasksMax if your systemd version supports it.

Only systemd 226 and above support this version.

TasksMax=infinity TimeoutStartSec=0

set delegate yes so that systemd does not reset the cgroups of docker containers

Delegate=yes

kill only the docker process, not all processes in the cgroup

KillMode=process

[Install] WantedBy=multi-user.target

I0802 03:07:23.818961 6167 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0802 03:07:23.840472 6167 main.go:141] libmachine: Using SSH client type: native I0802 03:07:23.840939 6167 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x80eb00] 0x811ba0 [] 0s} 127.0.0.1 32772 } I0802 03:07:23.840951 6167 main.go:141] libmachine: About to run SSH command: sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; } I0802 03:07:23.989513 6167 main.go:141] libmachine: SSH cmd err, output: : I0802 03:07:23.989526 6167 machine.go:91] provisioned docker machine in 1.655577061s I0802 03:07:23.989536 6167 start.go:300] post-start starting for "minikube" (driver="docker") I0802 03:07:23.989549 6167 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs] I0802 03:07:23.989615 6167 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs I0802 03:07:23.989673 6167 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0802 03:07:24.011703 6167 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/adil/.minikube/machines/minikube/id_rsa Username:docker} I0802 03:07:24.159676 6167 ssh_runner.go:195] Run: cat /etc/os-release I0802 03:07:24.168699 6167 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found I0802 03:07:24.168764 6167 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found I0802 03:07:24.168804 6167 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found I0802 03:07:24.168821 6167 info.go:137] Remote host: Ubuntu 22.04.2 LTS I0802 03:07:24.168834 6167 filesync.go:126] Scanning /home/adil/.minikube/addons for local assets ... I0802 03:07:24.168950 6167 filesync.go:126] Scanning /home/adil/.minikube/files for local assets ... I0802 03:07:24.169000 6167 start.go:303] post-start completed in 179.456452ms I0802 03:07:24.169072 6167 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'" I0802 03:07:24.169132 6167 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0802 03:07:24.210237 6167 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/adil/.minikube/machines/minikube/id_rsa Username:docker} I0802 03:07:24.308626 6167 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'" I0802 03:07:24.320638 6167 fix.go:56] fixHost completed within 2.020992064s I0802 03:07:24.320664 6167 start.go:83] releasing machines lock for "minikube", held for 2.021040364s I0802 03:07:24.320799 6167 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" minikube I0802 03:07:24.354165 6167 ssh_runner.go:195] Run: cat /version.json I0802 03:07:24.354213 6167 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0802 03:07:24.354316 6167 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/ I0802 03:07:24.354396 6167 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0802 03:07:24.375095 6167 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/adil/.minikube/machines/minikube/id_rsa Username:docker} I0802 03:07:24.378809 6167 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/adil/.minikube/machines/minikube/id_rsa Username:docker} I0802 03:07:25.329518 6167 ssh_runner.go:195] Run: systemctl --version I0802 03:07:25.345458 6167 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/loopback.conf" I0802 03:07:25.362546 6167 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name loopback.conf -not -name .mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": "."|"cniVersion": "1.0.0"|g' {}" ; I0802 03:07:25.405680 6167 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/loopback.conf" found I0802 03:07:25.405742 6167 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name bridge -or -name podman ) -and -not -name .mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ; I0802 03:07:25.426002 6167 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable I0802 03:07:25.426019 6167 start.go:466] detecting cgroup driver to use... I0802 03:07:25.426051 6167 detect.go:196] detected "cgroupfs" cgroup driver on host os I0802 03:07:25.426141 6167 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock " | sudo tee /etc/crictl.yaml" I0802 03:07:25.461660 6167 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( )sandbox_image = .$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml" I0802 03:07:25.482363 6167 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( )restrict_oom_score_adj = .$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml" I0802 03:07:25.502606 6167 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver... I0802 03:07:25.502670 6167 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( )SystemdCgroup = .$|\1SystemdCgroup = false|g' /etc/containerd/config.toml" I0802 03:07:25.522262 6167 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml" I0802 03:07:25.542258 6167 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml" I0802 03:07:25.561806 6167 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml" I0802 03:07:25.581866 6167 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk" I0802 03:07:25.601397 6167 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( )conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml" I0802 03:07:25.621082 6167 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables I0802 03:07:25.639539 6167 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward" I0802 03:07:25.658138 6167 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0802 03:07:25.787062 6167 ssh_runner.go:195] Run: sudo systemctl restart containerd I0802 03:07:25.916236 6167 start.go:466] detecting cgroup driver to use... I0802 03:07:25.916275 6167 detect.go:196] detected "cgroupfs" cgroup driver on host os I0802 03:07:25.916347 6167 ssh_runner.go:195] Run: sudo systemctl cat docker.service I0802 03:07:25.940740 6167 cruntime.go:276] skipping containerd shutdown because we are bound to it I0802 03:07:25.940888 6167 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio I0802 03:07:25.966827 6167 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock " | sudo tee /etc/crictl.yaml" I0802 03:07:26.009646 6167 ssh_runner.go:195] Run: which cri-dockerd I0802 03:07:26.013914 6167 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d I0802 03:07:26.033881 6167 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes) I0802 03:07:26.069217 6167 ssh_runner.go:195] Run: sudo systemctl unmask docker.service I0802 03:07:26.213423 6167 ssh_runner.go:195] Run: sudo systemctl enable docker.socket I0802 03:07:26.350369 6167 docker.go:535] configuring docker to use "cgroupfs" as cgroup driver... I0802 03:07:26.350387 6167 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes) I0802 03:07:26.388553 6167 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0802 03:07:26.532807 6167 ssh_runner.go:195] Run: sudo systemctl restart docker I0802 03:07:28.881653 6167 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.348826465s) I0802 03:07:28.881705 6167 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket I0802 03:07:29.024104 6167 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket I0802 03:07:29.157138 6167 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket I0802 03:07:29.285657 6167 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0802 03:07:29.420148 6167 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket I0802 03:07:29.452644 6167 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0802 03:07:29.612155 6167 ssh_runner.go:195] Run: sudo systemctl restart cri-docker I0802 03:07:29.726772 6167 start.go:513] Will wait 60s for socket path /var/run/cri-dockerd.sock I0802 03:07:29.726834 6167 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock I0802 03:07:29.731657 6167 start.go:534] Will wait 60s for crictl version I0802 03:07:29.731710 6167 ssh_runner.go:195] Run: which crictl I0802 03:07:29.736158 6167 ssh_runner.go:195] Run: sudo /usr/bin/crictl version I0802 03:07:29.811977 6167 start.go:550] Version: 0.1.0 RuntimeName: docker RuntimeVersion: 24.0.4 RuntimeApiVersion: v1 I0802 03:07:29.812020 6167 ssh_runner.go:195] Run: docker version --format {{.Server.Version}} I0802 03:07:29.841306 6167 ssh_runner.go:195] Run: docker version --format {{.Server.Version}} I0802 03:07:29.882524 6167 out.go:204] 🐳 Preparing Kubernetes v1.27.3 on Docker 24.0.4 ... I0802 03:07:29.882763 6167 cli_runner.go:164] Run: docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" I0802 03:07:29.902825 6167 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts I0802 03:07:29.908255 6167 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" minikube I0802 03:07:29.928611 6167 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker I0802 03:07:29.928685 6167 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}} I0802 03:07:29.950360 6167 docker.go:636] Got preloaded images: I0802 03:07:29.950375 6167 docker.go:642] registry.k8s.io/kube-apiserver:v1.27.3 wasn't preloaded I0802 03:07:29.950413 6167 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json I0802 03:07:29.968486 6167 ssh_runner.go:195] Run: which lz4 I0802 03:07:29.973203 6167 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4 I0802 03:07:29.977759 6167 ssh_runner.go:352] existence check for /preloaded.tar.lz4: source file and destination file are different sizes I0802 03:07:29.977783 6167 ssh_runner.go:362] scp /home/adil/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (4096 bytes) I0802 03:07:30.015064 6167 kubeadm.go:936] preload failed, will try to load cached images: copying file: sudo test -d / && sudo scp -t / && sudo touch -d "2023-08-02 02:57:51.049133423 +0500" /preloaded.tar.lz4: Process exited with status 1 output: scp: Broken pipe I0802 03:07:30.015151 6167 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}} I0802 03:07:30.038783 6167 docker.go:636] Got preloaded images: I0802 03:07:30.038794 6167 docker.go:642] registry.k8s.io/kube-apiserver:v1.27.3 wasn't preloaded I0802 03:07:30.038801 6167 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.27.3 registry.k8s.io/kube-controller-manager:v1.27.3 registry.k8s.io/kube-scheduler:v1.27.3 registry.k8s.io/kube-proxy:v1.27.3 registry.k8s.io/pause:3.9 registry.k8s.io/etcd:3.5.7-0 registry.k8s.io/coredns/coredns:v1.10.1 gcr.io/k8s-minikube/storage-provisioner:v5] I0802 03:07:30.040735 6167 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.10.1 I0802 03:07:30.040852 6167 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5 I0802 03:07:30.040913 6167 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.27.3 I0802 03:07:30.041015 6167 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.27.3 I0802 03:07:30.041030 6167 image.go:134] retrieving image: registry.k8s.io/pause:3.9 I0802 03:07:30.041096 6167 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.27.3 I0802 03:07:30.040735 6167 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.27.3 I0802 03:07:30.041480 6167 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.27.3: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.27.3 I0802 03:07:30.046785 6167 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.10.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.10.1 I0802 03:07:30.046785 6167 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5 I0802 03:07:30.046785 6167 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.27.3: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.27.3 I0802 03:07:30.047225 6167 image.go:177] daemon lookup for registry.k8s.io/pause:3.9: Error response from daemon: No such image: registry.k8s.io/pause:3.9 I0802 03:07:30.047305 6167 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.27.3: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.27.3 I0802 03:07:30.047305 6167 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.27.3: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.27.3 I0802 03:07:30.048932 6167 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.7-0 I0802 03:07:30.050387 6167 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.7-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.7-0 I0802 03:07:34.582794 6167 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns/coredns:v1.10.1 I0802 03:07:34.582895 6167 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.27.3 I0802 03:07:34.602207 6167 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.9 I0802 03:07:34.607304 6167 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.27.3 I0802 03:07:34.651332 6167 cache_images.go:116] "registry.k8s.io/coredns/coredns:v1.10.1" needs transfer: "registry.k8s.io/coredns/coredns:v1.10.1" does not exist at hash "ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc" in container runtime I0802 03:07:34.651367 6167 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.27.3" needs transfer: "registry.k8s.io/kube-scheduler:v1.27.3" does not exist at hash "41697ceeb70b3f49e54ed46f2cf27ac5b3a201a7d9668ca327588b23fafdf36a" in container runtime I0802 03:07:34.651370 6167 docker.go:316] Removing image: registry.k8s.io/coredns/coredns:v1.10.1 I0802 03:07:34.651387 6167 docker.go:316] Removing image: registry.k8s.io/kube-scheduler:v1.27.3 I0802 03:07:34.651430 6167 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.27.3 I0802 03:07:34.651432 6167 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns/coredns:v1.10.1 I0802 03:07:34.651472 6167 cache_images.go:116] "registry.k8s.io/pause:3.9" needs transfer: "registry.k8s.io/pause:3.9" does not exist at hash "e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c" in container runtime I0802 03:07:34.651486 6167 docker.go:316] Removing image: registry.k8s.io/pause:3.9 I0802 03:07:34.651514 6167 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.9 I0802 03:07:34.669284 6167 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.27.3" needs transfer: "registry.k8s.io/kube-proxy:v1.27.3" does not exist at hash "5780543258cf06f98595c003c0c6d22768d1fc8e9852e2839018a4bb3bfe163c" in container runtime I0802 03:07:34.669319 6167 docker.go:316] Removing image: registry.k8s.io/kube-proxy:v1.27.3 I0802 03:07:34.669366 6167 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.27.3 I0802 03:07:34.709979 6167 cache_images.go:286] Loading image from: /home/adil/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.10.1 I0802 03:07:34.710020 6167 cache_images.go:286] Loading image from: /home/adil/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.27.3 I0802 03:07:34.710033 6167 cache_images.go:286] Loading image from: /home/adil/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 I0802 03:07:34.710063 6167 cache_images.go:286] Loading image from: /home/adil/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.27.3 I0802 03:07:34.744099 6167 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.27.3 I0802 03:07:34.768436 6167 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.27.3" needs transfer: "registry.k8s.io/kube-apiserver:v1.27.3" does not exist at hash "08a0c939e61b7340db53ebf07b4d0e908a35ad8d94e2cb7d0f958210e567079a" in container runtime I0802 03:07:34.768489 6167 docker.go:316] Removing image: registry.k8s.io/kube-apiserver:v1.27.3 I0802 03:07:34.768550 6167 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.27.3 I0802 03:07:34.792482 6167 cache_images.go:286] Loading image from: /home/adil/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.27.3 I0802 03:07:34.826161 6167 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.27.3 I0802 03:07:34.849849 6167 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.27.3" needs transfer: "registry.k8s.io/kube-controller-manager:v1.27.3" does not exist at hash "7cffc01dba0e151e525544f87958d12c0fa62a9f173bbc930200ce815f2aaf3f" in container runtime I0802 03:07:34.849891 6167 docker.go:316] Removing image: registry.k8s.io/kube-controller-manager:v1.27.3 I0802 03:07:34.849936 6167 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.27.3 I0802 03:07:34.873480 6167 cache_images.go:286] Loading image from: /home/adil/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.27.3 I0802 03:07:35.326279 6167 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.5.7-0 I0802 03:07:35.396006 6167 cache_images.go:116] "registry.k8s.io/etcd:3.5.7-0" needs transfer: "registry.k8s.io/etcd:3.5.7-0" does not exist at hash "86b6af7dd652c1b38118be1c338e9354b33469e69a218f7e290a0ca5304ad681" in container runtime I0802 03:07:35.396048 6167 docker.go:316] Removing image: registry.k8s.io/etcd:3.5.7-0 I0802 03:07:35.396113 6167 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.5.7-0 I0802 03:07:35.421731 6167 cache_images.go:286] Loading image from: /home/adil/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.7-0 I0802 03:07:40.040709 6167 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: needs transfer timed out in 10.000000 seconds I0802 03:07:40.040765 6167 docker.go:316] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5 I0802 03:07:40.040953 6167 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5 I0802 03:07:40.095852 6167 cache_images.go:286] Loading image from: /home/adil/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 I0802 03:07:40.095918 6167 cache_images.go:92] LoadImages completed in 10.057095814s W0802 03:07:40.096096 6167 out.go:239] ❌ Unable to load cached images: loading cached images: stat /home/adil/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.10.1: no such file or directory I0802 03:07:40.096380 6167 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}} I0802 03:07:40.181805 6167 cni.go:84] Creating CNI manager for "" I0802 03:07:40.181823 6167 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge I0802 03:07:40.181833 6167 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16 I0802 03:07:40.181849 6167 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.27.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:minikube NodeName:minikube DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true} I0802 03:07:40.181979 6167 kubeadm.go:181] kubeadm config: apiVersion: kubeadm.k8s.io/v1beta3 kind: InitConfiguration localAPIEndpoint: advertiseAddress: 192.168.49.2 bindPort: 8443 bootstrapTokens:

I0802 03:07:40.182085 6167 kubeadm.go:976] kubelet [Unit] Wants=docker.socket

[Service] ExecStart= ExecStart=/var/lib/minikube/binaries/v1.27.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=minikube --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2

[Install] config: {KubernetesVersion:v1.27.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} I0802 03:07:40.182172 6167 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.27.3 I0802 03:07:40.201598 6167 binaries.go:47] Didn't find k8s binaries: didn't find preexisting kubelet Initiating transfer... I0802 03:07:40.201691 6167 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.27.3 I0802 03:07:40.220364 6167 download.go:107] Downloading: https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubectl.sha256 -> /home/adil/.minikube/cache/linux/amd64/v1.27.3/kubectl I0802 03:07:40.220387 6167 download.go:107] Downloading: https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubelet.sha256 -> /home/adil/.minikube/cache/linux/amd64/v1.27.3/kubelet I0802 03:07:40.220429 6167 download.go:107] Downloading: https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubeadm.sha256 -> /home/adil/.minikube/cache/linux/amd64/v1.27.3/kubeadm W0802 03:07:44.173415 6167 image.go:258] failed to get config for gcr.io/k8s-minikube/storage-provisioner:v5: Get "https://storage.googleapis.com/artifacts.k8s-minikube.appspot.com/containers/images/sha256:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562": remote error: tls: handshake failure I0802 03:07:44.173710 6167 image.go:93] error retrieve Image gcr.io/k8s-minikube/storage-provisioner:v5 ref Get "https://storage.googleapis.com/artifacts.k8s-minikube.appspot.com/containers/images/sha256:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562": remote error: tls: handshake failure I0802 03:08:57.747319 6167 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.27.3/kubectl I0802 03:08:57.752118 6167 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.27.3/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.27.3/kubectl: Process exited with status 1 stdout:

stderr: stat: cannot statx '/var/lib/minikube/binaries/v1.27.3/kubectl': No such file or directory I0802 03:08:57.752138 6167 ssh_runner.go:362] scp /home/adil/.minikube/cache/linux/amd64/v1.27.3/kubectl --> /var/lib/minikube/binaries/v1.27.3/kubectl (49258496 bytes) I0802 03:08:58.153976 6167 out.go:177] W0802 03:08:58.156866 6167 out.go:239] ❌ Exiting due to K8S_INSTALL_FAILED: Failed to update cluster: updating control plane: downloading binaries: downloading kubelet: download failed: https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubelet.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubelet.sha256 Dst:/home/adil/.minikube/cache/linux/amd64/v1.27.3/kubelet.download Pwd: Mode:2 Umask:---------- Detectors:[0x3f98710 0x3f98710 0x3f98710 0x3f98710 0x3f98710 0x3f98710 0x3f98710] Decompressors:map[bz2:0xc000604ed0 gz:0xc000604ed8 tar:0xc000604e80 tar.bz2:0xc000604e90 tar.gz:0xc000604ea0 tar.xz:0xc000604eb0 tar.zst:0xc000604ec0 tbz2:0xc000604e90 tgz:0xc000604ea0 txz:0xc000604eb0 tzst:0xc000604ec0 xz:0xc000604ee0 zip:0xc000604ef0 zst:0xc000604ee8] Getters:map[file:0xc00047f900 http:0xc001425270 https:0xc0014252c0] Dir:false ProgressListener:0x3f538e0 Insecure:false DisableSymlinks:false Options:[0x1d22da0]}: Get "https://dl.k8s.io/release/v1.27.3/bin/linux/amd64/kubelet": remote error: tls: handshake failure W0802 03:08:58.156978 6167 out.go:239] W0802 03:08:58.158347 6167 out.go:239] ╭───────────────────────────────────────────────────────────────────────────────────────────╮ │ │ │ 😿 If the above advice does not help, please let us know: │ │ 👉 https://github.com/kubernetes/minikube/issues/new/choose │ │ │ │ Please run minikube logs --file=logs.txt and attach logs.txt to the GitHub issue. │ │ │ ╰───────────────────────────────────────────────────────────────────────────────────────────╯

Operating System

Ubuntu

Driver

Docker

k8s-triage-robot commented 8 months ago

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

k8s-triage-robot commented 7 months ago

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle rotten

k8s-triage-robot commented 6 months ago

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs.

This bot triages issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/close not-planned

k8s-ci-robot commented 6 months ago

@k8s-triage-robot: Closing this issue, marking it as "Not Planned".

In response to [this](https://github.com/kubernetes/minikube/issues/16985#issuecomment-2018595242): >The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs. > >This bot triages issues according to the following rules: >- After 90d of inactivity, `lifecycle/stale` is applied >- After 30d of inactivity since `lifecycle/stale` was applied, `lifecycle/rotten` is applied >- After 30d of inactivity since `lifecycle/rotten` was applied, the issue is closed > >You can: >- Reopen this issue with `/reopen` >- Mark this issue as fresh with `/remove-lifecycle rotten` >- Offer to help out with [Issue Triage][1] > >Please send feedback to sig-contributor-experience at [kubernetes/community](https://github.com/kubernetes/community). > >/close not-planned > >[1]: https://www.kubernetes.dev/docs/guide/issue-triage/ Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.