Minikube failed to start on Mac

[WoodpeckerBaby]

Steps to reproduce the issue:

1. minikube start

Full output of minikube logs command:

==> Audit <== |---------|------|---------|------|---------|------------|----------| | Command | Args | Profile | User | Version | Start Time | End Time | |---------|------|---------|------|---------|------------|----------| |---------|------|---------|------|---------|------------|----------| ==> Last Start <== Log file created at: 2021/09/01 21:18:35 Running on machine: username-Macbook Binary: Built with gc go1.16.5 for darwin/amd64 Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg I0901 21:18:35.783130 9994 out.go:286] Setting OutFile to fd 1 ... I0901 21:18:35.783283 9994 out.go:338] isatty.IsTerminal(1) = true I0901 21:18:35.783286 9994 out.go:299] Setting ErrFile to fd 2... I0901 21:18:35.783290 9994 out.go:338] isatty.IsTerminal(2) = true I0901 21:18:35.783384 9994 root.go:312] Updating PATH: /Users/fullusername/.minikube/bin W0901 21:18:35.783520 9994 root.go:291] Error reading config file at /Users/fullusername/.minikube/config/config.json: open /Users/fullusername/.minikube/config/config.json: no such file or directory I0901 21:18:35.783718 9994 out.go:293] Setting JSON to false I0901 21:18:35.822851 9994 start.go:111] hostinfo: {"hostname":"username-Macbook.local","uptime":381,"bootTime":1630501934,"procs":514,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.5.2","kernelVersion":"20.6.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"fecbf22b-fbbe-36de-9664-f12a7dd41d3d"} W0901 21:18:35.822974 9994 start.go:119] gopshost.Virtualization returned error: not implemented yet I0901 21:18:35.849275 9994 out.go:165] 😄 minikube v1.22.0 on Darwin 11.5.2 I0901 21:18:35.850272 9994 driver.go:335] Setting default libvirt URI to qemu:///system I0901 21:18:35.850802 9994 notify.go:169] Checking for updates... I0901 21:18:35.871033 9994 main.go:130] libmachine: Found binary path at /Users/fullusername/.minikube/bin/docker-machine-driver-hyperkit I0901 21:18:35.871123 9994 main.go:130] libmachine: Launching plugin server for driver hyperkit I0901 21:18:35.883255 9994 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:50438 I0901 21:18:35.883842 9994 main.go:130] libmachine: () Calling .GetVersion I0901 21:18:35.884343 9994 main.go:130] libmachine: Using API Version 1 I0901 21:18:35.884352 9994 main.go:130] libmachine: () Calling .SetConfigRaw I0901 21:18:35.884642 9994 main.go:130] libmachine: () Calling .GetMachineName I0901 21:18:35.884773 9994 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:18:35.916988 9994 out.go:165] ✨ Using the hyperkit driver based on existing profile I0901 21:18:35.917042 9994 start.go:278] selected driver: hyperkit I0901 21:18:35.917050 9994 start.go:751] validating driver "hyperkit" against &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.22.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:minikube Namespace: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name:m01 IP:192.168.38.3 Port:8443 KubernetesVersion:v1.21.2 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false} I0901 21:18:35.917223 9994 start.go:762] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error: Reason: Fix: Doc:} I0901 21:18:35.917420 9994 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0901 21:18:35.917652 9994 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/fullusername/.minikube/bin:/usr/local/opt/openssl@1.1/bin:/usr/local/opt/krb5/sbin:/usr/local/opt/krb5/bin:/usr/local/opt/openssl@1.1/bin:/usr/local/opt/openssl@1.1/bin:/usr/local/opt/gettext/bin:/usr/local/opt/libarchive/bin:/usr/local/opt/libarchive/bin:/usw/local/opt/qt/bin:/usr/local/opt/krb5/sbin:/usr/local/opt/krb5/bin:/usr/local/opt/icu4c/bin:/usr/local/opt/icu4c/sbin:/usr/local/opt/icu4c/bin:/opt/local/bin:/opt/local/sbin:/usr/local/opt/ruby/bin:/usr/local/sbin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Applications/VMware Fusion.app/Contents/Public:/Library/TeX/texbin:/usr/local/go/bin:/usr/local/MacGPG2/bin:/usr/local/share/dotnet:/opt/puppetlabs/pdk/bin:/opt/X11/bin:/opt/puppetlabs/bin:~/.dotnet/tools:/Library/Apple/usr/bin:~/flutter/bin I0901 21:18:35.929221 9994 install.go:137] /Users/fullusername/.minikube/bin/docker-machine-driver-hyperkit version is 1.22.0 I0901 21:18:35.935043 9994 install.go:79] stdout: /Users/fullusername/.minikube/bin/docker-machine-driver-hyperkit I0901 21:18:35.935060 9994 install.go:81] /Users/fullusername/.minikube/bin/docker-machine-driver-hyperkit looks good I0901 21:18:35.935282 9994 cni.go:93] Creating CNI manager for "" I0901 21:18:35.935290 9994 cni.go:167] CNI unnecessary in this configuration, recommending no CNI I0901 21:18:35.935300 9994 start_flags.go:275] config: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.22.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:minikube Namespace: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name:m01 IP:192.168.38.3 Port:8443 KubernetesVersion:v1.21.2 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false} I0901 21:18:35.935395 9994 iso.go:123] acquiring lock: {Name:mk8fa8d87b88d4e7aa1aa58e0bd6b19be420459f Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0901 21:18:35.983097 9994 out.go:165] 👍 Starting control plane node minikube in cluster minikube I0901 21:18:35.983141 9994 preload.go:134] Checking if preload exists for k8s version v1.21.2 and runtime docker I0901 21:18:35.983217 9994 preload.go:150] Found local preload: /Users/fullusername/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.2-docker-overlay2-amd64.tar.lz4 I0901 21:18:35.983237 9994 cache.go:56] Caching tarball of preloaded images I0901 21:18:35.983397 9994 preload.go:174] Found /Users/fullusername/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download I0901 21:18:35.983409 9994 cache.go:59] Finished verifying existence of preloaded tar for v1.21.2 on docker I0901 21:18:35.983547 9994 profile.go:148] Saving config to /Users/fullusername/.minikube/profiles/minikube/config.json ... I0901 21:18:35.984486 9994 cache.go:205] Successfully downloaded all kic artifacts I0901 21:18:35.984530 9994 start.go:313] acquiring machines lock for minikube: {Name:mk4f8cc830813856c22eca2a96ac643bde973d82 Clock:{} Delay:500ms Timeout:13m0s Cancel:} I0901 21:18:35.984608 9994 start.go:317] acquired machines lock for "minikube" in 66.016µs I0901 21:18:35.984630 9994 start.go:93] Skipping create...Using existing machine configuration I0901 21:18:35.984640 9994 fix.go:55] fixHost starting: m01 I0901 21:18:35.984959 9994 main.go:130] libmachine: Found binary path at /Users/fullusername/.minikube/bin/docker-machine-driver-hyperkit I0901 21:18:35.984986 9994 main.go:130] libmachine: Launching plugin server for driver hyperkit I0901 21:18:35.996137 9994 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:50445 I0901 21:18:35.996666 9994 main.go:130] libmachine: () Calling .GetVersion I0901 21:18:35.997105 9994 main.go:130] libmachine: Using API Version 1 I0901 21:18:35.997120 9994 main.go:130] libmachine: () Calling .SetConfigRaw I0901 21:18:35.997473 9994 main.go:130] libmachine: () Calling .GetMachineName I0901 21:18:35.997636 9994 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:18:35.997780 9994 main.go:130] libmachine: (minikube) Calling .GetState I0901 21:18:35.997911 9994 main.go:130] libmachine: (minikube) DBG | exe=/Users/fullusername/.minikube/bin/docker-machine-driver-hyperkit uid=0 I0901 21:18:35.998039 9994 main.go:130] libmachine: (minikube) DBG | hyperkit pid from json: 4630 I0901 21:18:35.999519 9994 fix.go:108] recreateIfNeeded on minikube: state=Running err= W0901 21:18:35.999544 9994 fix.go:134] unexpected machine state, will restart: I0901 21:18:36.020916 9994 out.go:165] 🏃 Updating the running hyperkit "minikube" VM ... I0901 21:18:36.021063 9994 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:18:36.021454 9994 machine.go:88] provisioning docker machine ... I0901 21:18:36.021466 9994 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:18:36.021641 9994 main.go:130] libmachine: (minikube) Calling .GetMachineName I0901 21:18:36.021764 9994 buildroot.go:166] provisioning hostname "minikube" I0901 21:18:36.021771 9994 main.go:130] libmachine: (minikube) Calling .GetMachineName I0901 21:18:36.021873 9994 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:18:36.021963 9994 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:18:36.022049 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.022133 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.022215 9994 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:18:36.022745 9994 main.go:130] libmachine: Using SSH client type: native I0901 21:18:36.022977 9994 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x44042c0] 0x4404280 [] 0s} 192.168.38.3 22 } I0901 21:18:36.022984 9994 main.go:130] libmachine: About to run SSH command: sudo hostname minikube && echo "minikube" | sudo tee /etc/hostname I0901 21:18:36.123029 9994 main.go:130] libmachine: SSH cmd err, output: : minikube I0901 21:18:36.123051 9994 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:18:36.123256 9994 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:18:36.123390 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.123560 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.123687 9994 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:18:36.124006 9994 main.go:130] libmachine: Using SSH client type: native I0901 21:18:36.124162 9994 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x44042c0] 0x4404280 [] 0s} 192.168.38.3 22 } I0901 21:18:36.124175 9994 main.go:130] libmachine: About to run SSH command: if ! grep -xq '.*\sminikube' /etc/hosts; then if grep -xq '127.0.1.1\s.*' /etc/hosts; then sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 minikube/g' /etc/hosts; else echo '127.0.1.1 minikube' | sudo tee -a /etc/hosts; fi fi I0901 21:18:36.196929 9994 main.go:130] libmachine: SSH cmd err, output: : I0901 21:18:36.196948 9994 buildroot.go:172] set auth options {CertDir:/Users/fullusername/.minikube CaCertPath:/Users/fullusername/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/fullusername/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/fullusername/.minikube/machines/server.pem ServerKeyPath:/Users/fullusername/.minikube/machines/server-key.pem ClientKeyPath:/Users/fullusername/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/fullusername/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/fullusername/.minikube} I0901 21:18:36.196961 9994 buildroot.go:174] setting up certificates I0901 21:18:36.196974 9994 provision.go:83] configureAuth start I0901 21:18:36.196981 9994 main.go:130] libmachine: (minikube) Calling .GetMachineName I0901 21:18:36.197148 9994 main.go:130] libmachine: (minikube) Calling .GetIP I0901 21:18:36.197250 9994 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:18:36.197374 9994 provision.go:137] copyHostCerts I0901 21:18:36.197470 9994 exec_runner.go:145] found /Users/fullusername/.minikube/key.pem, removing ... I0901 21:18:36.197477 9994 exec_runner.go:190] rm: /Users/fullusername/.minikube/key.pem I0901 21:18:36.197922 9994 exec_runner.go:152] cp: /Users/fullusername/.minikube/certs/key.pem --> /Users/fullusername/.minikube/key.pem (1679 bytes) I0901 21:18:36.198167 9994 exec_runner.go:145] found /Users/fullusername/.minikube/ca.pem, removing ... I0901 21:18:36.198173 9994 exec_runner.go:190] rm: /Users/fullusername/.minikube/ca.pem I0901 21:18:36.198236 9994 exec_runner.go:152] cp: /Users/fullusername/.minikube/certs/ca.pem --> /Users/fullusername/.minikube/ca.pem (1050 bytes) I0901 21:18:36.198437 9994 exec_runner.go:145] found /Users/fullusername/.minikube/cert.pem, removing ... I0901 21:18:36.198440 9994 exec_runner.go:190] rm: /Users/fullusername/.minikube/cert.pem I0901 21:18:36.198530 9994 exec_runner.go:152] cp: /Users/fullusername/.minikube/certs/cert.pem --> /Users/fullusername/.minikube/cert.pem (1090 bytes) I0901 21:18:36.198701 9994 provision.go:111] generating server cert: /Users/fullusername/.minikube/machines/server.pem ca-key=/Users/fullusername/.minikube/certs/ca.pem private-key=/Users/fullusername/.minikube/certs/ca-key.pem org=fullusername.minikube san=[192.168.38.3 192.168.38.3 localhost 127.0.0.1 minikube minikube] I0901 21:18:36.286953 9994 provision.go:171] copyRemoteCerts I0901 21:18:36.287632 9994 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker I0901 21:18:36.287654 9994 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:18:36.287814 9994 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:18:36.287907 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.287991 9994 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:18:36.288069 9994 sshutil.go:53] new ssh client: &{IP:192.168.38.3 Port:22 SSHKeyPath:/Users/fullusername/.minikube/machines/minikube/id_rsa Username:docker} I0901 21:18:36.325394 9994 ssh_runner.go:316] scp /Users/fullusername/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1050 bytes) I0901 21:18:36.335833 9994 ssh_runner.go:316] scp /Users/fullusername/.minikube/machines/server.pem --> /etc/docker/server.pem (1168 bytes) I0901 21:18:36.345875 9994 ssh_runner.go:316] scp /Users/fullusername/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes) I0901 21:18:36.357924 9994 provision.go:86] duration metric: configureAuth took 160.934507ms I0901 21:18:36.357938 9994 buildroot.go:189] setting minikube options for container-runtime I0901 21:18:36.358146 9994 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:18:36.358380 9994 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:18:36.358524 9994 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:18:36.358656 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.358779 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.358894 9994 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:18:36.359307 9994 main.go:130] libmachine: Using SSH client type: native I0901 21:18:36.359485 9994 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x44042c0] 0x4404280 [] 0s} 192.168.38.3 22 } I0901 21:18:36.359494 9994 main.go:130] libmachine: About to run SSH command: df --output=fstype / | tail -n 1 I0901 21:18:36.430911 9994 main.go:130] libmachine: SSH cmd err, output: : tmpfs I0901 21:18:36.430919 9994 buildroot.go:70] root file system type: tmpfs I0901 21:18:36.431093 9994 provision.go:308] Updating docker unit: /lib/systemd/system/docker.service ... I0901 21:18:36.431117 9994 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:18:36.431254 9994 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:18:36.431352 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.431446 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.431527 9994 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:18:36.431795 9994 main.go:130] libmachine: Using SSH client type: native I0901 21:18:36.431922 9994 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x44042c0] 0x4404280 [] 0s} 192.168.38.3 22 } I0901 21:18:36.431977 9994 main.go:130] libmachine: About to run SSH command: sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com After=network.target minikube-automount.service docker.socket Requires= minikube-automount.service docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP \$MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target " | sudo tee /lib/systemd/system/docker.service.new I0901 21:18:36.508222 9994 main.go:130] libmachine: SSH cmd err, output: : [Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com After=network.target minikube-automount.service docker.socket Requires= minikube-automount.service docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP $MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target I0901 21:18:36.508254 9994 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:18:36.508445 9994 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:18:36.508580 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.508715 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.508854 9994 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:18:36.509278 9994 main.go:130] libmachine: Using SSH client type: native I0901 21:18:36.509434 9994 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x44042c0] 0x4404280 [] 0s} 192.168.38.3 22 } I0901 21:18:36.509446 9994 main.go:130] libmachine: About to run SSH command: sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; } I0901 21:18:36.580731 9994 main.go:130] libmachine: SSH cmd err, output: : I0901 21:18:36.580746 9994 machine.go:91] provisioned docker machine in 559.278946ms I0901 21:18:36.580754 9994 start.go:267] post-start starting for "minikube" (driver="hyperkit") I0901 21:18:36.580759 9994 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs] I0901 21:18:36.580768 9994 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:18:36.581089 9994 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs I0901 21:18:36.581099 9994 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:18:36.581195 9994 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:18:36.581301 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.581380 9994 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:18:36.581452 9994 sshutil.go:53] new ssh client: &{IP:192.168.38.3 Port:22 SSHKeyPath:/Users/fullusername/.minikube/machines/minikube/id_rsa Username:docker} I0901 21:18:36.620473 9994 ssh_runner.go:149] Run: cat /etc/os-release I0901 21:18:36.623547 9994 info.go:137] Remote host: Buildroot 2019.02.10 I0901 21:18:36.623557 9994 filesync.go:126] Scanning /Users/fullusername/.minikube/addons for local assets ... I0901 21:18:36.623660 9994 filesync.go:126] Scanning /Users/fullusername/.minikube/files for local assets ... I0901 21:18:36.623706 9994 start.go:270] post-start completed in 42.947248ms I0901 21:18:36.623743 9994 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:18:36.623895 9994 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:18:36.624010 9994 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:18:36.624118 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.624231 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.624324 9994 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:18:36.624580 9994 main.go:130] libmachine: Using SSH client type: native I0901 21:18:36.624698 9994 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x44042c0] 0x4404280 [] 0s} 192.168.38.3 22 } I0901 21:18:36.624703 9994 main.go:130] libmachine: About to run SSH command: date +%!s(MISSING).%!N(MISSING) I0901 21:18:36.696699 9994 main.go:130] libmachine: SSH cmd err, output: : 1630502316.562233521 I0901 21:18:36.696718 9994 fix.go:212] guest clock: 1630502316.562233521 I0901 21:18:36.696724 9994 fix.go:225] Guest: 2021-09-01 21:18:36.562233521 +0800 CST Remote: 2021-09-01 21:18:36.623886 +0800 CST m=+0.887634590 (delta=-61.652479ms) I0901 21:18:36.696738 9994 fix.go:196] guest clock delta is within tolerance: -61.652479ms I0901 21:18:36.696744 9994 fix.go:57] fixHost completed within 712.104504ms I0901 21:18:36.696746 9994 start.go:80] releasing machines lock for "minikube", held for 712.128122ms I0901 21:18:36.696765 9994 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:18:36.696898 9994 main.go:130] libmachine: (minikube) Calling .GetIP I0901 21:18:36.696999 9994 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:18:36.697090 9994 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:18:36.697912 9994 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:18:36.698216 9994 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/ I0901 21:18:36.698242 9994 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:18:36.698347 9994 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:18:36.698385 9994 ssh_runner.go:149] Run: systemctl --version I0901 21:18:36.698393 9994 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:18:36.698446 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.698476 9994 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:18:36.698546 9994 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:18:36.698560 9994 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:18:36.698636 9994 sshutil.go:53] new ssh client: &{IP:192.168.38.3 Port:22 SSHKeyPath:/Users/fullusername/.minikube/machines/minikube/id_rsa Username:docker} I0901 21:18:36.698650 9994 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:18:36.698722 9994 sshutil.go:53] new ssh client: &{IP:192.168.38.3 Port:22 SSHKeyPath:/Users/fullusername/.minikube/machines/minikube/id_rsa Username:docker} I0901 21:18:38.739623 9994 ssh_runner.go:189] Completed: curl -sS -m 2 https://k8s.gcr.io/: (2.041382913s) W0901 21:18:38.739646 9994 start.go:655] [curl -sS -m 2 https://k8s.gcr.io/] failed: curl -sS -m 2 https://k8s.gcr.io/: Process exited with status 28 stdout: stderr: curl: (28) Connection timed out after 2004 milliseconds I0901 21:18:38.739678 9994 ssh_runner.go:189] Completed: systemctl --version: (2.041272009s) I0901 21:18:38.739691 9994 preload.go:134] Checking if preload exists for k8s version v1.21.2 and runtime docker W0901 21:18:38.739748 9994 out.go:230] ❗ This VM is having trouble accessing https://k8s.gcr.io W0901 21:18:38.739767 9994 out.go:230] 💡 To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/ I0901 21:18:38.739966 9994 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}} I0901 21:18:38.770639 9994 docker.go:535] Got preloaded images: -- stdout -- k8s.gcr.io/kube-apiserver:v1.21.2 k8s.gcr.io/kube-controller-manager:v1.21.2 k8s.gcr.io/kube-proxy:v1.21.2 k8s.gcr.io/kube-scheduler:v1.21.2 gcr.io/k8s-minikube/storage-provisioner:v5 k8s.gcr.io/pause:3.4.1 kubernetesui/dashboard:v2.1.0 k8s.gcr.io/coredns/coredns:v1.8.0 k8s.gcr.io/etcd:3.4.13-0 kubernetesui/metrics-scraper:v1.0.4 : : : : : : k8s.gcr.io/coredns:1.6.7 kindest/kindnetd:0.5.3 : : : -- /stdout -- I0901 21:18:38.770664 9994 docker.go:466] Images already preloaded, skipping extraction I0901 21:18:38.770911 9994 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd I0901 21:18:38.783248 9994 ssh_runner.go:149] Run: sudo systemctl cat docker.service I0901 21:18:38.791151 9994 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd I0901 21:18:38.800607 9994 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio I0901 21:18:38.816003 9994 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock image-endpoint: unix:///var/run/dockershim.sock " | sudo tee /etc/crictl.yaml" I0901 21:18:38.825532 9994 ssh_runner.go:149] Run: sudo systemctl unmask docker.service I0901 21:18:38.895116 9994 ssh_runner.go:149] Run: sudo systemctl enable docker.socket I0901 21:18:38.972704 9994 ssh_runner.go:149] Run: sudo systemctl daemon-reload I0901 21:18:39.050160 9994 ssh_runner.go:149] Run: sudo systemctl start docker I0901 21:18:39.058008 9994 ssh_runner.go:149] Run: docker version --format {{.Server.Version}} I0901 21:18:39.094099 9994 ssh_runner.go:149] Run: docker version --format {{.Server.Version}} I0901 21:18:39.152907 9994 out.go:192] 🐳 Preparing Kubernetes v1.21.2 on Docker 19.03.8 ... I0901 21:18:39.153564 9994 ssh_runner.go:149] Run: grep 192.168.64.1 host.minikube.internal$ /etc/hosts I0901 21:18:39.157350 9994 preload.go:134] Checking if preload exists for k8s version v1.21.2 and runtime docker I0901 21:18:39.157624 9994 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}} I0901 21:18:39.184946 9994 docker.go:535] Got preloaded images: -- stdout -- k8s.gcr.io/kube-apiserver:v1.21.2 k8s.gcr.io/kube-proxy:v1.21.2 k8s.gcr.io/kube-scheduler:v1.21.2 k8s.gcr.io/kube-controller-manager:v1.21.2 gcr.io/k8s-minikube/storage-provisioner:v5 k8s.gcr.io/pause:3.4.1 kubernetesui/dashboard:v2.1.0 k8s.gcr.io/coredns/coredns:v1.8.0 k8s.gcr.io/etcd:3.4.13-0 kubernetesui/metrics-scraper:v1.0.4 : : : : : : k8s.gcr.io/coredns:1.6.7 kindest/kindnetd:0.5.3 : : : -- /stdout -- I0901 21:18:39.184963 9994 docker.go:466] Images already preloaded, skipping extraction I0901 21:18:39.185154 9994 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}} I0901 21:18:39.214309 9994 docker.go:535] Got preloaded images: -- stdout -- k8s.gcr.io/kube-apiserver:v1.21.2 k8s.gcr.io/kube-controller-manager:v1.21.2 k8s.gcr.io/kube-proxy:v1.21.2 k8s.gcr.io/kube-scheduler:v1.21.2 gcr.io/k8s-minikube/storage-provisioner:v5 k8s.gcr.io/pause:3.4.1 kubernetesui/dashboard:v2.1.0 k8s.gcr.io/coredns/coredns:v1.8.0 k8s.gcr.io/etcd:3.4.13-0 kubernetesui/metrics-scraper:v1.0.4 : : : : : : k8s.gcr.io/coredns:1.6.7 kindest/kindnetd:0.5.3 : : : -- /stdout -- I0901 21:18:39.214324 9994 cache_images.go:74] Images are preloaded, skipping loading I0901 21:18:39.214632 9994 ssh_runner.go:149] Run: docker info --format {{.CgroupDriver}} I0901 21:18:39.246676 9994 cni.go:93] Creating CNI manager for "" I0901 21:18:39.246684 9994 cni.go:167] CNI unnecessary in this configuration, recommending no CNI I0901 21:18:39.246694 9994 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16 I0901 21:18:39.246705 9994 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.38.3 APIServerPort:8443 KubernetesVersion:v1.21.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:minikube NodeName:minikube DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.38.3"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.38.3 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]} I0901 21:18:39.246792 9994 kubeadm.go:157] kubeadm config: apiVersion: kubeadm.k8s.io/v1beta2 kind: InitConfiguration localAPIEndpoint: advertiseAddress: 192.168.38.3 bindPort: 8443 bootstrapTokens: - groups: - system:bootstrappers:kubeadm:default-node-token ttl: 24h0m0s usages: - signing - authentication nodeRegistration: criSocket: /var/run/dockershim.sock name: "minikube" kubeletExtraArgs: node-ip: 192.168.38.3 taints: [] --- apiVersion: kubeadm.k8s.io/v1beta2 kind: ClusterConfiguration apiServer: certSANs: ["127.0.0.1", "localhost", "192.168.38.3"] extraArgs: enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota" controllerManager: extraArgs: allocate-node-cidrs: "true" leader-elect: "false" scheduler: extraArgs: leader-elect: "false" certificatesDir: /var/lib/minikube/certs clusterName: mk controlPlaneEndpoint: control-plane.minikube.internal:8443 dns: type: CoreDNS etcd: local: dataDir: /var/lib/minikube/etcd extraArgs: proxy-refresh-interval: "70000" kubernetesVersion: v1.21.2 networking: dnsDomain: cluster.local podSubnet: "10.244.0.0/16" serviceSubnet: 10.96.0.0/12 --- apiVersion: kubelet.config.k8s.io/v1beta1 kind: KubeletConfiguration authentication: x509: clientCAFile: /var/lib/minikube/certs/ca.crt cgroupDriver: systemd clusterDomain: "cluster.local" # disable disk resource management by default imageGCHighThresholdPercent: 100 evictionHard: nodefs.available: "0%!"(MISSING) nodefs.inodesFree: "0%!"(MISSING) imagefs.available: "0%!"(MISSING) failSwapOn: false staticPodPath: /etc/kubernetes/manifests --- apiVersion: kubeproxy.config.k8s.io/v1alpha1 kind: KubeProxyConfiguration clusterCIDR: "10.244.0.0/16" metricsBindAddress: 0.0.0.0:10249 conntrack: maxPerCore: 0 I0901 21:18:39.246853 9994 kubeadm.go:909] kubelet [Unit] Wants=docker.socket [Service] ExecStart= ExecStart=/var/lib/minikube/binaries/v1.21.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=minikube --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.38.3 [Install] config: {KubernetesVersion:v1.21.2 ClusterName:minikube Namespace: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} I0901 21:18:39.247058 9994 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.21.2 I0901 21:18:39.251247 9994 binaries.go:44] Found k8s binaries, skipping transfer I0901 21:18:39.251432 9994 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube I0901 21:18:39.256604 9994 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (334 bytes) I0901 21:18:39.267237 9994 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes) I0901 21:18:39.275158 9994 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (1866 bytes) I0901 21:18:39.282847 9994 ssh_runner.go:149] Run: grep 192.168.38.3 control-plane.minikube.internal$ /etc/hosts I0901 21:18:39.285156 9994 certs.go:52] Setting up /Users/fullusername/.minikube/profiles/minikube for IP: 192.168.38.3 I0901 21:18:39.285237 9994 certs.go:179] skipping minikubeCA CA generation: /Users/fullusername/.minikube/ca.key I0901 21:18:39.285280 9994 certs.go:179] skipping proxyClientCA CA generation: /Users/fullusername/.minikube/proxy-client-ca.key I0901 21:18:39.285364 9994 certs.go:290] skipping minikube-user signed cert generation: /Users/fullusername/.minikube/profiles/minikube/client.key I0901 21:18:39.285405 9994 certs.go:290] skipping minikube signed cert generation: /Users/fullusername/.minikube/profiles/minikube/apiserver.key.872a2615 I0901 21:18:39.285444 9994 certs.go:290] skipping aggregator signed cert generation: /Users/fullusername/.minikube/profiles/minikube/proxy-client.key I0901 21:18:39.285676 9994 certs.go:369] found cert: /Users/fullusername/.minikube/certs/Users/fullusername/.minikube/certs/ca-key.pem (1679 bytes) I0901 21:18:39.285728 9994 certs.go:369] found cert: /Users/fullusername/.minikube/certs/Users/fullusername/.minikube/certs/ca.pem (1050 bytes) I0901 21:18:39.285764 9994 certs.go:369] found cert: /Users/fullusername/.minikube/certs/Users/fullusername/.minikube/certs/cert.pem (1090 bytes) I0901 21:18:39.285799 9994 certs.go:369] found cert: /Users/fullusername/.minikube/certs/Users/fullusername/.minikube/certs/key.pem (1679 bytes) I0901 21:18:39.286644 9994 ssh_runner.go:316] scp /Users/fullusername/.minikube/profiles/minikube/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1350 bytes) I0901 21:18:39.296839 9994 ssh_runner.go:316] scp /Users/fullusername/.minikube/profiles/minikube/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes) I0901 21:18:39.309087 9994 ssh_runner.go:316] scp /Users/fullusername/.minikube/profiles/minikube/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1103 bytes) I0901 21:18:39.322401 9994 ssh_runner.go:316] scp /Users/fullusername/.minikube/profiles/minikube/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes) I0901 21:18:39.332527 9994 ssh_runner.go:316] scp /Users/fullusername/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1066 bytes) I0901 21:18:39.342620 9994 ssh_runner.go:316] scp /Users/fullusername/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes) I0901 21:18:39.352278 9994 ssh_runner.go:316] scp /Users/fullusername/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1074 bytes) I0901 21:18:39.365640 9994 ssh_runner.go:316] scp /Users/fullusername/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes) I0901 21:18:39.376452 9994 ssh_runner.go:316] scp /Users/fullusername/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1066 bytes) I0901 21:18:39.386862 9994 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (744 bytes) I0901 21:18:39.394012 9994 ssh_runner.go:149] Run: openssl version I0901 21:18:39.397648 9994 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem" I0901 21:18:39.403075 9994 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem I0901 21:18:39.406669 9994 certs.go:410] hashing: -rw-r--r-- 1 root root 1066 May 9 2020 /usr/share/ca-certificates/minikubeCA.pem I0901 21:18:39.406739 9994 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem I0901 21:18:39.417718 9994 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0" I0901 21:18:39.422038 9994 kubeadm.go:390] StartCluster: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.22.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:minikube Namespace: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name:m01 IP:192.168.38.3 Port:8443 KubernetesVersion:v1.21.2 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false} I0901 21:18:39.422252 9994 ssh_runner.go:149] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}} I0901 21:18:39.443803 9994 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd I0901 21:18:39.448617 9994 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml I0901 21:18:39.452978 9994 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf I0901 21:18:39.458949 9994 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2 stdout: stderr: ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory I0901 21:18:39.458987 9994 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem" I0901 21:18:39.952895 9994 out.go:192] ▪ Generating certificates and keys ... W0901 21:18:39.954927 9994 out.go:230] 💢 initialization failed, will try again: wait: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem": Process exited with status 1 stdout: [init] Using Kubernetes version: v1.21.2 [preflight] Running pre-flight checks [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' [certs] Using certificateDir folder "/var/lib/minikube/certs" [certs] Using existing ca certificate authority [certs] Using existing apiserver certificate and key on disk stderr: [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' [WARNING DirAvailable--var-lib-minikube-etcd]: /var/lib/minikube/etcd is not empty W0901 13:18:39.800483 3405 certs.go:489] WARNING: could not validate bounds for certificate apiserver-kubelet-client: the certificate has expired: NotBefore: 2020-05-08 21:59:23 +0000 UTC, NotAfter: 2021-05-09 21:59:24 +0000 UTC error execution phase certs/apiserver-kubelet-client: [certs] certificate apiserver-kubelet-client not signed by CA certificate ca: x509: certificate has expired or is not yet valid: current time 2021-09-01T13:18:39Z is after 2021-05-09T21:59:24Z To see the stack trace of this error execute with --v=5 or higher I0901 21:18:39.955012 9994 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm reset --cri-socket /var/run/dockershim.sock --force" I0901 21:18:40.044376 9994 ssh_runner.go:149] Run: sudo systemctl stop -f kubelet I0901 21:18:40.054420 9994 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}} I0901 21:18:40.079156 9994 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf I0901 21:18:40.084307 9994 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2 stdout: stderr: ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory I0901 21:18:40.084322 9994 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem" I0901 21:18:40.537023 9994 out.go:192] ▪ Generating certificates and keys ... I0901 21:18:40.537972 9994 kubeadm.go:392] StartCluster complete in 1.115931088s I0901 21:18:40.538364 9994 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0901 21:18:40.560898 9994 logs.go:270] 0 containers: [] W0901 21:18:40.560906 9994 logs.go:272] No container was found matching "kube-apiserver" I0901 21:18:40.561110 9994 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0901 21:18:40.584743 9994 logs.go:270] 0 containers: [] W0901 21:18:40.584751 9994 logs.go:272] No container was found matching "etcd" I0901 21:18:40.584941 9994 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0901 21:18:40.607533 9994 logs.go:270] 0 containers: [] W0901 21:18:40.607541 9994 logs.go:272] No container was found matching "coredns" I0901 21:18:40.607747 9994 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0901 21:18:40.628836 9994 logs.go:270] 0 containers: [] W0901 21:18:40.628845 9994 logs.go:272] No container was found matching "kube-scheduler" I0901 21:18:40.629045 9994 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0901 21:18:40.651086 9994 logs.go:270] 0 containers: [] W0901 21:18:40.651094 9994 logs.go:272] No container was found matching "kube-proxy" I0901 21:18:40.651291 9994 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0901 21:18:40.673174 9994 logs.go:270] 0 containers: [] W0901 21:18:40.673183 9994 logs.go:272] No container was found matching "kubernetes-dashboard" I0901 21:18:40.673372 9994 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0901 21:18:40.694657 9994 logs.go:270] 0 containers: [] W0901 21:18:40.694665 9994 logs.go:272] No container was found matching "storage-provisioner" I0901 21:18:40.694852 9994 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0901 21:18:40.716863 9994 logs.go:270] 0 containers: [] W0901 21:18:40.716872 9994 logs.go:272] No container was found matching "kube-controller-manager" I0901 21:18:40.716878 9994 logs.go:123] Gathering logs for kubelet ... I0901 21:18:40.716885 9994 ssh_runner.go:149] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0901 21:18:40.722598 9994 logs.go:123] Gathering logs for dmesg ... I0901 21:18:40.722608 9994 ssh_runner.go:149] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0901 21:18:40.729316 9994 logs.go:123] Gathering logs for describe nodes ... I0901 21:18:40.729325 9994 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" W0901 21:18:40.786913 9994 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1 stdout: stderr: The connection to the server localhost:8443 was refused - did you specify the right host or port? output: ** stderr ** The connection to the server localhost:8443 was refused - did you specify the right host or port? ** /stderr ** I0901 21:18:40.786921 9994 logs.go:123] Gathering logs for Docker ... I0901 21:18:40.786927 9994 ssh_runner.go:149] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0901 21:18:40.797564 9994 logs.go:123] Gathering logs for container status ... I0901 21:18:40.797574 9994 ssh_runner.go:149] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0901 21:18:42.833233 9994 ssh_runner.go:189] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.035631645s) W0901 21:18:42.833348 9994 out.go:359] Error starting cluster: wait: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem": Process exited with status 1 stdout: [init] Using Kubernetes version: v1.21.2 [preflight] Running pre-flight checks [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' [certs] Using certificateDir folder "/var/lib/minikube/certs" [certs] Using existing ca certificate authority [certs] Using existing apiserver certificate and key on disk stderr: [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' [WARNING DirAvailable--var-lib-minikube-etcd]: /var/lib/minikube/etcd is not empty W0901 13:18:40.382959 3553 certs.go:489] WARNING: could not validate bounds for certificate apiserver-kubelet-client: the certificate has expired: NotBefore: 2020-05-08 21:59:23 +0000 UTC, NotAfter: 2021-05-09 21:59:24 +0000 UTC error execution phase certs/apiserver-kubelet-client: [certs] certificate apiserver-kubelet-client not signed by CA certificate ca: x509: certificate has expired or is not yet valid: current time 2021-09-01T13:18:40Z is after 2021-05-09T21:59:24Z To see the stack trace of this error execute with --v=5 or higher W0901 21:18:42.833355 9994 out.go:230] W0901 21:18:42.833463 9994 out.go:230] 💣 Error starting cluster: wait: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem": Process exited with status 1 stdout: [init] Using Kubernetes version: v1.21.2 [preflight] Running pre-flight checks [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' [certs] Using certificateDir folder "/var/lib/minikube/certs" [certs] Using existing ca certificate authority [certs] Using existing apiserver certificate and key on disk stderr: [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' [WARNING DirAvailable--var-lib-minikube-etcd]: /var/lib/minikube/etcd is not empty W0901 13:18:40.382959 3553 certs.go:489] WARNING: could not validate bounds for certificate apiserver-kubelet-client: the certificate has expired: NotBefore: 2020-05-08 21:59:23 +0000 UTC, NotAfter: 2021-05-09 21:59:24 +0000 UTC error execution phase certs/apiserver-kubelet-client: [certs] certificate apiserver-kubelet-client not signed by CA certificate ca: x509: certificate has expired or is not yet valid: current time 2021-09-01T13:18:40Z is after 2021-05-09T21:59:24Z To see the stack trace of this error execute with --v=5 or higher W0901 21:18:42.833492 9994 out.go:230] W0901 21:18:42.834128 9994 out.go:230] ╭────────────────────────────────────────────────────────────────────╮ │ │ │ 😿 If the above advice does not help, please let us know: │ │ 👉 https://github.com/kubernetes/minikube/issues/new/choose │ │ │ │ Please attach the following file to the GitHub issue: │ │ - /Users/fullusername/.minikube/logs/lastStart.txt │ │ │ ╰────────────────────────────────────────────────────────────────────╯ I0901 21:18:42.885699 9994 out.go:165] W0901 21:18:42.885888 9994 out.go:230] ❌ Exiting due to GUEST_START: wait: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem": Process exited with status 1 stdout: [init] Using Kubernetes version: v1.21.2 [preflight] Running pre-flight checks [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' [certs] Using certificateDir folder "/var/lib/minikube/certs" [certs] Using existing ca certificate authority [certs] Using existing apiserver certificate and key on disk stderr: [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' [WARNING DirAvailable--var-lib-minikube-etcd]: /var/lib/minikube/etcd is not empty W0901 13:18:40.382959 3553 certs.go:489] WARNING: could not validate bounds for certificate apiserver-kubelet-client: the certificate has expired: NotBefore: 2020-05-08 21:59:23 +0000 UTC, NotAfter: 2021-05-09 21:59:24 +0000 UTC error execution phase certs/apiserver-kubelet-client: [certs] certificate apiserver-kubelet-client not signed by CA certificate ca: x509: certificate has expired or is not yet valid: current time 2021-09-01T13:18:40Z is after 2021-05-09T21:59:24Z To see the stack trace of this error execute with --v=5 or higher W0901 21:18:42.885944 9994 out.go:230] W0901 21:18:42.886893 9994 out.go:230] ╭────────────────────────────────────────────────────────────────────╮ │ │ │ 😿 If the above advice does not help, please let us know: │ │ 👉 https://github.com/kubernetes/minikube/issues/new/choose │ │ │ │ Please attach the following file to the GitHub issue: │ │ - /Users/fullusername/.minikube/logs/lastStart.txt │ │ │ ╰────────────────────────────────────────────────────────────────────╯ ==> Docker <== -- Logs begin at Wed 2021-09-01 13:14:31 UTC, end at Wed 2021-09-01 13:24:21 UTC. -- Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.337225546Z" level=info msg="loading plugin "io.containerd.snapshotter.v1.native"..." type=io.containerd.snapshotter.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.337543957Z" level=info msg="loading plugin "io.containerd.snapshotter.v1.overlayfs"..." type=io.containerd.snapshotter.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.337842501Z" level=info msg="loading plugin "io.containerd.snapshotter.v1.zfs"..." type=io.containerd.snapshotter.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.338040992Z" level=info msg="skip loading plugin "io.containerd.snapshotter.v1.zfs"..." type=io.containerd.snapshotter.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.338075224Z" level=info msg="loading plugin "io.containerd.metadata.v1.bolt"..." type=io.containerd.metadata.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.338094825Z" level=warning msg="could not use snapshotter aufs in metadata plugin" error="modprobe aufs failed: "modprobe: FATAL: Module aufs not found in directory /lib/modules/4.19.107\n": exit status 1" Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.338101639Z" level=warning msg="could not use snapshotter zfs in metadata plugin" error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.338106075Z" level=warning msg="could not use snapshotter btrfs in metadata plugin" error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs must be a btrfs filesystem to be used with the btrfs snapshotter" Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.339469153Z" level=info msg="loading plugin "io.containerd.differ.v1.walking"..." type=io.containerd.differ.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.339507916Z" level=info msg="loading plugin "io.containerd.gc.v1.scheduler"..." type=io.containerd.gc.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.339564731Z" level=info msg="loading plugin "io.containerd.service.v1.containers-service"..." type=io.containerd.service.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.339575600Z" level=info msg="loading plugin "io.containerd.service.v1.content-service"..." type=io.containerd.service.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.339586445Z" level=info msg="loading plugin "io.containerd.service.v1.diff-service"..." type=io.containerd.service.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.339598322Z" level=info msg="loading plugin "io.containerd.service.v1.images-service"..." type=io.containerd.service.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.339609606Z" level=info msg="loading plugin "io.containerd.service.v1.leases-service"..." type=io.containerd.service.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.339624343Z" level=info msg="loading plugin "io.containerd.service.v1.namespaces-service"..." type=io.containerd.service.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.339643153Z" level=info msg="loading plugin "io.containerd.service.v1.snapshots-service"..." type=io.containerd.service.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.339660224Z" level=info msg="loading plugin "io.containerd.runtime.v1.linux"..." type=io.containerd.runtime.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.339732089Z" level=info msg="loading plugin "io.containerd.runtime.v2.task"..." type=io.containerd.runtime.v2 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.339770662Z" level=info msg="loading plugin "io.containerd.monitor.v1.cgroups"..." type=io.containerd.monitor.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340007096Z" level=info msg="loading plugin "io.containerd.service.v1.tasks-service"..." type=io.containerd.service.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340052228Z" level=info msg="loading plugin "io.containerd.internal.v1.restart"..." type=io.containerd.internal.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340084320Z" level=info msg="loading plugin "io.containerd.grpc.v1.containers"..." type=io.containerd.grpc.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340097951Z" level=info msg="loading plugin "io.containerd.grpc.v1.content"..." type=io.containerd.grpc.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340149321Z" level=info msg="loading plugin "io.containerd.grpc.v1.diff"..." type=io.containerd.grpc.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340185655Z" level=info msg="loading plugin "io.containerd.grpc.v1.events"..." type=io.containerd.grpc.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340201138Z" level=info msg="loading plugin "io.containerd.grpc.v1.healthcheck"..." type=io.containerd.grpc.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340209260Z" level=info msg="loading plugin "io.containerd.grpc.v1.images"..." type=io.containerd.grpc.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340216180Z" level=info msg="loading plugin "io.containerd.grpc.v1.leases"..." type=io.containerd.grpc.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340224558Z" level=info msg="loading plugin "io.containerd.grpc.v1.namespaces"..." type=io.containerd.grpc.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340231242Z" level=info msg="loading plugin "io.containerd.internal.v1.opt"..." type=io.containerd.internal.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340268975Z" level=info msg="loading plugin "io.containerd.grpc.v1.snapshots"..." type=io.containerd.grpc.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340278423Z" level=info msg="loading plugin "io.containerd.grpc.v1.tasks"..." type=io.containerd.grpc.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340285727Z" level=info msg="loading plugin "io.containerd.grpc.v1.version"..." type=io.containerd.grpc.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340292822Z" level=info msg="loading plugin "io.containerd.grpc.v1.introspection"..." type=io.containerd.grpc.v1 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340384633Z" level=info msg=serving... address="/var/run/docker/containerd/containerd-debug.sock" Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340439750Z" level=info msg=serving... address="/var/run/docker/containerd/containerd.sock" Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.340448448Z" level=info msg="containerd successfully booted in 0.006713s" Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.346670728Z" level=info msg="parsed scheme: \"unix\"" module=grpc Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.346787386Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.346846839Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock 0 }] }" module=grpc Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.346948808Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.348144840Z" level=info msg="parsed scheme: \"unix\"" module=grpc Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.348182014Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.348196121Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock 0 }] }" module=grpc Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.348206803Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.425350148Z" level=warning msg="Your kernel does not support cgroup blkio weight" Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.425389616Z" level=warning msg="Your kernel does not support cgroup blkio weight_device" Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.425397514Z" level=warning msg="Your kernel does not support cgroup blkio throttle.read_bps_device" Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.425401862Z" level=warning msg="Your kernel does not support cgroup blkio throttle.write_bps_device" Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.425406135Z" level=warning msg="Your kernel does not support cgroup blkio throttle.read_iops_device" Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.425410232Z" level=warning msg="Your kernel does not support cgroup blkio throttle.write_iops_device" Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.425550607Z" level=info msg="Loading containers: start." Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.527614676Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address" Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.560207912Z" level=info msg="Loading containers: done." Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.576511284Z" level=info msg="Docker daemon" commit=afacb8b7f0 graphdriver(s)=overlay2 version=19.03.8 Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.577553409Z" level=info msg="Daemon has completed initialization" Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.596497646Z" level=info msg="API listen on /var/run/docker.sock" Sep 01 13:15:01 minikube systemd[1]: Started Docker Application Container Engine. Sep 01 13:15:01 minikube dockerd[1862]: time="2021-09-01T13:15:01.596696120Z" level=info msg="API listen on [::]:2376" ==> container status <== CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES time="2021-09-01T13:24:23Z" level=fatal msg="failed to connect: failed to connect, make sure you are running as root and the runtime has been started: context deadline exceeded" ==> describe nodes <== E0901 21:24:23.871125 14385 logs.go:190] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1 stdout: stderr: The connection to the server localhost:8443 was refused - did you specify the right host or port? output: "\n** stderr ** \nThe connection to the server localhost:8443 was refused - did you specify the right host or port?\n\n** /stderr **" ==> dmesg <== [Sep 1 13:14] ERROR: earlyprintk= earlyser already used [ +0.000000] You have booted with nomodeset. This means your GPU drivers are DISABLED [ +0.000000] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly [ +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it [ +0.109318] ACPI BIOS Warning (bug): Incorrect checksum in table [DSDT] - 0xBE, should be 0x1B (20180810/tbprint-177) [ +3.630160] GPT:Primary header thinks Alt. header is not at the end of the disk. [ +0.000001] GPT:39062499 != 40959999 [ +0.000000] GPT:Alternate GPT header not at the end of the disk. [ +0.000001] GPT:39062499 != 40959999 [ +0.000000] GPT: Use GNU Parted to correct GPT errors. [ +0.005997] ACPI Error: Could not enable RealTimeClock event (20180810/evxfevnt-184) [ +0.000002] ACPI Warning: Could not enable fixed event - RealTimeClock (4) (20180810/evxface-620) [ +0.010358] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2 [ +1.798507] systemd[1]: Failed to bump fs.file-max, ignoring: Invalid argument [ +0.006366] systemd-fstab-generator[1101]: Ignoring "noauto" for root device [ +0.002806] systemd[1]: File /usr/lib/systemd/system/systemd-journald.service:12 configures an IP firewall (IPAddressDeny=any), but the local system does not support BPF/cgroup based firewalling. [ +0.000002] systemd[1]: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.) [ +0.960975] NFSD: the nfsdcld client tracking upcall will be removed in 3.10. Please transition to using nfsdcltrack. [ +0.147563] vboxguest: loading out-of-tree module taints kernel. [ +0.002526] vboxguest: PCI device not found, probably running on physical hardware. [Sep 1 13:15] systemd-fstab-generator[1842]: Ignoring "noauto" for root device [ +0.071856] systemd-fstab-generator[1852]: Ignoring "noauto" for root device [ +2.733923] systemd-fstab-generator[2076]: Ignoring "noauto" for root device [ +0.092099] systemd-fstab-generator[2086]: Ignoring "noauto" for root device [ +0.060745] systemd-fstab-generator[2096]: Ignoring "noauto" for root device [Sep 1 13:16] NFSD: Unable to end grace period: -110 [Sep 1 13:17] systemd-fstab-generator[2680]: Ignoring "noauto" for root device [ +0.072252] systemd-fstab-generator[2690]: Ignoring "noauto" for root device [ +0.084984] systemd-fstab-generator[2700]: Ignoring "noauto" for root device [Sep 1 13:18] systemd-fstab-generator[3270]: Ignoring "noauto" for root device [ +0.075808] systemd-fstab-generator[3280]: Ignoring "noauto" for root device [ +0.070411] systemd-fstab-generator[3290]: Ignoring "noauto" for root device ==> kernel <== 13:24:24 up 9 min, 0 users, load average: 0.01, 0.03, 0.01 Linux minikube 4.19.107 #1 SMP Thu Mar 26 11:33:10 PDT 2020 x86_64 GNU/Linux PRETTY_NAME="Buildroot 2019.02.10" ==> kubelet <== -- Logs begin at Wed 2021-09-01 13:14:31 UTC, end at Wed 2021-09-01 13:24:24 UTC. -- -- No entries -- ❗ unable to fetch logs for: describe nodes

Full output of failed command:

I0901 21:26:43.950775 14618 out.go:286] Setting OutFile to fd 1 ... I0901 21:26:43.950962 14618 out.go:338] isatty.IsTerminal(1) = true I0901 21:26:43.950970 14618 out.go:299] Setting ErrFile to fd 2... I0901 21:26:43.950975 14618 out.go:338] isatty.IsTerminal(2) = true I0901 21:26:43.951082 14618 root.go:312] Updating PATH: /Users/fullusername/.minikube/bin W0901 21:26:43.951222 14618 root.go:291] Error reading config file at /Users/fullusername/.minikube/config/config.json: open /Users/fullusername/.minikube/config/config.json: no such file or directory I0901 21:26:43.951781 14618 out.go:293] Setting JSON to false I0901 21:26:43.990829 14618 start.go:111] hostinfo: {"hostname":"username-Macbook.local","uptime":869,"bootTime":1630501934,"procs":515,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.5.2","kernelVersion":"20.6.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"fecbf22b-fbbe-36de-9664-f12a7dd41d3d"} W0901 21:26:43.990944 14618 start.go:119] gopshost.Virtualization returned error: not implemented yet I0901 21:26:44.016266 14618 out.go:165] 😄 minikube v1.22.0 on Darwin 11.5.2 😄 minikube v1.22.0 on Darwin 11.5.2 I0901 21:26:44.016514 14618 notify.go:169] Checking for updates... I0901 21:26:44.018293 14618 driver.go:335] Setting default libvirt URI to qemu:///system I0901 21:26:44.037744 14618 main.go:130] libmachine: Found binary path at /Users/fullusername/.minikube/bin/docker-machine-driver-hyperkit I0901 21:26:44.037813 14618 main.go:130] libmachine: Launching plugin server for driver hyperkit I0901 21:26:44.049057 14618 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:51401 I0901 21:26:44.049890 14618 main.go:130] libmachine: () Calling .GetVersion I0901 21:26:44.050549 14618 main.go:130] libmachine: Using API Version 1 I0901 21:26:44.050574 14618 main.go:130] libmachine: () Calling .SetConfigRaw I0901 21:26:44.050907 14618 main.go:130] libmachine: () Calling .GetMachineName I0901 21:26:44.051067 14618 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:26:44.084285 14618 out.go:165] ✨ Using the hyperkit driver based on existing profile ✨ Using the hyperkit driver based on existing profile I0901 21:26:44.084349 14618 start.go:278] selected driver: hyperkit I0901 21:26:44.084357 14618 start.go:751] validating driver "hyperkit" against &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.22.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:minikube Namespace: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name:m01 IP:192.168.38.3 Port:8443 KubernetesVersion:v1.21.2 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false} I0901 21:26:44.084589 14618 start.go:762] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error: Reason: Fix: Doc:} I0901 21:26:44.085044 14618 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0901 21:26:44.085268 14618 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/fullusername/.minikube/bin:/usr/local/opt/openssl@1.1/bin:/usr/local/opt/krb5/sbin:/usr/local/opt/krb5/bin:/usr/local/opt/openssl@1.1/bin:/usr/local/opt/openssl@1.1/bin:/usr/local/opt/gettext/bin:/usr/local/opt/libarchive/bin:/usr/local/opt/libarchive/bin:/usw/local/opt/qt/bin:/usr/local/opt/krb5/sbin:/usr/local/opt/krb5/bin:/usr/local/opt/icu4c/bin:/usr/local/opt/icu4c/sbin:/usr/local/opt/icu4c/bin:/opt/local/bin:/opt/local/sbin:/usr/local/opt/ruby/bin:/usr/local/sbin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/Applications/VMware Fusion.app/Contents/Public:/Library/TeX/texbin:/usr/local/go/bin:/usr/local/MacGPG2/bin:/usr/local/share/dotnet:/opt/puppetlabs/pdk/bin:/opt/X11/bin:/opt/puppetlabs/bin:~/.dotnet/tools:/Library/Apple/usr/bin:~/flutter/bin I0901 21:26:44.098023 14618 install.go:137] /Users/fullusername/.minikube/bin/docker-machine-driver-hyperkit version is 1.22.0 I0901 21:26:44.107982 14618 install.go:79] stdout: /Users/fullusername/.minikube/bin/docker-machine-driver-hyperkit I0901 21:26:44.108015 14618 install.go:81] /Users/fullusername/.minikube/bin/docker-machine-driver-hyperkit looks good I0901 21:26:44.108510 14618 cni.go:93] Creating CNI manager for "" I0901 21:26:44.108799 14618 cni.go:167] CNI unnecessary in this configuration, recommending no CNI I0901 21:26:44.108824 14618 start_flags.go:275] config: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.22.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:minikube Namespace: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name:m01 IP:192.168.38.3 Port:8443 KubernetesVersion:v1.21.2 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false} I0901 21:26:44.109354 14618 iso.go:123] acquiring lock: {Name:mk8fa8d87b88d4e7aa1aa58e0bd6b19be420459f Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0901 21:26:44.131470 14618 out.go:165] 👍 Starting control plane node minikube in cluster minikube 👍 Starting control plane node minikube in cluster minikube I0901 21:26:44.131554 14618 preload.go:134] Checking if preload exists for k8s version v1.21.2 and runtime docker I0901 21:26:44.131687 14618 preload.go:150] Found local preload: /Users/fullusername/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.2-docker-overlay2-amd64.tar.lz4 I0901 21:26:44.132438 14618 cache.go:56] Caching tarball of preloaded images I0901 21:26:44.132642 14618 preload.go:174] Found /Users/fullusername/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download I0901 21:26:44.132660 14618 cache.go:59] Finished verifying existence of preloaded tar for v1.21.2 on docker I0901 21:26:44.132794 14618 profile.go:148] Saving config to /Users/fullusername/.minikube/profiles/minikube/config.json ... I0901 21:26:44.154056 14618 cache.go:205] Successfully downloaded all kic artifacts I0901 21:26:44.154122 14618 start.go:313] acquiring machines lock for minikube: {Name:mk4f8cc830813856c22eca2a96ac643bde973d82 Clock:{} Delay:500ms Timeout:13m0s Cancel:} I0901 21:26:44.154229 14618 start.go:317] acquired machines lock for "minikube" in 87.237µs I0901 21:26:44.154261 14618 start.go:93] Skipping create...Using existing machine configuration I0901 21:26:44.154279 14618 fix.go:55] fixHost starting: m01 I0901 21:26:44.154710 14618 main.go:130] libmachine: Found binary path at /Users/fullusername/.minikube/bin/docker-machine-driver-hyperkit I0901 21:26:44.154761 14618 main.go:130] libmachine: Launching plugin server for driver hyperkit I0901 21:26:44.167358 14618 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:51408 I0901 21:26:44.167887 14618 main.go:130] libmachine: () Calling .GetVersion I0901 21:26:44.168402 14618 main.go:130] libmachine: Using API Version 1 I0901 21:26:44.168424 14618 main.go:130] libmachine: () Calling .SetConfigRaw I0901 21:26:44.168804 14618 main.go:130] libmachine: () Calling .GetMachineName I0901 21:26:44.168954 14618 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:26:44.169109 14618 main.go:130] libmachine: (minikube) Calling .GetState I0901 21:26:44.169298 14618 main.go:130] libmachine: (minikube) DBG | exe=/Users/fullusername/.minikube/bin/docker-machine-driver-hyperkit uid=0 I0901 21:26:44.169488 14618 main.go:130] libmachine: (minikube) DBG | hyperkit pid from json: 4630 I0901 21:26:44.171577 14618 fix.go:108] recreateIfNeeded on minikube: state=Running err= W0901 21:26:44.171617 14618 fix.go:134] unexpected machine state, will restart: I0901 21:26:44.193403 14618 out.go:165] 🏃 Updating the running hyperkit "minikube" VM ... 🏃 Updating the running hyperkit "minikube" VM ... I0901 21:26:44.193443 14618 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:26:44.193703 14618 machine.go:88] provisioning docker machine ... I0901 21:26:44.193725 14618 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:26:44.193910 14618 main.go:130] libmachine: (minikube) Calling .GetMachineName I0901 21:26:44.194089 14618 buildroot.go:166] provisioning hostname "minikube" I0901 21:26:44.194107 14618 main.go:130] libmachine: (minikube) Calling .GetMachineName I0901 21:26:44.194276 14618 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:26:44.194418 14618 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:26:44.194563 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.194727 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.194904 14618 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:26:44.195963 14618 main.go:130] libmachine: Using SSH client type: native I0901 21:26:44.196209 14618 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x44042c0] 0x4404280 [] 0s} 192.168.38.3 22 } I0901 21:26:44.196225 14618 main.go:130] libmachine: About to run SSH command: sudo hostname minikube && echo "minikube" | sudo tee /etc/hostname I0901 21:26:44.283939 14618 main.go:130] libmachine: SSH cmd err, output: : minikube I0901 21:26:44.283971 14618 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:26:44.284158 14618 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:26:44.284301 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.284463 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.284596 14618 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:26:44.284910 14618 main.go:130] libmachine: Using SSH client type: native I0901 21:26:44.285050 14618 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x44042c0] 0x4404280 [] 0s} 192.168.38.3 22 } I0901 21:26:44.285067 14618 main.go:130] libmachine: About to run SSH command: if ! grep -xq '.*\sminikube' /etc/hosts; then if grep -xq '127.0.1.1\s.*' /etc/hosts; then sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 minikube/g' /etc/hosts; else echo '127.0.1.1 minikube' | sudo tee -a /etc/hosts; fi fi I0901 21:26:44.354973 14618 main.go:130] libmachine: SSH cmd err, output: : I0901 21:26:44.355022 14618 buildroot.go:172] set auth options {CertDir:/Users/fullusername/.minikube CaCertPath:/Users/fullusername/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/fullusername/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/fullusername/.minikube/machines/server.pem ServerKeyPath:/Users/fullusername/.minikube/machines/server-key.pem ClientKeyPath:/Users/fullusername/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/fullusername/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/fullusername/.minikube} I0901 21:26:44.355063 14618 buildroot.go:174] setting up certificates I0901 21:26:44.355088 14618 provision.go:83] configureAuth start I0901 21:26:44.355096 14618 main.go:130] libmachine: (minikube) Calling .GetMachineName I0901 21:26:44.355291 14618 main.go:130] libmachine: (minikube) Calling .GetIP I0901 21:26:44.355448 14618 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:26:44.355578 14618 provision.go:137] copyHostCerts I0901 21:26:44.355693 14618 exec_runner.go:145] found /Users/fullusername/.minikube/key.pem, removing ... I0901 21:26:44.355705 14618 exec_runner.go:190] rm: /Users/fullusername/.minikube/key.pem I0901 21:26:44.356157 14618 exec_runner.go:152] cp: /Users/fullusername/.minikube/certs/key.pem --> /Users/fullusername/.minikube/key.pem (1679 bytes) I0901 21:26:44.356667 14618 exec_runner.go:145] found /Users/fullusername/.minikube/ca.pem, removing ... I0901 21:26:44.356680 14618 exec_runner.go:190] rm: /Users/fullusername/.minikube/ca.pem I0901 21:26:44.356759 14618 exec_runner.go:152] cp: /Users/fullusername/.minikube/certs/ca.pem --> /Users/fullusername/.minikube/ca.pem (1050 bytes) I0901 21:26:44.357290 14618 exec_runner.go:145] found /Users/fullusername/.minikube/cert.pem, removing ... I0901 21:26:44.357300 14618 exec_runner.go:190] rm: /Users/fullusername/.minikube/cert.pem I0901 21:26:44.357373 14618 exec_runner.go:152] cp: /Users/fullusername/.minikube/certs/cert.pem --> /Users/fullusername/.minikube/cert.pem (1090 bytes) I0901 21:26:44.357645 14618 provision.go:111] generating server cert: /Users/fullusername/.minikube/machines/server.pem ca-key=/Users/fullusername/.minikube/certs/ca.pem private-key=/Users/fullusername/.minikube/certs/ca-key.pem org=fullusername.minikube san=[192.168.38.3 192.168.38.3 localhost 127.0.0.1 minikube minikube] I0901 21:26:44.459706 14618 provision.go:171] copyRemoteCerts I0901 21:26:44.460469 14618 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker I0901 21:26:44.460502 14618 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:26:44.460691 14618 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:26:44.460820 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.460970 14618 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:26:44.461127 14618 sshutil.go:53] new ssh client: &{IP:192.168.38.3 Port:22 SSHKeyPath:/Users/fullusername/.minikube/machines/minikube/id_rsa Username:docker} I0901 21:26:44.501660 14618 ssh_runner.go:316] scp /Users/fullusername/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1050 bytes) I0901 21:26:44.514033 14618 ssh_runner.go:316] scp /Users/fullusername/.minikube/machines/server.pem --> /etc/docker/server.pem (1172 bytes) I0901 21:26:44.526437 14618 ssh_runner.go:316] scp /Users/fullusername/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes) I0901 21:26:44.538874 14618 provision.go:86] duration metric: configureAuth took 183.767148ms I0901 21:26:44.538897 14618 buildroot.go:189] setting minikube options for container-runtime I0901 21:26:44.539080 14618 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:26:44.539263 14618 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:26:44.539395 14618 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:26:44.539550 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.539684 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.539807 14618 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:26:44.540092 14618 main.go:130] libmachine: Using SSH client type: native I0901 21:26:44.540223 14618 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x44042c0] 0x4404280 [] 0s} 192.168.38.3 22 } I0901 21:26:44.540234 14618 main.go:130] libmachine: About to run SSH command: df --output=fstype / | tail -n 1 I0901 21:26:44.618449 14618 main.go:130] libmachine: SSH cmd err, output: : tmpfs I0901 21:26:44.618474 14618 buildroot.go:70] root file system type: tmpfs I0901 21:26:44.618676 14618 provision.go:308] Updating docker unit: /lib/systemd/system/docker.service ... I0901 21:26:44.619522 14618 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:26:44.619752 14618 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:26:44.619911 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.620065 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.620203 14618 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:26:44.621030 14618 main.go:130] libmachine: Using SSH client type: native I0901 21:26:44.621192 14618 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x44042c0] 0x4404280 [] 0s} 192.168.38.3 22 } I0901 21:26:44.621269 14618 main.go:130] libmachine: About to run SSH command: sudo mkdir -p /lib/systemd/system && printf %s "[Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com After=network.target minikube-automount.service docker.socket Requires= minikube-automount.service docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP \$MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target " | sudo tee /lib/systemd/system/docker.service.new I0901 21:26:44.704681 14618 main.go:130] libmachine: SSH cmd err, output: : [Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com After=network.target minikube-automount.service docker.socket Requires= minikube-automount.service docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP $MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target I0901 21:26:44.704792 14618 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:26:44.704989 14618 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:26:44.705118 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.705259 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.705405 14618 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:26:44.705740 14618 main.go:130] libmachine: Using SSH client type: native I0901 21:26:44.705894 14618 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x44042c0] 0x4404280 [] 0s} 192.168.38.3 22 } I0901 21:26:44.705913 14618 main.go:130] libmachine: About to run SSH command: sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; } I0901 21:26:44.781600 14618 main.go:130] libmachine: SSH cmd err, output: : I0901 21:26:44.781633 14618 machine.go:91] provisioned docker machine in 587.900291ms I0901 21:26:44.781647 14618 start.go:267] post-start starting for "minikube" (driver="hyperkit") I0901 21:26:44.781655 14618 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs] I0901 21:26:44.781675 14618 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:26:44.782066 14618 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs I0901 21:26:44.782091 14618 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:26:44.782242 14618 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:26:44.782411 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.782526 14618 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:26:44.782636 14618 sshutil.go:53] new ssh client: &{IP:192.168.38.3 Port:22 SSHKeyPath:/Users/fullusername/.minikube/machines/minikube/id_rsa Username:docker} I0901 21:26:44.828952 14618 ssh_runner.go:149] Run: cat /etc/os-release I0901 21:26:44.832970 14618 info.go:137] Remote host: Buildroot 2019.02.10 I0901 21:26:44.833003 14618 filesync.go:126] Scanning /Users/fullusername/.minikube/addons for local assets ... I0901 21:26:44.833605 14618 filesync.go:126] Scanning /Users/fullusername/.minikube/files for local assets ... I0901 21:26:44.833686 14618 start.go:270] post-start completed in 52.030657ms I0901 21:26:44.833705 14618 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:26:44.833889 14618 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:26:44.834026 14618 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:26:44.834158 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.834289 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.834396 14618 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:26:44.834706 14618 main.go:130] libmachine: Using SSH client type: native I0901 21:26:44.834862 14618 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x44042c0] 0x4404280 [] 0s} 192.168.38.3 22 } I0901 21:26:44.834874 14618 main.go:130] libmachine: About to run SSH command: date +%s.%N I0901 21:26:44.909508 14618 main.go:130] libmachine: SSH cmd err, output: : 1630502805.122471927 I0901 21:26:44.909534 14618 fix.go:212] guest clock: 1630502805.122471927 I0901 21:26:44.909541 14618 fix.go:225] Guest: 2021-09-01 21:26:45.122471927 +0800 CST Remote: 2021-09-01 21:26:44.833879 +0800 CST m=+0.929739344 (delta=288.592927ms) I0901 21:26:44.909557 14618 fix.go:196] guest clock delta is within tolerance: 288.592927ms I0901 21:26:44.909567 14618 fix.go:57] fixHost completed within 755.284959ms I0901 21:26:44.909571 14618 start.go:80] releasing machines lock for "minikube", held for 755.320155ms I0901 21:26:44.909596 14618 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:26:44.909795 14618 main.go:130] libmachine: (minikube) Calling .GetIP I0901 21:26:44.909956 14618 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:26:44.910099 14618 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:26:44.911084 14618 main.go:130] libmachine: (minikube) Calling .DriverName I0901 21:26:44.911615 14618 ssh_runner.go:149] Run: systemctl --version I0901 21:26:44.911635 14618 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:26:44.911763 14618 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:26:44.911877 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.911997 14618 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:26:44.912104 14618 sshutil.go:53] new ssh client: &{IP:192.168.38.3 Port:22 SSHKeyPath:/Users/fullusername/.minikube/machines/minikube/id_rsa Username:docker} I0901 21:26:44.912331 14618 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/ I0901 21:26:44.912385 14618 main.go:130] libmachine: (minikube) Calling .GetSSHHostname I0901 21:26:44.912588 14618 main.go:130] libmachine: (minikube) Calling .GetSSHPort I0901 21:26:44.912766 14618 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath I0901 21:26:44.912929 14618 main.go:130] libmachine: (minikube) Calling .GetSSHUsername I0901 21:26:44.913096 14618 sshutil.go:53] new ssh client: &{IP:192.168.38.3 Port:22 SSHKeyPath:/Users/fullusername/.minikube/machines/minikube/id_rsa Username:docker} I0901 21:26:44.952954 14618 preload.go:134] Checking if preload exists for k8s version v1.21.2 and runtime docker I0901 21:26:44.953353 14618 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}} I0901 21:26:46.957312 14618 ssh_runner.go:189] Completed: curl -sS -m 2 https://k8s.gcr.io/: (2.044893396s) W0901 21:26:46.957370 14618 start.go:655] [curl -sS -m 2 https://k8s.gcr.io/] failed: curl -sS -m 2 https://k8s.gcr.io/: Process exited with status 28 stdout: stderr: curl: (28) Connection timed out after 2002 milliseconds I0901 21:26:46.957398 14618 ssh_runner.go:189] Completed: docker images --format {{.Repository}}:{{.Tag}}: (2.003991965s) I0901 21:26:46.957455 14618 docker.go:535] Got preloaded images: -- stdout -- k8s.gcr.io/kube-apiserver:v1.21.2 k8s.gcr.io/kube-proxy:v1.21.2 k8s.gcr.io/kube-controller-manager:v1.21.2 k8s.gcr.io/kube-scheduler:v1.21.2 gcr.io/k8s-minikube/storage-provisioner:v5 k8s.gcr.io/pause:3.4.1 kubernetesui/dashboard:v2.1.0 k8s.gcr.io/coredns/coredns:v1.8.0 k8s.gcr.io/etcd:3.4.13-0 kubernetesui/metrics-scraper:v1.0.4 : : : : : : k8s.gcr.io/coredns:1.6.7 kindest/kindnetd:0.5.3 : : : -- /stdout -- I0901 21:26:46.957495 14618 docker.go:466] Images already preloaded, skipping extraction W0901 21:26:46.957576 14618 out.go:230] ❗ This VM is having trouble accessing https://k8s.gcr.io ❗ This VM is having trouble accessing https://k8s.gcr.io W0901 21:26:46.957608 14618 out.go:230] 💡 To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/ 💡 To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/ I0901 21:26:46.957887 14618 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd I0901 21:26:46.970469 14618 ssh_runner.go:149] Run: sudo systemctl cat docker.service I0901 21:26:46.979973 14618 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd I0901 21:26:46.991155 14618 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio I0901 21:26:47.004167 14618 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock image-endpoint: unix:///var/run/dockershim.sock " | sudo tee /etc/crictl.yaml" I0901 21:26:47.014914 14618 ssh_runner.go:149] Run: sudo systemctl unmask docker.service I0901 21:26:47.095084 14618 ssh_runner.go:149] Run: sudo systemctl enable docker.socket I0901 21:26:47.170524 14618 ssh_runner.go:149] Run: sudo systemctl daemon-reload I0901 21:26:47.247536 14618 ssh_runner.go:149] Run: sudo systemctl start docker I0901 21:26:47.255159 14618 ssh_runner.go:149] Run: docker version --format {{.Server.Version}} I0901 21:26:47.289070 14618 ssh_runner.go:149] Run: docker version --format {{.Server.Version}} I0901 21:26:47.370904 14618 out.go:192] 🐳 Preparing Kubernetes v1.21.2 on Docker 19.03.8 ... 🐳 Preparing Kubernetes v1.21.2 on Docker 19.03.8 ...| I0901 21:26:47.372280 14618 ssh_runner.go:149] Run: grep 192.168.64.1 host.minikube.internal$ /etc/hosts I0901 21:26:47.377522 14618 preload.go:134] Checking if preload exists for k8s version v1.21.2 and runtime docker I0901 21:26:47.377796 14618 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}} I0901 21:26:47.407422 14618 docker.go:535] Got preloaded images: -- stdout -- k8s.gcr.io/kube-apiserver:v1.21.2 k8s.gcr.io/kube-scheduler:v1.21.2 k8s.gcr.io/kube-proxy:v1.21.2 k8s.gcr.io/kube-controller-manager:v1.21.2 gcr.io/k8s-minikube/storage-provisioner:v5 k8s.gcr.io/pause:3.4.1 kubernetesui/dashboard:v2.1.0 k8s.gcr.io/coredns/coredns:v1.8.0 k8s.gcr.io/etcd:3.4.13-0 kubernetesui/metrics-scraper:v1.0.4 : : : : : : k8s.gcr.io/coredns:1.6.7 kindest/kindnetd:0.5.3 : : : -- /stdout -- I0901 21:26:47.407450 14618 docker.go:466] Images already preloaded, skipping extraction I0901 21:26:47.407679 14618 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}} I0901 21:26:47.436985 14618 docker.go:535] Got preloaded images: -- stdout -- k8s.gcr.io/kube-apiserver:v1.21.2 k8s.gcr.io/kube-scheduler:v1.21.2 k8s.gcr.io/kube-controller-manager:v1.21.2 k8s.gcr.io/kube-proxy:v1.21.2 gcr.io/k8s-minikube/storage-provisioner:v5 k8s.gcr.io/pause:3.4.1 kubernetesui/dashboard:v2.1.0 k8s.gcr.io/coredns/coredns:v1.8.0 k8s.gcr.io/etcd:3.4.13-0 kubernetesui/metrics-scraper:v1.0.4 : : : : : : k8s.gcr.io/coredns:1.6.7 kindest/kindnetd:0.5.3 : : : -- /stdout -- I0901 21:26:47.437020 14618 cache_images.go:74] Images are preloaded, skipping loading I0901 21:26:47.437252 14618 ssh_runner.go:149] Run: docker info --format {{.CgroupDriver}} / I0901 21:26:47.474946 14618 cni.go:93] Creating CNI manager for "" I0901 21:26:47.474967 14618 cni.go:167] CNI unnecessary in this configuration, recommending no CNI I0901 21:26:47.474982 14618 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16 I0901 21:26:47.474995 14618 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.38.3 APIServerPort:8443 KubernetesVersion:v1.21.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:minikube NodeName:minikube DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.38.3"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.38.3 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]} I0901 21:26:47.475169 14618 kubeadm.go:157] kubeadm config: apiVersion: kubeadm.k8s.io/v1beta2 kind: InitConfiguration localAPIEndpoint: advertiseAddress: 192.168.38.3 bindPort: 8443 bootstrapTokens: - groups: - system:bootstrappers:kubeadm:default-node-token ttl: 24h0m0s usages: - signing - authentication nodeRegistration: criSocket: /var/run/dockershim.sock name: "minikube" kubeletExtraArgs: node-ip: 192.168.38.3 taints: [] --- apiVersion: kubeadm.k8s.io/v1beta2 kind: ClusterConfiguration apiServer: certSANs: ["127.0.0.1", "localhost", "192.168.38.3"] extraArgs: enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota" controllerManager: extraArgs: allocate-node-cidrs: "true" leader-elect: "false" scheduler: extraArgs: leader-elect: "false" certificatesDir: /var/lib/minikube/certs clusterName: mk controlPlaneEndpoint: control-plane.minikube.internal:8443 dns: type: CoreDNS etcd: local: dataDir: /var/lib/minikube/etcd extraArgs: proxy-refresh-interval: "70000" kubernetesVersion: v1.21.2 networking: dnsDomain: cluster.local podSubnet: "10.244.0.0/16" serviceSubnet: 10.96.0.0/12 --- apiVersion: kubelet.config.k8s.io/v1beta1 kind: KubeletConfiguration authentication: x509: clientCAFile: /var/lib/minikube/certs/ca.crt cgroupDriver: systemd clusterDomain: "cluster.local" # disable disk resource management by default imageGCHighThresholdPercent: 100 evictionHard: nodefs.available: "0%" nodefs.inodesFree: "0%" imagefs.available: "0%" failSwapOn: false staticPodPath: /etc/kubernetes/manifests --- apiVersion: kubeproxy.config.k8s.io/v1alpha1 kind: KubeProxyConfiguration clusterCIDR: "10.244.0.0/16" metricsBindAddress: 0.0.0.0:10249 conntrack: maxPerCore: 0 I0901 21:26:47.475280 14618 kubeadm.go:909] kubelet [Unit] Wants=docker.socket [Service] ExecStart= ExecStart=/var/lib/minikube/binaries/v1.21.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=minikube --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.38.3 [Install] config: {KubernetesVersion:v1.21.2 ClusterName:minikube Namespace: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} I0901 21:26:47.475504 14618 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.21.2 I0901 21:26:47.481034 14618 binaries.go:44] Found k8s binaries, skipping transfer I0901 21:26:47.481245 14618 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube I0901 21:26:47.486295 14618 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (334 bytes) I0901 21:26:47.494500 14618 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes) I0901 21:26:47.503121 14618 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (1866 bytes) I0901 21:26:47.511405 14618 ssh_runner.go:149] Run: grep 192.168.38.3 control-plane.minikube.internal$ /etc/hosts I0901 21:26:47.514633 14618 certs.go:52] Setting up /Users/fullusername/.minikube/profiles/minikube for IP: 192.168.38.3 I0901 21:26:47.515448 14618 certs.go:179] skipping minikubeCA CA generation: /Users/fullusername/.minikube/ca.key I0901 21:26:47.515511 14618 certs.go:179] skipping proxyClientCA CA generation: /Users/fullusername/.minikube/proxy-client-ca.key I0901 21:26:47.515610 14618 certs.go:290] skipping minikube-user signed cert generation: /Users/fullusername/.minikube/profiles/minikube/client.key I0901 21:26:47.515665 14618 certs.go:290] skipping minikube signed cert generation: /Users/fullusername/.minikube/profiles/minikube/apiserver.key.872a2615 I0901 21:26:47.515716 14618 certs.go:290] skipping aggregator signed cert generation: /Users/fullusername/.minikube/profiles/minikube/proxy-client.key I0901 21:26:47.515995 14618 certs.go:369] found cert: /Users/fullusername/.minikube/certs/Users/fullusername/.minikube/certs/ca-key.pem (1679 bytes) I0901 21:26:47.516049 14618 certs.go:369] found cert: /Users/fullusername/.minikube/certs/Users/fullusername/.minikube/certs/ca.pem (1050 bytes) I0901 21:26:47.516092 14618 certs.go:369] found cert: /Users/fullusername/.minikube/certs/Users/fullusername/.minikube/certs/cert.pem (1090 bytes) I0901 21:26:47.516134 14618 certs.go:369] found cert: /Users/fullusername/.minikube/certs/Users/fullusername/.minikube/certs/key.pem (1679 bytes) I0901 21:26:47.520399 14618 ssh_runner.go:316] scp /Users/fullusername/.minikube/profiles/minikube/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1350 bytes) I0901 21:26:47.532318 14618 ssh_runner.go:316] scp /Users/fullusername/.minikube/profiles/minikube/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes) I0901 21:26:47.544839 14618 ssh_runner.go:316] scp /Users/fullusername/.minikube/profiles/minikube/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1103 bytes) I0901 21:26:47.557987 14618 ssh_runner.go:316] scp /Users/fullusername/.minikube/profiles/minikube/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes) I0901 21:26:47.570214 14618 ssh_runner.go:316] scp /Users/fullusername/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1066 bytes) - I0901 21:26:47.582779 14618 ssh_runner.go:316] scp /Users/fullusername/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes) I0901 21:26:47.594449 14618 ssh_runner.go:316] scp /Users/fullusername/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1074 bytes) I0901 21:26:47.608466 14618 ssh_runner.go:316] scp /Users/fullusername/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes) I0901 21:26:47.620564 14618 ssh_runner.go:316] scp /Users/fullusername/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1066 bytes) I0901 21:26:47.633683 14618 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (744 bytes) I0901 21:26:47.642678 14618 ssh_runner.go:149] Run: openssl version I0901 21:26:47.647157 14618 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem" I0901 21:26:47.653550 14618 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem I0901 21:26:47.657152 14618 certs.go:410] hashing: -rw-r--r-- 1 root root 1066 May 9 2020 /usr/share/ca-certificates/minikubeCA.pem I0901 21:26:47.657224 14618 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem I0901 21:26:47.667097 14618 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0" I0901 21:26:47.672052 14618 kubeadm.go:390] StartCluster: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.22.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser: SSHKey: SSHPort:0 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:minikube Namespace: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name:m01 IP:192.168.38.3 Port:8443 KubernetesVersion:v1.21.2 ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false} I0901 21:26:47.672433 14618 ssh_runner.go:149] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}} \ I0901 21:26:47.697959 14618 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd I0901 21:26:47.703228 14618 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml I0901 21:26:47.709592 14618 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf I0901 21:26:47.714703 14618 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2 stdout: stderr: ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory I0901 21:26:47.714730 14618 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem" | I0901 21:26:48.234914 14618 out.go:192] ▪ Generating certificates and keys ... ▪ Generating certificates and keys ...W0901 21:26:48.237226 14618 out.go:230] 💢 initialization failed, will try again: wait: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem": Process exited with status 1 stdout: [init] Using Kubernetes version: v1.21.2 [preflight] Running pre-flight checks [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' [certs] Using certificateDir folder "/var/lib/minikube/certs" [certs] Using existing ca certificate authority [certs] Using existing apiserver certificate and key on disk stderr: [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' [WARNING DirAvailable--var-lib-minikube-etcd]: /var/lib/minikube/etcd is not empty W0901 13:26:48.408645 4259 certs.go:489] WARNING: could not validate bounds for certificate apiserver-kubelet-client: the certificate has expired: NotBefore: 2020-05-08 21:59:23 +0000 UTC, NotAfter: 2021-05-09 21:59:24 +0000 UTC error execution phase certs/apiserver-kubelet-client: [certs] certificate apiserver-kubelet-client not signed by CA certificate ca: x509: certificate has expired or is not yet valid: current time 2021-09-01T13:26:48Z is after 2021-05-09T21:59:24Z To see the stack trace of this error execute with --v=5 or higher 💢 initialization failed, will try again: wait: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem": Process exited with status 1 stdout: [init] Using Kubernetes version: v1.21.2 [preflight] Running pre-flight checks [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' [certs] Using certificateDir folder "/var/lib/minikube/certs" [certs] Using existing ca certificate authority [certs] Using existing apiserver certificate and key on disk stderr: [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' [WARNING DirAvailable--var-lib-minikube-etcd]: /var/lib/minikube/etcd is not empty W0901 13:26:48.408645 4259 certs.go:489] WARNING: could not validate bounds for certificate apiserver-kubelet-client: the certificate has expired: NotBefore: 2020-05-08 21:59:23 +0000 UTC, NotAfter: 2021-05-09 21:59:24 +0000 UTC error execution phase certs/apiserver-kubelet-client: [certs] certificate apiserver-kubelet-client not signed by CA certificate ca: x509: certificate has expired or is not yet valid: current time 2021-09-01T13:26:48Z is after 2021-05-09T21:59:24Z To see the stack trace of this error execute with --v=5 or higher I0901 21:26:48.237670 14618 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm reset --cri-socket /var/run/dockershim.sock --force" I0901 21:26:48.323896 14618 ssh_runner.go:149] Run: sudo systemctl stop -f kubelet I0901 21:26:48.333061 14618 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}} I0901 21:26:48.358621 14618 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf I0901 21:26:48.365690 14618 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2 stdout: stderr: ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory I0901 21:26:48.365726 14618 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem" I0901 21:26:48.873721 14618 out.go:192] ▪ Generating certificates and keys ... ▪ Generating certificates and keys ...| I0901 21:26:48.876459 14618 kubeadm.go:392] StartCluster complete in 1.20439295s I0901 21:26:48.877000 14618 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0901 21:26:48.908262 14618 logs.go:270] 0 containers: [] W0901 21:26:48.929591 14618 logs.go:272] No container was found matching "kube-apiserver" I0901 21:26:48.929964 14618 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0901 21:26:48.959574 14618 logs.go:270] 0 containers: [] W0901 21:26:48.959596 14618 logs.go:272] No container was found matching "etcd" I0901 21:26:48.959814 14618 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} / I0901 21:26:48.987929 14618 logs.go:270] 0 containers: [] W0901 21:26:48.987956 14618 logs.go:272] No container was found matching "coredns" I0901 21:26:48.988214 14618 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0901 21:26:49.014454 14618 logs.go:270] 0 containers: [] W0901 21:26:49.014479 14618 logs.go:272] No container was found matching "kube-scheduler" I0901 21:26:49.014701 14618 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0901 21:26:49.040538 14618 logs.go:270] 0 containers: [] W0901 21:26:49.040559 14618 logs.go:272] No container was found matching "kube-proxy" I0901 21:26:49.040764 14618 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0901 21:26:49.067621 14618 logs.go:270] 0 containers: [] W0901 21:26:49.067641 14618 logs.go:272] No container was found matching "kubernetes-dashboard" I0901 21:26:49.067854 14618 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} - I0901 21:26:49.093419 14618 logs.go:270] 0 containers: [] W0901 21:26:49.093439 14618 logs.go:272] No container was found matching "storage-provisioner" I0901 21:26:49.093653 14618 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0901 21:26:49.119155 14618 logs.go:270] 0 containers: [] W0901 21:26:49.119177 14618 logs.go:272] No container was found matching "kube-controller-manager" I0901 21:26:49.119186 14618 logs.go:123] Gathering logs for Docker ... I0901 21:26:49.119200 14618 ssh_runner.go:149] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0901 21:26:49.132418 14618 logs.go:123] Gathering logs for container status ... I0901 21:26:49.132446 14618 ssh_runner.go:149] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" - I0901 21:26:51.176188 14618 ssh_runner.go:189] Completed: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": (2.043695886s) I0901 21:26:51.176384 14618 logs.go:123] Gathering logs for kubelet ... I0901 21:26:51.176403 14618 ssh_runner.go:149] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0901 21:26:51.183937 14618 logs.go:123] Gathering logs for dmesg ... I0901 21:26:51.183962 14618 ssh_runner.go:149] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0901 21:26:51.192957 14618 logs.go:123] Gathering logs for describe nodes ... I0901 21:26:51.192979 14618 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" \ W0901 21:26:51.253303 14618 logs.go:130] failed describe nodes: command: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1 stdout: stderr: The connection to the server localhost:8443 was refused - did you specify the right host or port? output: ** stderr ** The connection to the server localhost:8443 was refused - did you specify the right host or port? ** /stderr ** W0901 21:26:51.253335 14618 out.go:359] Error starting cluster: wait: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem": Process exited with status 1 stdout: [init] Using Kubernetes version: v1.21.2 [preflight] Running pre-flight checks [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' [certs] Using certificateDir folder "/var/lib/minikube/certs" [certs] Using existing ca certificate authority [certs] Using existing apiserver certificate and key on disk stderr: [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' [WARNING DirAvailable--var-lib-minikube-etcd]: /var/lib/minikube/etcd is not empty W0901 13:26:49.046668 4403 certs.go:489] WARNING: could not validate bounds for certificate apiserver-kubelet-client: the certificate has expired: NotBefore: 2020-05-08 21:59:23 +0000 UTC, NotAfter: 2021-05-09 21:59:24 +0000 UTC error execution phase certs/apiserver-kubelet-client: [certs] certificate apiserver-kubelet-client not signed by CA certificate ca: x509: certificate has expired or is not yet valid: current time 2021-09-01T13:26:49Z is after 2021-05-09T21:59:24Z To see the stack trace of this error execute with --v=5 or higher W0901 21:26:51.253408 14618 out.go:230] W0901 21:26:51.253551 14618 out.go:230] 💣 Error starting cluster: wait: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem": Process exited with status 1 stdout: [init] Using Kubernetes version: v1.21.2 [preflight] Running pre-flight checks [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' [certs] Using certificateDir folder "/var/lib/minikube/certs" [certs] Using existing ca certificate authority [certs] Using existing apiserver certificate and key on disk stderr: [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' [WARNING DirAvailable--var-lib-minikube-etcd]: /var/lib/minikube/etcd is not empty W0901 13:26:49.046668 4403 certs.go:489] WARNING: could not validate bounds for certificate apiserver-kubelet-client: the certificate has expired: NotBefore: 2020-05-08 21:59:23 +0000 UTC, NotAfter: 2021-05-09 21:59:24 +0000 UTC error execution phase certs/apiserver-kubelet-client: [certs] certificate apiserver-kubelet-client not signed by CA certificate ca: x509: certificate has expired or is not yet valid: current time 2021-09-01T13:26:49Z is after 2021-05-09T21:59:24Z To see the stack trace of this error execute with --v=5 or higher 💣 Error starting cluster: wait: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem": Process exited with status 1 stdout: [init] Using Kubernetes version: v1.21.2 [preflight] Running pre-flight checks [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' [certs] Using certificateDir folder "/var/lib/minikube/certs" [certs] Using existing ca certificate authority [certs] Using existing apiserver certificate and key on disk stderr: [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' [WARNING DirAvailable--var-lib-minikube-etcd]: /var/lib/minikube/etcd is not empty W0901 13:26:49.046668 4403 certs.go:489] WARNING: could not validate bounds for certificate apiserver-kubelet-client: the certificate has expired: NotBefore: 2020-05-08 21:59:23 +0000 UTC, NotAfter: 2021-05-09 21:59:24 +0000 UTC error execution phase certs/apiserver-kubelet-client: [certs] certificate apiserver-kubelet-client not signed by CA certificate ca: x509: certificate has expired or is not yet valid: current time 2021-09-01T13:26:49Z is after 2021-05-09T21:59:24Z To see the stack trace of this error execute with --v=5 or higher W0901 21:26:51.253640 14618 out.go:230] W0901 21:26:51.254299 14618 out.go:230] ╭────────────────────────────────────────────────────────────────────╮ │ │ │ 😿 If the above advice does not help, please let us know: │ │ 👉 https://github.com/kubernetes/minikube/issues/new/choose │ │ │ │ Please attach the following file to the GitHub issue: │ │ - /Users/fullusername/.minikube/logs/lastStart.txt │ │ │ ╰────────────────────────────────────────────────────────────────────╯ ╭────────────────────────────────────────────────────────────────────╮ │ │ │ 😿 If the above advice does not help, please let us know: │ │ 👉 https://github.com/kubernetes/minikube/issues/new/choose │ │ │ │ Please attach the following file to the GitHub issue: │ │ - /Users/fullusername/.minikube/logs/lastStart.txt │ │ │ ╰────────────────────────────────────────────────────────────────────╯ I0901 21:26:51.341220 14618 out.go:165] W0901 21:26:51.341517 14618 out.go:230] ❌ Exiting due to GUEST_START: wait: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem": Process exited with status 1 stdout: [init] Using Kubernetes version: v1.21.2 [preflight] Running pre-flight checks [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' [certs] Using certificateDir folder "/var/lib/minikube/certs" [certs] Using existing ca certificate authority [certs] Using existing apiserver certificate and key on disk stderr: [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' [WARNING DirAvailable--var-lib-minikube-etcd]: /var/lib/minikube/etcd is not empty W0901 13:26:49.046668 4403 certs.go:489] WARNING: could not validate bounds for certificate apiserver-kubelet-client: the certificate has expired: NotBefore: 2020-05-08 21:59:23 +0000 UTC, NotAfter: 2021-05-09 21:59:24 +0000 UTC error execution phase certs/apiserver-kubelet-client: [certs] certificate apiserver-kubelet-client not signed by CA certificate ca: x509: certificate has expired or is not yet valid: current time 2021-09-01T13:26:49Z is after 2021-05-09T21:59:24Z To see the stack trace of this error execute with --v=5 or higher ❌ Exiting due to GUEST_START: wait: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem": Process exited with status 1 stdout: [init] Using Kubernetes version: v1.21.2 [preflight] Running pre-flight checks [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' [certs] Using certificateDir folder "/var/lib/minikube/certs" [certs] Using existing ca certificate authority [certs] Using existing apiserver certificate and key on disk stderr: [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' [WARNING DirAvailable--var-lib-minikube-etcd]: /var/lib/minikube/etcd is not empty W0901 13:26:49.046668 4403 certs.go:489] WARNING: could not validate bounds for certificate apiserver-kubelet-client: the certificate has expired: NotBefore: 2020-05-08 21:59:23 +0000 UTC, NotAfter: 2021-05-09 21:59:24 +0000 UTC error execution phase certs/apiserver-kubelet-client: [certs] certificate apiserver-kubelet-client not signed by CA certificate ca: x509: certificate has expired or is not yet valid: current time 2021-09-01T13:26:49Z is after 2021-05-09T21:59:24Z To see the stack trace of this error execute with --v=5 or higher W0901 21:26:51.341898 14618 out.go:230] W0901 21:26:51.343447 14618 out.go:230] ╭────────────────────────────────────────────────────────────────────╮ │ │ │ 😿 If the above advice does not help, please let us know: │ │ 👉 https://github.com/kubernetes/minikube/issues/new/choose │ │ │ │ Please attach the following file to the GitHub issue: │ │ - /Users/fullusername/.minikube/logs/lastStart.txt │ │ │ ╰────────────────────────────────────────────────────────────────────╯ ╭────────────────────────────────────────────────────────────────────╮ │ │ │ 😿 If the above advice does not help, please let us know: │ │ 👉 https://github.com/kubernetes/minikube/issues/new/choose │ │ │ │ Please attach the following file to the GitHub issue: │ │ - /Users/fullusername/.minikube/logs/lastStart.txt │ │ │ ╰────────────────────────────────────────────────────────────────────╯ I0901 21:26:51.428237 14618 out.go:165]

Troubleshooting

I tried to use brew rm minikube, restarted the computer and installed it again, but did not help.

About networking and proxy

I have reviewed the proxy documentation mentioned in the logs. I don't need a proxy to access the internet but I'm using a commercial VPN software Astrill, which has a custom VPN driver.

• I whitelisted the following IPs in Mac network setting under proxy *.local, 169.254/16, 192.168.0.1/16, 10.96.0.0/12
• I whitelisted the following IPs in Astrill VPN software *.local, 192.168.0.1/16, 10.96.0.0/12
• I reconnected VPN and internet is working I tried to run the command minikube start again, but the same issue. I tried to turn off the VPN all together, and run the minikube start command again, but the same issue.

Edit

I realized a few previous cases

• 12363

• 8765

This hotfix solved my issue.

this is worked for me

minikube delete --all --purge
minikube start

Originally posted by @kenessajr in https://github.com/kubernetes/minikube/issues/8765#issuecomment-828506809

Command line outputs

$ `minikube delete --all --purge` 🔥 Deleting "minikube" in hyperkit ... 💀 Removed all traces of the "minikube" cluster. 🔥 Successfully deleted all profiles 💀 Successfully purged minikube directory located at - [/Users/fullusername/.minikube] $ `minikube start` 😄 minikube v1.22.0 on Darwin 11.5.2 ✨ Automatically selected the hyperkit driver. Other choices: parallels, vmware, ssh 💾 Downloading driver docker-machine-driver-hyperkit: > docker-machine-driver-hyper...: 65 B / 65 B [----------] 100.00% ? p/s 0s > docker-machine-driver-hyper...: 10.52 MiB / 10.52 MiB 100.00% 9.55 MiB p 🔑 The 'hyperkit' driver requires elevated permissions. The following commands will be executed: $ sudo chown root:wheel /Users/fullusername/.minikube/bin/docker-machine-driver-hyperkit $ sudo chmod u+s /Users/fullusername/.minikube/bin/docker-machine-driver-hyperkit Password: 💿 Downloading VM boot image ... > minikube-v1.22.0.iso.sha256: 65 B / 65 B [-------------] 100.00% ? p/s 0s > minikube-v1.22.0.iso: 242.95 MiB / 242.95 MiB [ 100.00% 14.19 MiB p/s 17s 👍 Starting control plane node minikube in cluster minikube 💾 Downloading Kubernetes v1.21.2 preload ... > preloaded-images-k8s-v11-v1...: 502.14 MiB / 502.14 MiB 100.00% 11.79 Mi 🔥 Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ... ❗ This VM is having trouble accessing https://k8s.gcr.io 💡 To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/ 🐳 Preparing Kubernetes v1.21.2 on Docker 20.10.6 ... ▪ Generating certificates and keys ... ▪ Booting up control plane ... ▪ Configuring RBAC rules ... 🔎 Verifying Kubernetes components... ▪ Using image gcr.io/k8s-minikube/storage-provisioner:v5 🌟 Enabled addons: storage-provisioner, default-storageclass 🏄 Done! kubectl is now configured to use "minikube" cluster and "default" namespace by default $ `kubectl get nodes` NAME STATUS ROLES AGE VERSION minikube Ready control-plane,master 9m28s v1.21.2

But there is a new issue

Everything looks okay until I tried to create a deployment

$ kubectl create deployment nginx-depl --image=nginx 
deployment.apps/nginx-depl created

$ kubectl get deployment
NAME         READY   UP-TO-DATE   AVAILABLE   AGE
nginx-depl   0/1     1            0           16s

$ kubectl get pod
NAME                          READY   STATUS         RESTARTS   AGE
nginx-depl-5c8bf76b5b-nhfsc   0/1     ErrImagePull   0          27s

I tried kubectl describe pod nginx-depl-5c8bf76b5b-nhfsc

Command line outputs from describe

Name: nginx-depl-5c8bf76b5b-nhfsc Namespace: default Priority: 0 Node: minikube/192.168.38.4 Start Time: Wed, 01 Sep 2021 22:11:33 +0800 Labels: app=nginx-depl pod-template-hash=5c8bf76b5b Annotations: Status: Pending IP: 172.17.0.3 IPs: IP: 172.17.0.3 Controlled By: ReplicaSet/nginx-depl-5c8bf76b5b Containers: nginx: Container ID: Image: nginx Image ID: Port: Host Port: State: Waiting Reason: ImagePullBackOff Ready: False Restart Count: 0 Environment: Mounts: /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-7fhlt (ro) Conditions: Type Status Initialized True Ready False ContainersReady False PodScheduled True Volumes: kube-api-access-7fhlt: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: BestEffort Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 9m24s default-scheduler Successfully assigned default/nginx-depl-5c8bf76b5b-nhfsc to minikube Normal Pulling 7m12s (x4 over 9m23s) kubelet Pulling image "nginx" Warning Failed 6m57s (x4 over 9m8s) kubelet Failed to pull image "nginx": rpc error: code = Unknown desc = Error response from daemon: Get https://registry-1.docker.io/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Warning Failed 6m57s (x4 over 9m8s) kubelet Error: ErrImagePull Warning Failed 6m42s (x6 over 9m8s) kubelet Error: ImagePullBackOff Normal BackOff 4m20s (x15 over 9m8s) kubelet Back-off pulling image "nginx"

This problem is likely due to hypervisor issues the way minikube is generated. I fixed this issue by using minikube start --driver=docker, you can also set all future ones to use docker hypervisor with minikube config set driver docker. See, doc for details.

[RA489]

/kind support

[sharifelgamal]

Interesting, generally if docker is healthy and available, minikube will automatically choose the docker driver if no driver is explicitly passed into minikube start.

The hyperkit + VPN issue is a well-known one (see https://github.com/kubernetes/minikube/issues/6296) that we're looking at fixing soon.

[k8s-triage-robot]

The Kubernetes project currently lacks enough contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

• After 90d of inactivity, lifecycle/stale is applied
• After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
• After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

• Mark this issue or PR as fresh with /remove-lifecycle stale
• Mark this issue or PR as rotten with /lifecycle rotten
• Close this issue or PR with /close
• Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

[RA489]

/remove-lifecycle stale

[k8s-triage-robot]

The Kubernetes project currently lacks enough contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

• After 90d of inactivity, lifecycle/stale is applied
• After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
• After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

• Mark this issue or PR as fresh with /remove-lifecycle stale
• Mark this issue or PR as rotten with /lifecycle rotten
• Close this issue or PR with /close
• Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

[RA489]

/remove-lifecycle stale

[mariorojasac]

this helped me thank you @WoodpeckerBaby

[k8s-triage-robot]

The Kubernetes project currently lacks enough contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

• After 90d of inactivity, lifecycle/stale is applied
• After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
• After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

• Mark this issue or PR as fresh with /remove-lifecycle stale
• Mark this issue or PR as rotten with /lifecycle rotten
• Close this issue or PR with /close
• Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

[k8s-triage-robot]

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

• After 90d of inactivity, lifecycle/stale is applied
• After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
• After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

• Mark this issue or PR as fresh with /remove-lifecycle rotten
• Close this issue or PR with /close
• Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle rotten