kubernetes / minikube

Run Kubernetes locally
https://minikube.sigs.k8s.io/
Apache License 2.0
29.6k stars 4.89k forks source link

Exiting due to GUEST_START: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: timed out waiting for the condition #10343

Closed BioGeek closed 2 years ago

BioGeek commented 3 years ago

Steps to reproduce the issue:

I am following this blogpost to setup Kubernetes and Minikube on WSL2 on Windows 10.

OS: Windows 10 Version 1909 build 18363.1256 WSL2 distro: Ubuntu 20.04 LTS

$ minikube version
minikube version: v1.17.1
commit: 043bdca07e54ab6e4fc0457e3064048f34133d7e
$ docker version
Client: Docker Engine - Community
 Cloud integration: 1.0.4
 Version:           20.10.0
 API version:       1.41
 Go version:        go1.13.15
 Git commit:        7287ab3
 Built:             Tue Dec  8 18:59:53 2020
 OS/Arch:           linux/amd64
 Context:           default
 Experimental:      true

Server: Docker Engine - Community
 Engine:
  Version:          20.10.0
  API version:      1.41 (minimum version 1.12)
  Go version:       go1.13.15
  Git commit:       eeddea2
  Built:            Tue Dec  8 18:58:04 2020
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          v1.4.3
  GitCommit:        269548fa27e0089a8b8278fc4fc781d7f65a939b
 runc:
  Version:          1.0.0-rc92
  GitCommit:        ff819c7e9184c13b7c2607fe6c30ae19403a7aff
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0
$ kubectl version
Client Version: version.Info{Major:"1", Minor:"19", GitVersion:"v1.19.3", GitCommit:"1e11e4a2108024935ecfcb2912226cedeafd99df", GitTreeState:"clean", BuildDate:"2020-10-14T12:50:19Z", GoVersion:"go1.15.2", Compiler:"gc", Platform:"linux/amd64"}
Unable to connect to the server: dial tcp 192.168.49.2:8443: i/o timeout

I can follow the above mentioned blogpost until Minikube: the first cluster.

Instead of sudo minikube start --driver=none I just do minikube start, but I get the following error:


$ minikube start
πŸ˜„  minikube v1.17.1 on Ubuntu 20.04
✨  Automatically selected the docker driver
πŸ‘  Starting control plane node minikube in cluster minikube
πŸ’Ύ  Downloading Kubernetes v1.20.2 preload ...
    > preloaded-images-k8s-v8-v1....: 491.22 MiB / 491.22 MiB  100.00% 7.38 MiB
πŸ”₯  Creating docker container (CPUs=2, Memory=6300MB) ...
🐳  Preparing Kubernetes v1.20.2 on Docker 20.10.2 ...
    β–ͺ Generating certificates and keys ...
    β–ͺ Booting up control plane ...
    β–ͺ Configuring RBAC rules ...
πŸ”Ž  Verifying Kubernetes components...
❗  Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://192.168.49.2:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 192.168.49.2:8443: i/o timeout]
🌟  Enabled addons: storage-provisioner

❌  Exiting due to GUEST_START: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: timed out waiting for the condition

😿  If the above advice does not help, please let us know:
πŸ‘‰  https://github.com/kubernetes/minikube/issues/new/choose

This seems a similar error as in #9556, so to answer a few questions from there as well:

  1. do you happen to use a VPN or a proxy ? In a previous step when following the blogpost, a proxy was set up to access a dashboard.

  2. do you have a custom DOCKER_HOST echo $DOCKER_HOST retuns an empty string

  3. do you mind sharing env | grep DOCKER env | grep DOCKER returns nothing

Full output of failed command ( minikube start with "--alsologtostderr" flag) minikube.log

Optional: Full output of minikube logs command: minkube2.log

priyawadhwa commented 3 years ago

Hey @BioGeek thanks for opening this issue. Unfortunately I'm not very familiar with WSL, but I found additional issues/blog posts that may be useful:

Please let us know if you find anything that resolves your issue, and if not we can keep trying to debug!

spowelljr commented 3 years ago

@BioGeek Is this still an issue you're facing?

BioGeek commented 3 years ago

@spowelljr I upgraded minikube from v1.17.1 to v1.19.0 and tried again, but I still have the same error.

A ticket is opened (https://github.com/kubernetes/website/issues/26998) to update the blog post that I am following to show the correct commands to install minikube on WSL2. Once that issue gets resolved I will report back here.

For completness sake, the output of minikube start --alsologtostderr -v=4:

Details ``` I0426 11:22:39.129761 8357 out.go:278] Setting OutFile to fd 1 ... I0426 11:22:39.129872 8357 out.go:330] isatty.IsTerminal(1) = true I0426 11:22:39.129904 8357 out.go:291] Setting ErrFile to fd 2... I0426 11:22:39.129934 8357 out.go:330] isatty.IsTerminal(2) = true I0426 11:22:39.130059 8357 root.go:317] Updating PATH: /home/jervan/.minikube/bin I0426 11:22:39.130271 8357 out.go:285] Setting JSON to false I0426 11:22:39.130836 8357 start.go:108] hostinfo: {"hostname":"KORCLT38593","uptime":9976,"bootTime":1619418983,"procs":24,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.4.72-microsoft-standard-WSL2","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"7a4cfed6-ab7e-e027-cfca-57f56019136b"} I0426 11:22:39.130919 8357 start.go:118] virtualization: I0426 11:22:39.133747 8357 out.go:157] πŸ˜„ minikube v1.19.0 on Ubuntu 20.04 πŸ˜„ minikube v1.19.0 on Ubuntu 20.04 I0426 11:22:39.133996 8357 notify.go:126] Checking for updates... I0426 11:22:39.134180 8357 driver.go:322] Setting default libvirt URI to qemu:///system I0426 11:22:39.265049 8357 docker.go:119] docker version: linux-20.10.0 I0426 11:22:39.265162 8357 cli_runner.go:115] Run: docker system info --format "{{json .}}" I0426 11:22:39.467561 8357 info.go:261] docker info: {ID:JL3K:WVKO:J7EF:2FJM:XLYM:2YBF:SHAQ:EZUF:JJ2W:2NPI:O6QM:56ZT Containers:14 ContainersRunning:6 ContainersPaused:0 ContainersStopped:8 Images:17 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:91 OomKillDisable:true NGoroutines:80 SystemTime:2021-04-26 09:22:39.3669773 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.4.72-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:26703204352 GenericResources: DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense:Community Engine Warnings:[WARNING: No blkio weight support WARNING: No blkio weight_device support WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.4.2-docker] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.5.0]] Warnings:}} I0426 11:22:39.467670 8357 docker.go:225] overlay module found I0426 11:22:39.470889 8357 out.go:157] ✨ Using the docker driver based on existing profile ✨ Using the docker driver based on existing profile I0426 11:22:39.470941 8357 start.go:276] selected driver: docker I0426 11:22:39.470946 8357 start.go:718] validating driver "docker" against &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.20@sha256:0250dab3644403384bd54f566921c6b57138eecffbb861f9392feef9b2ec44f6 Memory:6300 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.20.2 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false} I0426 11:22:39.471048 8357 start.go:729] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc:} I0426 11:22:39.471353 8357 cli_runner.go:115] Run: docker system info --format "{{json .}}" I0426 11:22:39.674040 8357 info.go:261] docker info: {ID:JL3K:WVKO:J7EF:2FJM:XLYM:2YBF:SHAQ:EZUF:JJ2W:2NPI:O6QM:56ZT Containers:14 ContainersRunning:6 ContainersPaused:0 ContainersStopped:8 Images:17 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:91 OomKillDisable:true NGoroutines:80 SystemTime:2021-04-26 09:22:39.5715841 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.4.72-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:12 MemTotal:26703204352 GenericResources: DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default] ProductLicense:Community Engine Warnings:[WARNING: No blkio weight support WARNING: No blkio weight_device support WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Build with BuildKit Vendor:Docker Inc. Version:v0.4.2-docker] map[Name:scan Path:/usr/local/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.5.0]] Warnings:}} I0426 11:22:39.675795 8357 start_flags.go:270] config: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.20@sha256:0250dab3644403384bd54f566921c6b57138eecffbb861f9392feef9b2ec44f6 Memory:6300 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.20.2 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false} I0426 11:22:39.683388 8357 out.go:157] πŸ‘ Starting control plane node minikube in cluster minikube πŸ‘ Starting control plane node minikube in cluster minikube I0426 11:22:39.683546 8357 image.go:107] Checking for gcr.io/k8s-minikube/kicbase:v0.0.20@sha256:0250dab3644403384bd54f566921c6b57138eecffbb861f9392feef9b2ec44f6 in local docker daemon I0426 11:22:39.845426 8357 image.go:111] Found gcr.io/k8s-minikube/kicbase:v0.0.20@sha256:0250dab3644403384bd54f566921c6b57138eecffbb861f9392feef9b2ec44f6 in local docker daemon, skipping pull I0426 11:22:39.845482 8357 cache.go:116] gcr.io/k8s-minikube/kicbase:v0.0.20@sha256:0250dab3644403384bd54f566921c6b57138eecffbb861f9392feef9b2ec44f6 exists in daemon, skipping pull I0426 11:22:39.845524 8357 preload.go:97] Checking if preload exists for k8s version v1.20.2 and runtime docker I0426 11:22:39.845577 8357 preload.go:105] Found local preload: /home/jervan/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v10-v1.20.2-docker-overlay2-amd64.tar.lz4 I0426 11:22:39.845618 8357 cache.go:54] Caching tarball of preloaded images I0426 11:22:39.845668 8357 preload.go:131] Found /home/jervan/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v10-v1.20.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download I0426 11:22:39.845712 8357 cache.go:57] Finished verifying existence of preloaded tar for v1.20.2 on docker I0426 11:22:39.845843 8357 profile.go:148] Saving config to /home/jervan/.minikube/profiles/minikube/config.json ... I0426 11:22:39.846038 8357 cache.go:185] Successfully downloaded all kic artifacts I0426 11:22:39.846117 8357 start.go:313] acquiring machines lock for minikube: {Name:mk1a3b22b413de49c894457e3f7d0a1c11db5719 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0426 11:22:39.846319 8357 start.go:317] acquired machines lock for "minikube" in 157.4Β΅s I0426 11:22:39.846364 8357 start.go:93] Skipping create...Using existing machine configuration I0426 11:22:39.846396 8357 fix.go:55] fixHost starting: I0426 11:22:39.846567 8357 cli_runner.go:115] Run: docker container inspect minikube --format={{.State.Status}} I0426 11:22:40.000808 8357 fix.go:108] recreateIfNeeded on minikube: state=Running err= W0426 11:22:40.000889 8357 fix.go:134] unexpected machine state, will restart: I0426 11:22:40.004089 8357 out.go:157] πŸƒ Updating the running docker "minikube" container ... πŸƒ Updating the running docker "minikube" container ... I0426 11:22:40.004154 8357 machine.go:88] provisioning docker machine ... I0426 11:22:40.004186 8357 ubuntu.go:169] provisioning hostname "minikube" I0426 11:22:40.004256 8357 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0426 11:22:40.152548 8357 main.go:126] libmachine: Using SSH client type: native I0426 11:22:40.152859 8357 main.go:126] libmachine: &{{{ 0 [] [] []} docker [0x800360] 0x800320 [] 0s} 127.0.0.1 49162 } I0426 11:22:40.152896 8357 main.go:126] libmachine: About to run SSH command: sudo hostname minikube && echo "minikube" | sudo tee /etc/hostname I0426 11:22:40.276875 8357 main.go:126] libmachine: SSH cmd err, output: : minikube I0426 11:22:40.276950 8357 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0426 11:22:40.425996 8357 main.go:126] libmachine: Using SSH client type: native I0426 11:22:40.426156 8357 main.go:126] libmachine: &{{{ 0 [] [] []} docker [0x800360] 0x800320 [] 0s} 127.0.0.1 49162 } I0426 11:22:40.426200 8357 main.go:126] libmachine: About to run SSH command: if ! grep -xq '.*\sminikube' /etc/hosts; then if grep -xq '127.0.1.1\s.*' /etc/hosts; then sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 minikube/g' /etc/hosts; else echo '127.0.1.1 minikube' | sudo tee -a /etc/hosts; fi fi I0426 11:22:40.538452 8357 main.go:126] libmachine: SSH cmd err, output: : I0426 11:22:40.538497 8357 ubuntu.go:175] set auth options {CertDir:/home/jervan/.minikube CaCertPath:/home/jervan/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jervan/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jervan/.minikube/machines/server.pem ServerKeyPath:/home/jervan/.minikube/machines/server-key.pem ClientKeyPath:/home/jervan/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jervan/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jervan/.minikube} I0426 11:22:40.538559 8357 ubuntu.go:177] setting up certificates I0426 11:22:40.538570 8357 provision.go:83] configureAuth start I0426 11:22:40.538637 8357 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" minikube I0426 11:22:40.711607 8357 provision.go:137] copyHostCerts I0426 11:22:40.711694 8357 vm_assets.go:96] NewFileAsset: /home/jervan/.minikube/certs/cert.pem -> /home/jervan/.minikube/cert.pem I0426 11:22:40.711787 8357 exec_runner.go:145] found /home/jervan/.minikube/cert.pem, removing ... I0426 11:22:40.711829 8357 exec_runner.go:190] rm: /home/jervan/.minikube/cert.pem I0426 11:22:40.711933 8357 exec_runner.go:152] cp: /home/jervan/.minikube/certs/cert.pem --> /home/jervan/.minikube/cert.pem (1119 bytes) I0426 11:22:40.712056 8357 vm_assets.go:96] NewFileAsset: /home/jervan/.minikube/certs/key.pem -> /home/jervan/.minikube/key.pem I0426 11:22:40.712111 8357 exec_runner.go:145] found /home/jervan/.minikube/key.pem, removing ... I0426 11:22:40.712157 8357 exec_runner.go:190] rm: /home/jervan/.minikube/key.pem I0426 11:22:40.712226 8357 exec_runner.go:152] cp: /home/jervan/.minikube/certs/key.pem --> /home/jervan/.minikube/key.pem (1675 bytes) I0426 11:22:40.712314 8357 vm_assets.go:96] NewFileAsset: /home/jervan/.minikube/certs/ca.pem -> /home/jervan/.minikube/ca.pem I0426 11:22:40.712370 8357 exec_runner.go:145] found /home/jervan/.minikube/ca.pem, removing ... I0426 11:22:40.712457 8357 exec_runner.go:190] rm: /home/jervan/.minikube/ca.pem I0426 11:22:40.712543 8357 exec_runner.go:152] cp: /home/jervan/.minikube/certs/ca.pem --> /home/jervan/.minikube/ca.pem (1078 bytes) I0426 11:22:40.712636 8357 provision.go:111] generating server cert: /home/jervan/.minikube/machines/server.pem ca-key=/home/jervan/.minikube/certs/ca.pem private-key=/home/jervan/.minikube/certs/ca-key.pem org=jervan.minikube san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube minikube] I0426 11:22:40.788173 8357 provision.go:165] copyRemoteCerts I0426 11:22:40.788251 8357 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker I0426 11:22:40.788310 8357 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0426 11:22:40.939617 8357 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49162 SSHKeyPath:/home/jervan/.minikube/machines/minikube/id_rsa Username:docker} I0426 11:22:41.022345 8357 vm_assets.go:96] NewFileAsset: /home/jervan/.minikube/certs/ca.pem -> /etc/docker/ca.pem I0426 11:22:41.022406 8357 ssh_runner.go:316] scp /home/jervan/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes) I0426 11:22:41.041133 8357 vm_assets.go:96] NewFileAsset: /home/jervan/.minikube/machines/server.pem -> /etc/docker/server.pem I0426 11:22:41.041191 8357 ssh_runner.go:316] scp /home/jervan/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes) I0426 11:22:41.059488 8357 vm_assets.go:96] NewFileAsset: /home/jervan/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem I0426 11:22:41.059547 8357 ssh_runner.go:316] scp /home/jervan/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes) I0426 11:22:41.077119 8357 provision.go:86] duration metric: configureAuth took 538.5197ms I0426 11:22:41.077170 8357 ubuntu.go:193] setting minikube options for container-runtime I0426 11:22:41.077332 8357 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0426 11:22:41.225557 8357 main.go:126] libmachine: Using SSH client type: native I0426 11:22:41.225712 8357 main.go:126] libmachine: &{{{ 0 [] [] []} docker [0x800360] 0x800320 [] 0s} 127.0.0.1 49162 } I0426 11:22:41.225751 8357 main.go:126] libmachine: About to run SSH command: df --output=fstype / | tail -n 1 I0426 11:22:41.349145 8357 main.go:126] libmachine: SSH cmd err, output: : overlay I0426 11:22:41.349188 8357 ubuntu.go:71] root file system type: overlay I0426 11:22:41.349325 8357 provision.go:296] Updating docker unit: /lib/systemd/system/docker.service ... I0426 11:22:41.349413 8357 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0426 11:22:41.511861 8357 main.go:126] libmachine: Using SSH client type: native I0426 11:22:41.512032 8357 main.go:126] libmachine: &{{{ 0 [] [] []} docker [0x800360] 0x800320 [] 0s} 127.0.0.1 49162 } I0426 11:22:41.512116 8357 main.go:126] libmachine: About to run SSH command: sudo mkdir -p /lib/systemd/system && printf %s "[Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com BindsTo=containerd.service After=network-online.target firewalld.service containerd.service Wants=network-online.target Requires=docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP \$MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target " | sudo tee /lib/systemd/system/docker.service.new I0426 11:22:41.647666 8357 main.go:126] libmachine: SSH cmd err, output: : [Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com BindsTo=containerd.service After=network-online.target firewalld.service containerd.service Wants=network-online.target Requires=docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP $MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target I0426 11:22:41.647817 8357 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0426 11:22:41.805720 8357 main.go:126] libmachine: Using SSH client type: native I0426 11:22:41.805941 8357 main.go:126] libmachine: &{{{ 0 [] [] []} docker [0x800360] 0x800320 [] 0s} 127.0.0.1 49162 } I0426 11:22:41.805965 8357 main.go:126] libmachine: About to run SSH command: sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; } I0426 11:22:41.923155 8357 main.go:126] libmachine: SSH cmd err, output: : I0426 11:22:41.923213 8357 machine.go:91] provisioned docker machine in 1.9190382s I0426 11:22:41.923269 8357 start.go:267] post-start starting for "minikube" (driver="docker") I0426 11:22:41.923302 8357 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs] I0426 11:22:41.923343 8357 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs I0426 11:22:41.923397 8357 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0426 11:22:42.077411 8357 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49162 SSHKeyPath:/home/jervan/.minikube/machines/minikube/id_rsa Username:docker} I0426 11:22:42.119277 8357 ssh_runner.go:149] Run: cat /etc/os-release I0426 11:22:42.122266 8357 main.go:126] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found I0426 11:22:42.122305 8357 main.go:126] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found I0426 11:22:42.122314 8357 main.go:126] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found I0426 11:22:42.122333 8357 info.go:137] Remote host: Ubuntu 20.04.1 LTS I0426 11:22:42.122367 8357 filesync.go:118] Scanning /home/jervan/.minikube/addons for local assets ... I0426 11:22:42.122439 8357 filesync.go:118] Scanning /home/jervan/.minikube/files for local assets ... I0426 11:22:42.122475 8357 start.go:270] post-start completed in 199.1729ms I0426 11:22:42.122537 8357 ssh_runner.go:149] Run: sh -c "df -h /var | awk 'NR==2{print $5}'" I0426 11:22:42.122602 8357 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0426 11:22:42.284753 8357 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49162 SSHKeyPath:/home/jervan/.minikube/machines/minikube/id_rsa Username:docker} I0426 11:22:42.369002 8357 fix.go:57] fixHost completed within 2.5226041s I0426 11:22:42.369045 8357 start.go:80] releasing machines lock for "minikube", held for 2.5226902s I0426 11:22:42.369127 8357 cli_runner.go:115] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" minikube I0426 11:22:42.566216 8357 ssh_runner.go:149] Run: systemctl --version I0426 11:22:42.566506 8357 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/ I0426 11:22:42.566542 8357 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0426 11:22:42.566945 8357 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0426 11:22:42.781338 8357 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49162 SSHKeyPath:/home/jervan/.minikube/machines/minikube/id_rsa Username:docker} I0426 11:22:42.781606 8357 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49162 SSHKeyPath:/home/jervan/.minikube/machines/minikube/id_rsa Username:docker} I0426 11:22:42.890656 8357 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd I0426 11:22:43.114269 8357 ssh_runner.go:149] Run: sudo systemctl cat docker.service I0426 11:22:43.132277 8357 cruntime.go:219] skipping containerd shutdown because we are bound to it I0426 11:22:43.132363 8357 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio I0426 11:22:43.142782 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock image-endpoint: unix:///var/run/dockershim.sock " | sudo tee /etc/crictl.yaml" I0426 11:22:43.155943 8357 ssh_runner.go:149] Run: sudo systemctl cat docker.service I0426 11:22:43.164906 8357 ssh_runner.go:149] Run: sudo systemctl daemon-reload I0426 11:22:43.234750 8357 ssh_runner.go:149] Run: sudo systemctl start docker I0426 11:22:43.244286 8357 ssh_runner.go:149] Run: docker version --format {{.Server.Version}} I0426 11:22:43.283089 8357 out.go:184] 🐳 Preparing Kubernetes v1.20.2 on Docker 20.10.5 ... 🐳 Preparing Kubernetes v1.20.2 on Docker 20.10.5 ...I0426 11:22:43.283193 8357 cli_runner.go:115] Run: docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" / I0426 11:22:43.430204 8357 ssh_runner.go:149] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts I0426 11:22:43.433985 8357 preload.go:97] Checking if preload exists for k8s version v1.20.2 and runtime docker I0426 11:22:43.434049 8357 preload.go:105] Found local preload: /home/jervan/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v10-v1.20.2-docker-overlay2-amd64.tar.lz4 I0426 11:22:43.434125 8357 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}} I0426 11:22:43.463640 8357 docker.go:455] Got preloaded images: -- stdout -- gcr.io/k8s-minikube/storage-provisioner:v5 k8s.gcr.io/kube-proxy:v1.20.2 k8s.gcr.io/kube-controller-manager:v1.20.2 k8s.gcr.io/kube-apiserver:v1.20.2 k8s.gcr.io/kube-scheduler:v1.20.2 kubernetesui/dashboard:v2.1.0 k8s.gcr.io/etcd:3.4.13-0 k8s.gcr.io/coredns:1.7.0 kubernetesui/metrics-scraper:v1.0.4 k8s.gcr.io/pause:3.2 -- /stdout -- I0426 11:22:43.463701 8357 docker.go:392] Images already preloaded, skipping extraction I0426 11:22:43.463786 8357 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}} - I0426 11:22:43.493932 8357 docker.go:455] Got preloaded images: -- stdout -- gcr.io/k8s-minikube/storage-provisioner:v5 k8s.gcr.io/kube-proxy:v1.20.2 k8s.gcr.io/kube-controller-manager:v1.20.2 k8s.gcr.io/kube-apiserver:v1.20.2 k8s.gcr.io/kube-scheduler:v1.20.2 kubernetesui/dashboard:v2.1.0 k8s.gcr.io/etcd:3.4.13-0 k8s.gcr.io/coredns:1.7.0 kubernetesui/metrics-scraper:v1.0.4 k8s.gcr.io/pause:3.2 -- /stdout -- I0426 11:22:43.493985 8357 cache_images.go:74] Images are preloaded, skipping loading I0426 11:22:43.494072 8357 ssh_runner.go:149] Run: docker info --format {{.CgroupDriver}} I0426 11:22:43.559541 8357 cni.go:81] Creating CNI manager for "" I0426 11:22:43.559581 8357 cni.go:153] CNI unnecessary in this configuration, recommending no CNI I0426 11:22:43.559604 8357 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16 I0426 11:22:43.559637 8357 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.20.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:minikube NodeName:minikube DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]} I0426 11:22:43.559765 8357 kubeadm.go:157] kubeadm config: apiVersion: kubeadm.k8s.io/v1beta2 kind: InitConfiguration localAPIEndpoint: advertiseAddress: 192.168.49.2 bindPort: 8443 bootstrapTokens: - groups: - system:bootstrappers:kubeadm:default-node-token ttl: 24h0m0s usages: - signing - authentication nodeRegistration: criSocket: /var/run/dockershim.sock name: "minikube" kubeletExtraArgs: node-ip: 192.168.49.2 taints: [] --- apiVersion: kubeadm.k8s.io/v1beta2 kind: ClusterConfiguration apiServer: certSANs: ["127.0.0.1", "localhost", "192.168.49.2"] extraArgs: enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota" controllerManager: extraArgs: allocate-node-cidrs: "true" leader-elect: "false" scheduler: extraArgs: leader-elect: "false" certificatesDir: /var/lib/minikube/certs clusterName: mk controlPlaneEndpoint: control-plane.minikube.internal:8443 dns: type: CoreDNS etcd: local: dataDir: /var/lib/minikube/etcd extraArgs: proxy-refresh-interval: "70000" kubernetesVersion: v1.20.2 networking: dnsDomain: cluster.local podSubnet: "10.244.0.0/16" serviceSubnet: 10.96.0.0/12 --- apiVersion: kubelet.config.k8s.io/v1beta1 kind: KubeletConfiguration authentication: x509: clientCAFile: /var/lib/minikube/certs/ca.crt cgroupDriver: cgroupfs clusterDomain: "cluster.local" # disable disk resource management by default imageGCHighThresholdPercent: 100 evictionHard: nodefs.available: "0%" nodefs.inodesFree: "0%" imagefs.available: "0%" failSwapOn: false staticPodPath: /etc/kubernetes/manifests --- apiVersion: kubeproxy.config.k8s.io/v1alpha1 kind: KubeProxyConfiguration clusterCIDR: "10.244.0.0/16" metricsBindAddress: 0.0.0.0:10249 I0426 11:22:43.559872 8357 kubeadm.go:897] kubelet [Unit] Wants=docker.socket [Service] ExecStart= ExecStart=/var/lib/minikube/binaries/v1.20.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=minikube --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2 [Install] config: {KubernetesVersion:v1.20.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} I0426 11:22:43.559945 8357 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.20.2 I0426 11:22:43.567138 8357 binaries.go:44] Found k8s binaries, skipping transfer I0426 11:22:43.567211 8357 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube I0426 11:22:43.575157 8357 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (334 bytes) \ I0426 11:22:43.587751 8357 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes) I0426 11:22:43.599987 8357 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (1840 bytes) I0426 11:22:43.612907 8357 ssh_runner.go:149] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts I0426 11:22:43.615911 8357 certs.go:52] Setting up /home/jervan/.minikube/profiles/minikube for IP: 192.168.49.2 I0426 11:22:43.615968 8357 certs.go:171] skipping minikubeCA CA generation: /home/jervan/.minikube/ca.key I0426 11:22:43.615993 8357 certs.go:171] skipping proxyClientCA CA generation: /home/jervan/.minikube/proxy-client-ca.key I0426 11:22:43.616056 8357 certs.go:282] skipping minikube-user signed cert generation: /home/jervan/.minikube/profiles/minikube/client.key I0426 11:22:43.616097 8357 certs.go:282] skipping minikube signed cert generation: /home/jervan/.minikube/profiles/minikube/apiserver.key.dd3b5fb2 I0426 11:22:43.616140 8357 certs.go:282] skipping aggregator signed cert generation: /home/jervan/.minikube/profiles/minikube/proxy-client.key I0426 11:22:43.616171 8357 vm_assets.go:96] NewFileAsset: /home/jervan/.minikube/profiles/minikube/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt I0426 11:22:43.616196 8357 vm_assets.go:96] NewFileAsset: /home/jervan/.minikube/profiles/minikube/apiserver.key -> /var/lib/minikube/certs/apiserver.key I0426 11:22:43.616230 8357 vm_assets.go:96] NewFileAsset: /home/jervan/.minikube/profiles/minikube/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt I0426 11:22:43.616267 8357 vm_assets.go:96] NewFileAsset: /home/jervan/.minikube/profiles/minikube/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key I0426 11:22:43.616301 8357 vm_assets.go:96] NewFileAsset: /home/jervan/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt I0426 11:22:43.616335 8357 vm_assets.go:96] NewFileAsset: /home/jervan/.minikube/ca.key -> /var/lib/minikube/certs/ca.key I0426 11:22:43.616357 8357 vm_assets.go:96] NewFileAsset: /home/jervan/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt I0426 11:22:43.616406 8357 vm_assets.go:96] NewFileAsset: /home/jervan/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key I0426 11:22:43.616463 8357 certs.go:361] found cert: /home/jervan/.minikube/certs/home/jervan/.minikube/certs/ca-key.pem (1675 bytes) I0426 11:22:43.616514 8357 certs.go:361] found cert: /home/jervan/.minikube/certs/home/jervan/.minikube/certs/ca.pem (1078 bytes) I0426 11:22:43.616560 8357 certs.go:361] found cert: /home/jervan/.minikube/certs/home/jervan/.minikube/certs/cert.pem (1119 bytes) I0426 11:22:43.616600 8357 certs.go:361] found cert: /home/jervan/.minikube/certs/home/jervan/.minikube/certs/key.pem (1675 bytes) I0426 11:22:43.616649 8357 vm_assets.go:96] NewFileAsset: /home/jervan/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem I0426 11:22:43.617343 8357 ssh_runner.go:316] scp /home/jervan/.minikube/profiles/minikube/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes) I0426 11:22:43.634408 8357 ssh_runner.go:316] scp /home/jervan/.minikube/profiles/minikube/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes) I0426 11:22:43.652746 8357 ssh_runner.go:316] scp /home/jervan/.minikube/profiles/minikube/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes) I0426 11:22:43.671523 8357 ssh_runner.go:316] scp /home/jervan/.minikube/profiles/minikube/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes) | I0426 11:22:43.691708 8357 ssh_runner.go:316] scp /home/jervan/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes) I0426 11:22:43.710162 8357 ssh_runner.go:316] scp /home/jervan/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes) I0426 11:22:43.728239 8357 ssh_runner.go:316] scp /home/jervan/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes) I0426 11:22:43.745670 8357 ssh_runner.go:316] scp /home/jervan/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes) I0426 11:22:43.762568 8357 ssh_runner.go:316] scp /home/jervan/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes) I0426 11:22:43.780158 8357 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (740 bytes) / I0426 11:22:43.792697 8357 ssh_runner.go:149] Run: openssl version I0426 11:22:43.797122 8357 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem" I0426 11:22:43.805240 8357 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem I0426 11:22:43.808820 8357 certs.go:402] hashing: -rw-r--r-- 1 root root 1111 Apr 26 08:48 /usr/share/ca-certificates/minikubeCA.pem I0426 11:22:43.808879 8357 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem I0426 11:22:43.813247 8357 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0" I0426 11:22:43.821072 8357 kubeadm.go:386] StartCluster: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.20@sha256:0250dab3644403384bd54f566921c6b57138eecffbb861f9392feef9b2ec44f6 Memory:6300 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.20.2 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false} I0426 11:22:43.821194 8357 ssh_runner.go:149] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}} I0426 11:22:43.852241 8357 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd I0426 11:22:43.859605 8357 kubeadm.go:397] found existing configuration files, will attempt cluster restart I0426 11:22:43.859667 8357 kubeadm.go:596] restartCluster start I0426 11:22:43.859701 8357 ssh_runner.go:149] Run: sudo test -d /data/minikube I0426 11:22:43.866576 8357 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1 stdout: stderr: I0426 11:22:43.867344 8357 kubeconfig.go:93] found "minikube" server: "https://192.168.49.2:8443" I0426 11:22:43.869109 8357 kapi.go:59] client config for minikube: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jervan/.minikube/profiles/minikube/client.crt", KeyFile:"/home/jervan/.minikube/profiles/minikube/client.key", CAFile:"/home/jervan/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1a71760), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)} I0426 11:22:43.869572 8357 cert_rotation.go:137] Starting client certificate rotation controller I0426 11:22:43.870160 8357 ssh_runner.go:149] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new I0426 11:22:43.877827 8357 api_server.go:146] Checking apiserver status ... I0426 11:22:43.877894 8357 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.* - I0426 11:22:43.893532 8357 ssh_runner.go:149] Run: sudo egrep ^[0-9]+:freezer: /proc/1920/cgroup I0426 11:22:43.901403 8357 api_server.go:162] apiserver freezer: "20:freezer:/docker/6f12f9a37b9e0559740ac958a2d9f28bdc92ab3f9a45cbe3df22add8bd865869/kubepods/burstable/podc767dbeb9ddd2d01964c2fc02c621c4e/26803d9e237c4a6fa043b7dae216934173d01668a8eaaf7da3e6f860b9a9662d" I0426 11:22:43.901503 8357 ssh_runner.go:149] Run: sudo cat /sys/fs/cgroup/freezer/docker/6f12f9a37b9e0559740ac958a2d9f28bdc92ab3f9a45cbe3df22add8bd865869/kubepods/burstable/podc767dbeb9ddd2d01964c2fc02c621c4e/26803d9e237c4a6fa043b7dae216934173d01668a8eaaf7da3e6f860b9a9662d/freezer.state I0426 11:22:43.908612 8357 api_server.go:184] freezer state: "THAWED" I0426 11:22:43.908660 8357 api_server.go:221] Checking apiserver healthz at https://192.168.49.2:8443/healthz ... | I0426 11:24:53.684992 8357 api_server.go:231] stopped: https://192.168.49.2:8443/healthz: Get "https://192.168.49.2:8443/healthz": dial tcp 192.168.49.2:8443: connect: connection timed out I0426 11:24:53.685068 8357 kubeadm.go:575] needs reconfigure: apiserver in state Stopped I0426 11:24:53.685093 8357 kubeadm.go:1020] stopping kube-system containers ... I0426 11:24:53.685204 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}} / I0426 11:24:53.716427 8357 docker.go:293] Stopping containers: [5d01245c0a14 e540090f8da4 d2e34314d3d7 3948d79290a2 a0436291ae35 84abef2c2cf6 5eb185af9240 66d78a2ce48e f6273bfc6ca9 99f6b32970b2 26803d9e237c c0c33b716438 5a6fdb9838a5 0c86d24542e9 eacb672dbd6d d087acedd2d2] I0426 11:24:53.716506 8357 ssh_runner.go:149] Run: docker stop 5d01245c0a14 e540090f8da4 d2e34314d3d7 3948d79290a2 a0436291ae35 84abef2c2cf6 5eb185af9240 66d78a2ce48e f6273bfc6ca9 99f6b32970b2 26803d9e237c c0c33b716438 5a6fdb9838a5 0c86d24542e9 eacb672dbd6d d087acedd2d2 | I0426 11:24:58.871549 8357 ssh_runner.go:189] Completed: docker stop 5d01245c0a14 e540090f8da4 d2e34314d3d7 3948d79290a2 a0436291ae35 84abef2c2cf6 5eb185af9240 66d78a2ce48e f6273bfc6ca9 99f6b32970b2 26803d9e237c c0c33b716438 5a6fdb9838a5 0c86d24542e9 eacb672dbd6d d087acedd2d2: (5.1549929s) I0426 11:24:58.871637 8357 ssh_runner.go:149] Run: sudo systemctl stop kubelet I0426 11:24:58.930858 8357 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf I0426 11:24:58.939801 8357 kubeadm.go:154] found existing configuration files: -rw------- 1 root root 5615 Apr 26 09:12 /etc/kubernetes/admin.conf -rw------- 1 root root 5632 Apr 26 09:12 /etc/kubernetes/controller-manager.conf -rw------- 1 root root 1971 Apr 26 09:12 /etc/kubernetes/kubelet.conf -rw------- 1 root root 5576 Apr 26 09:12 /etc/kubernetes/scheduler.conf I0426 11:24:58.939883 8357 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf / I0426 11:24:58.947744 8357 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf I0426 11:24:58.955474 8357 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf I0426 11:24:58.962825 8357 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1 stdout: stderr: I0426 11:24:58.962919 8357 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/controller-manager.conf I0426 11:24:58.970822 8357 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf I0426 11:24:58.978899 8357 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1 stdout: stderr: I0426 11:24:58.979006 8357 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/scheduler.conf I0426 11:24:58.986628 8357 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml I0426 11:24:58.993660 8357 kubeadm.go:672] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml I0426 11:24:58.993715 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.2:$PATH kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml" \ I0426 11:24:59.171066 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.2:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml" \ I0426 11:25:00.039195 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.2:$PATH kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml" - I0426 11:25:00.345706 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.2:$PATH kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml" | I0426 11:25:00.536178 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.2:$PATH kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml" \ I0426 11:25:00.759271 8357 api_server.go:48] waiting for apiserver process to appear ... I0426 11:25:00.759338 8357 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.* I0426 11:25:00.776086 8357 api_server.go:68] duration metric: took 16.8161ms to wait for apiserver process to appear ... I0426 11:25:00.776130 8357 api_server.go:84] waiting for apiserver healthz status ... I0426 11:25:00.776192 8357 api_server.go:221] Checking apiserver healthz at https://192.168.49.2:8443/healthz ... \ I0426 11:27:11.915020 8357 api_server.go:231] stopped: https://192.168.49.2:8443/healthz: Get "https://192.168.49.2:8443/healthz": dial tcp 192.168.49.2:8443: connect: connection timed out | I0426 11:27:12.416248 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0426 11:27:12.446507 8357 logs.go:256] 2 containers: [6632851be9d3 26803d9e237c] I0426 11:27:12.446585 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} / I0426 11:27:12.475152 8357 logs.go:256] 2 containers: [3ee27c87a397 c0c33b716438] I0426 11:27:12.475247 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0426 11:27:12.502664 8357 logs.go:256] 4 containers: [04114f628189 ec01d791d166 d2e34314d3d7 3948d79290a2] I0426 11:27:12.502748 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0426 11:27:12.531999 8357 logs.go:256] 2 containers: [45a56499ae06 f6273bfc6ca9] I0426 11:27:12.532071 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0426 11:27:12.561477 8357 logs.go:256] 2 containers: [19c40ee85c46 5eb185af9240] I0426 11:27:12.561549 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} - I0426 11:27:12.589933 8357 logs.go:256] 0 containers: [] W0426 11:27:12.589983 8357 logs.go:258] No container was found matching "kubernetes-dashboard" I0426 11:27:12.590029 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0426 11:27:12.617790 8357 logs.go:256] 2 containers: [82a20bf1e446 5d01245c0a14] I0426 11:27:12.617876 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0426 11:27:12.645717 8357 logs.go:256] 2 containers: [7e8f49b5c2be 99f6b32970b2] I0426 11:27:12.645770 8357 logs.go:122] Gathering logs for kube-controller-manager [99f6b32970b2] ... I0426 11:27:12.645780 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 99f6b32970b2" \ I0426 11:27:12.689112 8357 logs.go:122] Gathering logs for kube-apiserver [26803d9e237c] ... I0426 11:27:12.689190 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 26803d9e237c" I0426 11:27:12.743292 8357 logs.go:122] Gathering logs for etcd [3ee27c87a397] ... I0426 11:27:12.743349 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 3ee27c87a397" | I0426 11:27:12.774270 8357 logs.go:122] Gathering logs for etcd [c0c33b716438] ... I0426 11:27:12.774297 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 c0c33b716438" I0426 11:27:12.809190 8357 logs.go:122] Gathering logs for coredns [ec01d791d166] ... I0426 11:27:12.809246 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 ec01d791d166" I0426 11:27:12.840509 8357 logs.go:122] Gathering logs for coredns [3948d79290a2] ... I0426 11:27:12.840555 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 3948d79290a2" I0426 11:27:12.871185 8357 logs.go:122] Gathering logs for Docker ... I0426 11:27:12.871231 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo journalctl -u docker -n 400" / I0426 11:27:12.887335 8357 logs.go:122] Gathering logs for kubelet ... I0426 11:27:12.887381 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0426 11:27:12.943545 8357 logs.go:122] Gathering logs for dmesg ... I0426 11:27:12.943606 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0426 11:27:12.957585 8357 logs.go:122] Gathering logs for coredns [d2e34314d3d7] ... I0426 11:27:12.957633 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 d2e34314d3d7" - I0426 11:27:12.987259 8357 logs.go:122] Gathering logs for kube-scheduler [45a56499ae06] ... I0426 11:27:12.987307 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 45a56499ae06" I0426 11:27:13.016815 8357 logs.go:122] Gathering logs for kube-proxy [19c40ee85c46] ... I0426 11:27:13.016862 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 19c40ee85c46" I0426 11:27:13.047699 8357 logs.go:122] Gathering logs for kube-proxy [5eb185af9240] ... I0426 11:27:13.047746 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 5eb185af9240" \ I0426 11:27:13.079167 8357 logs.go:122] Gathering logs for storage-provisioner [82a20bf1e446] ... I0426 11:27:13.079213 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 82a20bf1e446" I0426 11:27:13.112607 8357 logs.go:122] Gathering logs for storage-provisioner [5d01245c0a14] ... I0426 11:27:13.112659 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 5d01245c0a14" I0426 11:27:13.144676 8357 logs.go:122] Gathering logs for describe nodes ... I0426 11:27:13.144726 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" - I0426 11:27:13.409117 8357 logs.go:122] Gathering logs for kube-apiserver [6632851be9d3] ... I0426 11:27:13.409175 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 6632851be9d3" I0426 11:27:13.446986 8357 logs.go:122] Gathering logs for kube-controller-manager [7e8f49b5c2be] ... I0426 11:27:13.447041 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 7e8f49b5c2be" \ I0426 11:27:13.485443 8357 logs.go:122] Gathering logs for container status ... I0426 11:27:13.485490 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0426 11:27:13.502348 8357 logs.go:122] Gathering logs for coredns [04114f628189] ... I0426 11:27:13.502394 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 04114f628189" I0426 11:27:13.532659 8357 logs.go:122] Gathering logs for kube-scheduler [f6273bfc6ca9] ... I0426 11:27:13.532715 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 f6273bfc6ca9" | I0426 11:27:16.065332 8357 api_server.go:221] Checking apiserver healthz at https://192.168.49.2:8443/healthz ... - I0426 11:29:30.155062 8357 api_server.go:231] stopped: https://192.168.49.2:8443/healthz: Get "https://192.168.49.2:8443/healthz": dial tcp 192.168.49.2:8443: connect: connection timed out / I0426 11:29:30.415664 8357 kubeadm.go:600] restartCluster took 6m46.5559862s W0426 11:29:30.415834 8357 out.go:222] 🀦 Unable to restart cluster, will reset it: apiserver health: apiserver healthz never reported healthy: cluster wait timed out during healthz check 🀦 Unable to restart cluster, will reset it: apiserver health: apiserver healthz never reported healthy: cluster wait timed out during healthz check I0426 11:29:30.415908 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.2:$PATH kubeadm reset --cri-socket /var/run/dockershim.sock --force" I0426 11:29:54.108787 8357 ssh_runner.go:189] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.2:$PATH kubeadm reset --cri-socket /var/run/dockershim.sock --force": (23.6928381s) I0426 11:29:54.108866 8357 ssh_runner.go:149] Run: sudo systemctl stop -f kubelet I0426 11:29:54.119269 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}} I0426 11:29:54.149807 8357 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml I0426 11:29:54.157421 8357 kubeadm.go:220] ignoring SystemVerification for kubeadm because of docker driver I0426 11:29:54.157502 8357 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf I0426 11:29:54.164456 8357 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2 stdout: stderr: ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory I0426 11:29:54.164510 8357 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.20.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables" I0426 11:29:54.748026 8357 out.go:184] β–ͺ Generating certificates and keys ... β–ͺ Generating certificates and keys ...\ I0426 11:29:55.521719 8357 out.go:184] β–ͺ Booting up control plane ... β–ͺ Booting up control plane ...\ I0426 11:30:09.560065 8357 out.go:184] β–ͺ Configuring RBAC rules ... β–ͺ Configuring RBAC rules ...\ I0426 11:30:09.975795 8357 cni.go:81] Creating CNI manager for "" I0426 11:30:09.975848 8357 cni.go:153] CNI unnecessary in this configuration, recommending no CNI I0426 11:30:09.975896 8357 ssh_runner.go:149] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj" I0426 11:30:09.975965 8357 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.20.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig I0426 11:30:09.976009 8357 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.20.2/kubectl label nodes minikube.k8s.io/version=v1.19.0 minikube.k8s.io/commit=15cede53bdc5fe242228853e737333b09d4336b5 minikube.k8s.io/name=minikube minikube.k8s.io/updated_at=2021_04_26T11_30_09_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig | I0426 11:30:10.042860 8357 ops.go:34] apiserver oom_adj: -16 / I0426 11:30:10.141980 8357 kubeadm.go:973] duration metric: took 166.0645ms to wait for elevateKubeSystemPrivileges. I0426 11:30:10.142044 8357 kubeadm.go:388] StartCluster complete in 7m26.3209766s I0426 11:30:10.142090 8357 settings.go:142] acquiring lock: {Name:mkb476309b92a734ca1cd9b20af4df3dde2265fa Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0426 11:30:10.142293 8357 settings.go:150] Updating kubeconfig: /home/jervan/.kube/config I0426 11:30:10.143262 8357 lock.go:36] WriteFile acquiring /home/jervan/.kube/config: {Name:mk1416ebb7846af0da642f12eb2c02964b83dd13 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0426 11:30:10.145722 8357 kapi.go:59] client config for minikube: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jervan/.minikube/profiles/minikube/client.crt", KeyFile:"/home/jervan/.minikube/profiles/minikube/client.key", CAFile:"/home/jervan/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1a71760), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)} \ W0426 11:30:40.147576 8357 kapi.go:226] failed getting deployment scale, will retry: Get "https://192.168.49.2:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale": dial tcp 192.168.49.2:8443: i/o timeout \ W0426 11:31:10.648151 8357 kapi.go:226] failed getting deployment scale, will retry: Get "https://192.168.49.2:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale": dial tcp 192.168.49.2:8443: i/o timeout - W0426 11:31:41.149691 8357 kapi.go:226] failed getting deployment scale, will retry: Get "https://192.168.49.2:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale": dial tcp 192.168.49.2:8443: i/o timeout / W0426 11:32:11.649446 8357 kapi.go:226] failed getting deployment scale, will retry: Get "https://192.168.49.2:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale": dial tcp 192.168.49.2:8443: i/o timeout / W0426 11:32:42.148494 8357 kapi.go:226] failed getting deployment scale, will retry: Get "https://192.168.49.2:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale": dial tcp 192.168.49.2:8443: i/o timeout \ W0426 11:33:12.149767 8357 kapi.go:226] failed getting deployment scale, will retry: Get "https://192.168.49.2:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale": dial tcp 192.168.49.2:8443: i/o timeout I0426 11:33:12.149822 8357 kapi.go:241] timed out trying to rescale deployment "coredns" in namespace "kube-system" and context "minikube" to 1: timed out waiting for the condition E0426 11:33:12.149858 8357 start.go:131] Unable to scale down deployment "coredns" in namespace "kube-system" to 1 replica: timed out waiting for the condition I0426 11:33:12.149902 8357 start.go:200] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.20.2 ControlPlane:true Worker:true} I0426 11:33:12.149984 8357 addons.go:328] enableAddons start: toEnable=map[], additional=[] I0426 11:33:12.156831 8357 out.go:157] πŸ”Ž Verifying Kubernetes components... πŸ”Ž Verifying Kubernetes components... I0426 11:33:12.156928 8357 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet I0426 11:33:12.150046 8357 addons.go:55] Setting storage-provisioner=true in profile "minikube" I0426 11:33:12.156972 8357 addons.go:131] Setting addon storage-provisioner=true in "minikube" W0426 11:33:12.156984 8357 addons.go:140] addon storage-provisioner should already be in state true I0426 11:33:12.156997 8357 host.go:66] Checking if "minikube" exists ... I0426 11:33:12.150055 8357 addons.go:55] Setting default-storageclass=true in profile "minikube" I0426 11:33:12.157057 8357 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "minikube" I0426 11:33:12.157252 8357 cli_runner.go:115] Run: docker container inspect minikube --format={{.State.Status}} I0426 11:33:12.157321 8357 cli_runner.go:115] Run: docker container inspect minikube --format={{.State.Status}} I0426 11:33:12.168589 8357 api_server.go:48] waiting for apiserver process to appear ... I0426 11:33:12.168687 8357 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.* I0426 11:33:12.191680 8357 api_server.go:68] duration metric: took 41.7377ms to wait for apiserver process to appear ... I0426 11:33:12.191717 8357 api_server.go:84] waiting for apiserver healthz status ... I0426 11:33:12.191746 8357 api_server.go:221] Checking apiserver healthz at https://192.168.49.2:8443/healthz ... I0426 11:33:12.322325 8357 kapi.go:59] client config for minikube: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jervan/.minikube/profiles/minikube/client.crt", KeyFile:"/home/jervan/.minikube/profiles/minikube/client.key", CAFile:"/home/jervan/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1a71760), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)} I0426 11:33:12.327782 8357 out.go:157] β–ͺ Using image gcr.io/k8s-minikube/storage-provisioner:v5 β–ͺ Using image gcr.io/k8s-minikube/storage-provisioner:v5 I0426 11:33:12.327995 8357 addons.go:261] installing /etc/kubernetes/addons/storage-provisioner.yaml I0426 11:33:12.328034 8357 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes) I0426 11:33:12.328137 8357 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0426 11:33:12.475498 8357 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49162 SSHKeyPath:/home/jervan/.minikube/machines/minikube/id_rsa Username:docker} I0426 11:33:12.521853 8357 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml W0426 11:33:42.324584 8357 out.go:222] ❗ Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://192.168.49.2:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 192.168.49.2:8443: i/o timeout] ❗ Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://192.168.49.2:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 192.168.49.2:8443: i/o timeout] I0426 11:33:42.331483 8357 out.go:157] 🌟 Enabled addons: storage-provisioner 🌟 Enabled addons: storage-provisioner I0426 11:33:42.331537 8357 addons.go:330] enableAddons completed in 30.1815626s I0426 11:35:23.435177 8357 api_server.go:231] stopped: https://192.168.49.2:8443/healthz: Get "https://192.168.49.2:8443/healthz": dial tcp 192.168.49.2:8443: connect: connection timed out I0426 11:35:23.936266 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0426 11:35:23.971534 8357 logs.go:256] 1 containers: [c67507cb2726] I0426 11:35:23.971619 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0426 11:35:24.000718 8357 logs.go:256] 1 containers: [aac913e93cc2] I0426 11:35:24.000804 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0426 11:35:24.031372 8357 logs.go:256] 2 containers: [0bbd80e5a1d7 c7f18c2ce192] I0426 11:35:24.031464 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0426 11:35:24.060987 8357 logs.go:256] 1 containers: [64e90c5f5e85] I0426 11:35:24.061100 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0426 11:35:24.089985 8357 logs.go:256] 1 containers: [cdeba80a861b] I0426 11:35:24.090080 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0426 11:35:24.119243 8357 logs.go:256] 0 containers: [] W0426 11:35:24.119285 8357 logs.go:258] No container was found matching "kubernetes-dashboard" I0426 11:35:24.119354 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0426 11:35:24.148449 8357 logs.go:256] 1 containers: [6fc8e75d2ddf] I0426 11:35:24.148534 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0426 11:35:24.177108 8357 logs.go:256] 1 containers: [985a83aaea6c] I0426 11:35:24.177172 8357 logs.go:122] Gathering logs for kubelet ... I0426 11:35:24.177185 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0426 11:35:24.226960 8357 logs.go:122] Gathering logs for describe nodes ... I0426 11:35:24.227020 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0426 11:35:24.300255 8357 logs.go:122] Gathering logs for etcd [aac913e93cc2] ... I0426 11:35:24.300302 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 aac913e93cc2" I0426 11:35:24.331718 8357 logs.go:122] Gathering logs for kube-scheduler [64e90c5f5e85] ... I0426 11:35:24.331765 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 64e90c5f5e85" I0426 11:35:24.363487 8357 logs.go:122] Gathering logs for kube-controller-manager [985a83aaea6c] ... I0426 11:35:24.363533 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 985a83aaea6c" I0426 11:35:24.404064 8357 logs.go:122] Gathering logs for container status ... I0426 11:35:24.404110 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0426 11:35:24.420459 8357 logs.go:122] Gathering logs for dmesg ... I0426 11:35:24.420500 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0426 11:35:24.435010 8357 logs.go:122] Gathering logs for kube-apiserver [c67507cb2726] ... I0426 11:35:24.435055 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 c67507cb2726" I0426 11:35:24.475892 8357 logs.go:122] Gathering logs for coredns [0bbd80e5a1d7] ... I0426 11:35:24.475951 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 0bbd80e5a1d7" I0426 11:35:24.505012 8357 logs.go:122] Gathering logs for coredns [c7f18c2ce192] ... I0426 11:35:24.505058 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 c7f18c2ce192" I0426 11:35:24.534036 8357 logs.go:122] Gathering logs for kube-proxy [cdeba80a861b] ... I0426 11:35:24.534081 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 cdeba80a861b" I0426 11:35:24.564577 8357 logs.go:122] Gathering logs for storage-provisioner [6fc8e75d2ddf] ... I0426 11:35:24.564622 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 6fc8e75d2ddf" I0426 11:35:24.594645 8357 logs.go:122] Gathering logs for Docker ... I0426 11:35:24.594691 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0426 11:35:27.112165 8357 api_server.go:221] Checking apiserver healthz at https://192.168.49.2:8443/healthz ... I0426 11:37:36.555358 8357 api_server.go:231] stopped: https://192.168.49.2:8443/healthz: Get "https://192.168.49.2:8443/healthz": dial tcp 192.168.49.2:8443: connect: connection timed out I0426 11:37:36.936408 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0426 11:37:36.966993 8357 logs.go:256] 1 containers: [c67507cb2726] I0426 11:37:36.967097 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0426 11:37:36.994045 8357 logs.go:256] 1 containers: [aac913e93cc2] I0426 11:37:36.994128 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0426 11:37:37.022063 8357 logs.go:256] 2 containers: [0bbd80e5a1d7 c7f18c2ce192] I0426 11:37:37.022157 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0426 11:37:37.049679 8357 logs.go:256] 1 containers: [64e90c5f5e85] I0426 11:37:37.049763 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0426 11:37:37.077015 8357 logs.go:256] 1 containers: [cdeba80a861b] I0426 11:37:37.077121 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0426 11:37:37.106340 8357 logs.go:256] 0 containers: [] W0426 11:37:37.106381 8357 logs.go:258] No container was found matching "kubernetes-dashboard" I0426 11:37:37.106437 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0426 11:37:37.134375 8357 logs.go:256] 1 containers: [6fc8e75d2ddf] I0426 11:37:37.134455 8357 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0426 11:37:37.162347 8357 logs.go:256] 1 containers: [985a83aaea6c] I0426 11:37:37.162396 8357 logs.go:122] Gathering logs for coredns [c7f18c2ce192] ... I0426 11:37:37.162429 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 c7f18c2ce192" I0426 11:37:37.191057 8357 logs.go:122] Gathering logs for kube-scheduler [64e90c5f5e85] ... I0426 11:37:37.191102 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 64e90c5f5e85" I0426 11:37:37.222778 8357 logs.go:122] Gathering logs for storage-provisioner [6fc8e75d2ddf] ... I0426 11:37:37.222830 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 6fc8e75d2ddf" I0426 11:37:37.251669 8357 logs.go:122] Gathering logs for kube-controller-manager [985a83aaea6c] ... I0426 11:37:37.251715 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 985a83aaea6c" I0426 11:37:37.292770 8357 logs.go:122] Gathering logs for Docker ... I0426 11:37:37.292832 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0426 11:37:37.310257 8357 logs.go:122] Gathering logs for kubelet ... I0426 11:37:37.310308 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0426 11:37:37.366154 8357 logs.go:122] Gathering logs for kube-apiserver [c67507cb2726] ... I0426 11:37:37.366216 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 c67507cb2726" I0426 11:37:37.405380 8357 logs.go:122] Gathering logs for coredns [0bbd80e5a1d7] ... I0426 11:37:37.405436 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 0bbd80e5a1d7" I0426 11:37:37.435875 8357 logs.go:122] Gathering logs for container status ... I0426 11:37:37.435920 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0426 11:37:37.452319 8357 logs.go:122] Gathering logs for kube-proxy [cdeba80a861b] ... I0426 11:37:37.452365 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 cdeba80a861b" I0426 11:37:37.482974 8357 logs.go:122] Gathering logs for dmesg ... I0426 11:37:37.483034 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0426 11:37:37.498058 8357 logs.go:122] Gathering logs for describe nodes ... I0426 11:37:37.498104 8357 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.20.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0426 11:37:37.750455 8357 logs.go:122] Gathering logs for etcd [aac913e93cc2] ... I0426 11:37:37.750511 8357 ssh_runner.go:149] Run: /bin/bash -c "docker logs --tail 400 aac913e93cc2" I0426 11:37:40.284275 8357 api_server.go:221] Checking apiserver healthz at https://192.168.49.2:8443/healthz ... I0426 11:39:49.675191 8357 api_server.go:231] stopped: https://192.168.49.2:8443/healthz: Get "https://192.168.49.2:8443/healthz": dial tcp 192.168.49.2:8443: connect: connection timed out I0426 11:39:49.681888 8357 out.go:157] W0426 11:39:49.682079 8357 out.go:222] ❌ Exiting due to GUEST_START: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check ❌ Exiting due to GUEST_START: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: cluster wait timed out during healthz check W0426 11:39:49.682128 8357 out.go:222] W0426 11:39:49.682180 8357 out.go:222] 😿 If the above advice does not help, please let us know: 😿 If the above advice does not help, please let us know: W0426 11:39:49.682230 8357 out.go:222] πŸ‘‰ https://github.com/kubernetes/minikube/issues/new/choose πŸ‘‰ https://github.com/kubernetes/minikube/issues/new/choose I0426 11:39:49.684313 8357 out.go:157] ```
esron commented 3 years ago

I'm having the same Issue.

My workaround is running minikube naively on windows via Powershel using the .exe installer.

But is way slower.

sharifelgamal commented 3 years ago

Yeah properly supporting WSL with the docker and none drivers is in our roadmap for this year.

k8s-triage-robot commented 3 years ago

The Kubernetes project currently lacks enough contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

hardik-dadhich commented 3 years ago

Hi @priyawadhwa , @BioGeek I am also facing same error:

I am running it on mac with hyperkit

minikube start --driver=hyperkit --alsologtostderr -v=4                                     80 err | 11m 6s | 10:31:35 AM 
I1008 10:38:53.919767   27221 out.go:286] Setting OutFile to fd 1 ...
I1008 10:38:53.920285   27221 out.go:338] isatty.IsTerminal(1) = true
I1008 10:38:53.920295   27221 out.go:299] Setting ErrFile to fd 2...
I1008 10:38:53.920302   27221 out.go:338] isatty.IsTerminal(2) = true
I1008 10:38:53.920678   27221 root.go:312] Updating PATH: /Users/hardikdadhich/.minikube/bin
I1008 10:38:53.922423   27221 out.go:293] Setting JSON to false
I1008 10:38:53.983664   27221 start.go:111] hostinfo: {"hostname":"Hardiks-MacBook-Pro.local","uptime":606148,"bootTime":1633063585,"procs":683,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.6","kernelVersion":"20.6.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"c2591f4e-ee82-33cc-8c59-db81d9ad80dd"}
W1008 10:38:53.983810   27221 start.go:119] gopshost.Virtualization returned error: not implemented yet
I1008 10:38:53.989777   27221 out.go:165] πŸ˜„  minikube v1.22.0 on Darwin 11.6
πŸ˜„  minikube v1.22.0 on Darwin 11.6
I1008 10:38:54.005828   27221 main.go:130] libmachine: Found binary path at /Users/hardikdadhich/.minikube/bin/docker-machine-driver-hyperkit
I1008 10:38:54.008032   27221 main.go:130] libmachine: Launching plugin server for driver hyperkit
I1008 10:38:54.065187   27221 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:51532
I1008 10:38:54.068193   27221 main.go:130] libmachine: () Calling .GetVersion
I1008 10:38:54.069655   27221 main.go:130] libmachine: Using API Version  1
I1008 10:38:54.069683   27221 main.go:130] libmachine: () Calling .SetConfigRaw
I1008 10:38:54.069991   27221 main.go:130] libmachine: () Calling .GetMachineName
I1008 10:38:54.070105   27221 main.go:130] libmachine: (minikube) Calling .DriverName
I1008 10:38:54.071056   27221 driver.go:335] Setting default libvirt URI to qemu:///system
I1008 10:38:54.071470   27221 main.go:130] libmachine: Found binary path at /Users/hardikdadhich/.minikube/bin/docker-machine-driver-hyperkit
I1008 10:38:54.071505   27221 main.go:130] libmachine: Launching plugin server for driver hyperkit
I1008 10:38:54.085565   27221 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:51538
I1008 10:38:54.086199   27221 main.go:130] libmachine: () Calling .GetVersion
I1008 10:38:54.086646   27221 main.go:130] libmachine: Using API Version  1
I1008 10:38:54.086660   27221 main.go:130] libmachine: () Calling .SetConfigRaw
I1008 10:38:54.087031   27221 main.go:130] libmachine: () Calling .GetMachineName
I1008 10:38:54.087201   27221 main.go:130] libmachine: (minikube) Calling .DriverName
I1008 10:38:54.121983   27221 out.go:165] ✨  Using the hyperkit driver based on existing profile
✨  Using the hyperkit driver based on existing profile
I1008 10:38:54.122069   27221 start.go:278] selected driver: hyperkit
I1008 10:38:54.122099   27221 start.go:751] validating driver "hyperkit" against &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.22.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.2 Port:8443 KubernetesVersion:v1.21.2 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false}
I1008 10:38:54.122403   27221 start.go:762] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}
I1008 10:38:54.122760   27221 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1008 10:38:54.123064   27221 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/hardikdadhich/.minikube/bin:/Users/hardikdadhich/.nvm/versions/node/v8.14.1/bin:/Users/hardikdadhich/.jenv/shims:/Users/hardikdadhich/.jenv/bin:/Users/hardikdadhich/Desktop/IBM-work/apprap-work/one-pipeline/all-ops-pipelines/github-release-pipeline/bin:/Library/Frameworks/Python.framework/Versions/3.7/bin:/Users/hardikdadhich/.jenv/shims:/Users/hardikdadhich/Downloads/spring-2.1.0.BUILD-SNAPSHOT/bin:/usr/local/opt/maven@3.5/bin:/bin:/usr/bin:/usr/local/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/go/bin:/usr/local/MacGPG2/bin:/Applications/Wireshark.app/Contents/MacOS:/Users/hardikdadhich/.istioctl/bin:/Users/hardikdadhich/.krew/bin:/Users/hardikdadhich/Library/Android/sdk/tools:/Users/hardikdadhich/Library/Android/sdk/tools/bin:/Users/hardikdadhich/Library/Android/sdk/platform-tools:/Users/hardikdadhich/Library/Android/sdk/emulator:/Users/hardikdadhich/.android-sdk-macosx/platform-tools/
I1008 10:38:54.137545   27221 install.go:137] /Users/hardikdadhich/.minikube/bin/docker-machine-driver-hyperkit version is 1.22.0
I1008 10:38:54.150255   27221 install.go:79] stdout: /Users/hardikdadhich/.minikube/bin/docker-machine-driver-hyperkit
I1008 10:38:54.150358   27221 install.go:81] /Users/hardikdadhich/.minikube/bin/docker-machine-driver-hyperkit looks good
I1008 10:38:54.157962   27221 cni.go:93] Creating CNI manager for ""
I1008 10:38:54.157994   27221 cni.go:167] CNI unnecessary in this configuration, recommending no CNI
I1008 10:38:54.158017   27221 start_flags.go:275] config:
{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.22.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.2 Port:8443 KubernetesVersion:v1.21.2 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false}
I1008 10:38:54.158975   27221 iso.go:123] acquiring lock: {Name:mk00ccd7618c3fe4f7c4de56ac3ee2df0f2082c2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1008 10:38:54.179767   27221 out.go:165] πŸ‘  Starting control plane node minikube in cluster minikube
πŸ‘  Starting control plane node minikube in cluster minikube
I1008 10:38:54.179823   27221 preload.go:134] Checking if preload exists for k8s version v1.21.2 and runtime docker
I1008 10:38:54.179876   27221 preload.go:150] Found local preload: /Users/hardikdadhich/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.2-docker-overlay2-amd64.tar.lz4
I1008 10:38:54.184258   27221 cache.go:56] Caching tarball of preloaded images
I1008 10:38:54.184449   27221 preload.go:174] Found /Users/hardikdadhich/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I1008 10:38:54.184475   27221 cache.go:59] Finished verifying existence of preloaded tar for  v1.21.2 on docker
I1008 10:38:54.185252   27221 profile.go:148] Saving config to /Users/hardikdadhich/.minikube/profiles/minikube/config.json ...
I1008 10:38:54.191631   27221 cache.go:205] Successfully downloaded all kic artifacts
I1008 10:38:54.191707   27221 start.go:313] acquiring machines lock for minikube: {Name:mkb9330f912d9243bae6def5b1adaa75788acca7 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1008 10:38:54.191850   27221 start.go:317] acquired machines lock for "minikube" in 121.469Β΅s
I1008 10:38:54.192244   27221 start.go:93] Skipping create...Using existing machine configuration
I1008 10:38:54.192264   27221 fix.go:55] fixHost starting: 
I1008 10:38:54.192703   27221 main.go:130] libmachine: Found binary path at /Users/hardikdadhich/.minikube/bin/docker-machine-driver-hyperkit
I1008 10:38:54.192773   27221 main.go:130] libmachine: Launching plugin server for driver hyperkit
I1008 10:38:54.208446   27221 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:51542
I1008 10:38:54.209227   27221 main.go:130] libmachine: () Calling .GetVersion
I1008 10:38:54.209835   27221 main.go:130] libmachine: Using API Version  1
I1008 10:38:54.209854   27221 main.go:130] libmachine: () Calling .SetConfigRaw
I1008 10:38:54.210221   27221 main.go:130] libmachine: () Calling .GetMachineName
I1008 10:38:54.210417   27221 main.go:130] libmachine: (minikube) Calling .DriverName
I1008 10:38:54.210607   27221 main.go:130] libmachine: (minikube) Calling .GetState
I1008 10:38:54.210808   27221 main.go:130] libmachine: (minikube) DBG | exe=/Users/hardikdadhich/.minikube/bin/docker-machine-driver-hyperkit uid=0
I1008 10:38:54.211421   27221 main.go:130] libmachine: (minikube) DBG | hyperkit pid from json: 25872
I1008 10:38:54.216018   27221 fix.go:108] recreateIfNeeded on minikube: state=Running err=<nil>
W1008 10:38:54.216123   27221 fix.go:134] unexpected machine state, will restart: <nil>
I1008 10:38:54.222750   27221 out.go:165] πŸƒ  Updating the running hyperkit "minikube" VM ...
πŸƒ  Updating the running hyperkit "minikube" VM ...
I1008 10:38:54.222843   27221 main.go:130] libmachine: (minikube) Calling .DriverName
I1008 10:38:54.223268   27221 machine.go:88] provisioning docker machine ...
I1008 10:38:54.223283   27221 main.go:130] libmachine: (minikube) Calling .DriverName
I1008 10:38:54.223503   27221 main.go:130] libmachine: (minikube) Calling .GetMachineName
I1008 10:38:54.223658   27221 buildroot.go:166] provisioning hostname "minikube"
I1008 10:38:54.223673   27221 main.go:130] libmachine: (minikube) Calling .GetMachineName
I1008 10:38:54.223812   27221 main.go:130] libmachine: (minikube) Calling .GetSSHHostname
I1008 10:38:54.223949   27221 main.go:130] libmachine: (minikube) Calling .GetSSHPort
I1008 10:38:54.224089   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:54.224240   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:54.224387   27221 main.go:130] libmachine: (minikube) Calling .GetSSHUsername
I1008 10:38:54.227044   27221 main.go:130] libmachine: Using SSH client type: native
I1008 10:38:54.231100   27221 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f9760] 0x13f9720 <nil>  [] 0s} 192.168.64.2 22 <nil> <nil>}
I1008 10:38:54.231123   27221 main.go:130] libmachine: About to run SSH command:
sudo hostname minikube && echo "minikube" | sudo tee /etc/hostname
I1008 10:38:54.339631   27221 main.go:130] libmachine: SSH cmd err, output: <nil>: minikube

I1008 10:38:54.339694   27221 main.go:130] libmachine: (minikube) Calling .GetSSHHostname
I1008 10:38:54.339950   27221 main.go:130] libmachine: (minikube) Calling .GetSSHPort
I1008 10:38:54.340149   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:54.340359   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:54.340523   27221 main.go:130] libmachine: (minikube) Calling .GetSSHUsername
I1008 10:38:54.340993   27221 main.go:130] libmachine: Using SSH client type: native
I1008 10:38:54.342467   27221 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f9760] 0x13f9720 <nil>  [] 0s} 192.168.64.2 22 <nil> <nil>}
I1008 10:38:54.342521   27221 main.go:130] libmachine: About to run SSH command:

        if ! grep -xq '.*\sminikube' /etc/hosts; then
            if grep -xq '127.0.1.1\s.*' /etc/hosts; then
                sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 minikube/g' /etc/hosts;
            else 
                echo '127.0.1.1 minikube' | sudo tee -a /etc/hosts; 
            fi
        fi
I1008 10:38:54.419690   27221 main.go:130] libmachine: SSH cmd err, output: <nil>: 
I1008 10:38:54.419784   27221 buildroot.go:172] set auth options {CertDir:/Users/hardikdadhich/.minikube CaCertPath:/Users/hardikdadhich/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/hardikdadhich/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/hardikdadhich/.minikube/machines/server.pem ServerKeyPath:/Users/hardikdadhich/.minikube/machines/server-key.pem ClientKeyPath:/Users/hardikdadhich/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/hardikdadhich/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/hardikdadhich/.minikube}
I1008 10:38:54.419863   27221 buildroot.go:174] setting up certificates
I1008 10:38:54.419922   27221 provision.go:83] configureAuth start
I1008 10:38:54.419949   27221 main.go:130] libmachine: (minikube) Calling .GetMachineName
I1008 10:38:54.420248   27221 main.go:130] libmachine: (minikube) Calling .GetIP
I1008 10:38:54.420413   27221 main.go:130] libmachine: (minikube) Calling .GetSSHHostname
I1008 10:38:54.420576   27221 provision.go:137] copyHostCerts
I1008 10:38:54.420976   27221 vm_assets.go:99] NewFileAsset: /Users/hardikdadhich/.minikube/certs/ca.pem -> /Users/hardikdadhich/.minikube/ca.pem
I1008 10:38:54.421468   27221 exec_runner.go:145] found /Users/hardikdadhich/.minikube/ca.pem, removing ...
I1008 10:38:54.421805   27221 exec_runner.go:190] rm: /Users/hardikdadhich/.minikube/ca.pem
I1008 10:38:54.422538   27221 exec_runner.go:152] cp: /Users/hardikdadhich/.minikube/certs/ca.pem --> /Users/hardikdadhich/.minikube/ca.pem (1054 bytes)
I1008 10:38:54.423055   27221 vm_assets.go:99] NewFileAsset: /Users/hardikdadhich/.minikube/certs/cert.pem -> /Users/hardikdadhich/.minikube/cert.pem
I1008 10:38:54.423157   27221 exec_runner.go:145] found /Users/hardikdadhich/.minikube/cert.pem, removing ...
I1008 10:38:54.423166   27221 exec_runner.go:190] rm: /Users/hardikdadhich/.minikube/cert.pem
I1008 10:38:54.423703   27221 exec_runner.go:152] cp: /Users/hardikdadhich/.minikube/certs/cert.pem --> /Users/hardikdadhich/.minikube/cert.pem (1094 bytes)
I1008 10:38:54.424180   27221 vm_assets.go:99] NewFileAsset: /Users/hardikdadhich/.minikube/certs/key.pem -> /Users/hardikdadhich/.minikube/key.pem
I1008 10:38:54.424289   27221 exec_runner.go:145] found /Users/hardikdadhich/.minikube/key.pem, removing ...
I1008 10:38:54.424301   27221 exec_runner.go:190] rm: /Users/hardikdadhich/.minikube/key.pem
I1008 10:38:54.424896   27221 exec_runner.go:152] cp: /Users/hardikdadhich/.minikube/certs/key.pem --> /Users/hardikdadhich/.minikube/key.pem (1675 bytes)
I1008 10:38:54.425399   27221 provision.go:111] generating server cert: /Users/hardikdadhich/.minikube/machines/server.pem ca-key=/Users/hardikdadhich/.minikube/certs/ca.pem private-key=/Users/hardikdadhich/.minikube/certs/ca-key.pem org=hardikdadhich.minikube san=[192.168.64.2 192.168.64.2 localhost 127.0.0.1 minikube minikube]
I1008 10:38:54.994156   27221 provision.go:171] copyRemoteCerts
I1008 10:38:54.994476   27221 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I1008 10:38:54.994912   27221 main.go:130] libmachine: (minikube) Calling .GetSSHHostname
I1008 10:38:54.995145   27221 main.go:130] libmachine: (minikube) Calling .GetSSHPort
I1008 10:38:54.995298   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:54.995456   27221 main.go:130] libmachine: (minikube) Calling .GetSSHUsername
I1008 10:38:54.995601   27221 sshutil.go:53] new ssh client: &{IP:192.168.64.2 Port:22 SSHKeyPath:/Users/hardikdadhich/.minikube/machines/minikube/id_rsa Username:docker}
I1008 10:38:55.036754   27221 vm_assets.go:99] NewFileAsset: /Users/hardikdadhich/.minikube/certs/ca.pem -> /etc/docker/ca.pem
I1008 10:38:55.036973   27221 ssh_runner.go:316] scp /Users/hardikdadhich/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1054 bytes)
I1008 10:38:55.051067   27221 vm_assets.go:99] NewFileAsset: /Users/hardikdadhich/.minikube/machines/server.pem -> /etc/docker/server.pem
I1008 10:38:55.051266   27221 ssh_runner.go:316] scp /Users/hardikdadhich/.minikube/machines/server.pem --> /etc/docker/server.pem (1172 bytes)
I1008 10:38:55.064895   27221 vm_assets.go:99] NewFileAsset: /Users/hardikdadhich/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
I1008 10:38:55.065130   27221 ssh_runner.go:316] scp /Users/hardikdadhich/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I1008 10:38:55.079629   27221 provision.go:86] duration metric: configureAuth took 659.678073ms
I1008 10:38:55.079662   27221 buildroot.go:189] setting minikube options for container-runtime
I1008 10:38:55.079933   27221 main.go:130] libmachine: (minikube) Calling .DriverName
I1008 10:38:55.080284   27221 main.go:130] libmachine: (minikube) Calling .GetSSHHostname
I1008 10:38:55.080439   27221 main.go:130] libmachine: (minikube) Calling .GetSSHPort
I1008 10:38:55.080589   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:55.080770   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:55.080907   27221 main.go:130] libmachine: (minikube) Calling .GetSSHUsername
I1008 10:38:55.081199   27221 main.go:130] libmachine: Using SSH client type: native
I1008 10:38:55.081414   27221 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f9760] 0x13f9720 <nil>  [] 0s} 192.168.64.2 22 <nil> <nil>}
I1008 10:38:55.081430   27221 main.go:130] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I1008 10:38:55.180135   27221 main.go:130] libmachine: SSH cmd err, output: <nil>: tmpfs

I1008 10:38:55.180187   27221 buildroot.go:70] root file system type: tmpfs
I1008 10:38:55.180502   27221 provision.go:308] Updating docker unit: /lib/systemd/system/docker.service ...
I1008 10:38:55.180545   27221 main.go:130] libmachine: (minikube) Calling .GetSSHHostname
I1008 10:38:55.180765   27221 main.go:130] libmachine: (minikube) Calling .GetSSHPort
I1008 10:38:55.180921   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:55.181095   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:55.181249   27221 main.go:130] libmachine: (minikube) Calling .GetSSHUsername
I1008 10:38:55.181547   27221 main.go:130] libmachine: Using SSH client type: native
I1008 10:38:55.181793   27221 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f9760] 0x13f9720 <nil>  [] 0s} 192.168.64.2 22 <nil> <nil>}
I1008 10:38:55.181900   27221 main.go:130] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target  minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket 
StartLimitBurst=3
StartLimitIntervalSec=60

[Service]
Type=notify
Restart=on-failure

# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 
ExecReload=/bin/kill -s HUP \$MAINPID

# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity

# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0

# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes

# kill only the docker process, not all processes in the cgroup
KillMode=process

[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I1008 10:38:55.273158   27221 main.go:130] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
After=network.target  minikube-automount.service docker.socket
Requires= minikube-automount.service docker.socket 
StartLimitBurst=3
StartLimitIntervalSec=60

[Service]
Type=notify
Restart=on-failure

# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=hyperkit --insecure-registry 10.96.0.0/12 
ExecReload=/bin/kill -s HUP $MAINPID

# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity

# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0

# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes

# kill only the docker process, not all processes in the cgroup
KillMode=process

[Install]
WantedBy=multi-user.target

I1008 10:38:55.273279   27221 main.go:130] libmachine: (minikube) Calling .GetSSHHostname
I1008 10:38:55.273552   27221 main.go:130] libmachine: (minikube) Calling .GetSSHPort
I1008 10:38:55.273710   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:55.273845   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:55.273998   27221 main.go:130] libmachine: (minikube) Calling .GetSSHUsername
I1008 10:38:55.274313   27221 main.go:130] libmachine: Using SSH client type: native
I1008 10:38:55.274574   27221 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f9760] 0x13f9720 <nil>  [] 0s} 192.168.64.2 22 <nil> <nil>}
I1008 10:38:55.274603   27221 main.go:130] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I1008 10:38:55.352723   27221 main.go:130] libmachine: SSH cmd err, output: <nil>: 
I1008 10:38:55.352772   27221 machine.go:91] provisioned docker machine in 1.129479352s
I1008 10:38:55.352818   27221 start.go:267] post-start starting for "minikube" (driver="hyperkit")
I1008 10:38:55.352832   27221 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I1008 10:38:55.352852   27221 main.go:130] libmachine: (minikube) Calling .DriverName
I1008 10:38:55.353412   27221 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I1008 10:38:55.353439   27221 main.go:130] libmachine: (minikube) Calling .GetSSHHostname
I1008 10:38:55.353629   27221 main.go:130] libmachine: (minikube) Calling .GetSSHPort
I1008 10:38:55.353766   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:55.353912   27221 main.go:130] libmachine: (minikube) Calling .GetSSHUsername
I1008 10:38:55.354071   27221 sshutil.go:53] new ssh client: &{IP:192.168.64.2 Port:22 SSHKeyPath:/Users/hardikdadhich/.minikube/machines/minikube/id_rsa Username:docker}
I1008 10:38:55.399600   27221 ssh_runner.go:149] Run: cat /etc/os-release
I1008 10:38:55.408761   27221 info.go:137] Remote host: Buildroot 2020.02.12
I1008 10:38:55.408789   27221 filesync.go:126] Scanning /Users/hardikdadhich/.minikube/addons for local assets ...
I1008 10:38:55.409011   27221 filesync.go:126] Scanning /Users/hardikdadhich/.minikube/files for local assets ...
I1008 10:38:55.409212   27221 start.go:270] post-start completed in 56.38198ms
I1008 10:38:55.409239   27221 main.go:130] libmachine: (minikube) Calling .DriverName
I1008 10:38:55.409487   27221 main.go:130] libmachine: (minikube) Calling .GetSSHHostname
I1008 10:38:55.409660   27221 main.go:130] libmachine: (minikube) Calling .GetSSHPort
I1008 10:38:55.409859   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:55.410057   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:55.410209   27221 main.go:130] libmachine: (minikube) Calling .GetSSHUsername
I1008 10:38:55.410453   27221 main.go:130] libmachine: Using SSH client type: native
I1008 10:38:55.410703   27221 main.go:130] libmachine: &{{{<nil> 0 [] [] []} docker [0x13f9760] 0x13f9720 <nil>  [] 0s} 192.168.64.2 22 <nil> <nil>}
I1008 10:38:55.410716   27221 main.go:130] libmachine: About to run SSH command:
date +%s.%N
I1008 10:38:55.488893   27221 main.go:130] libmachine: SSH cmd err, output: <nil>: 1633669736.139495439

I1008 10:38:55.488917   27221 fix.go:212] guest clock: 1633669736.139495439
I1008 10:38:55.488925   27221 fix.go:225] Guest: 2021-10-08 10:38:56.139495439 +0530 IST Remote: 2021-10-08 10:38:55.409468 +0530 IST m=+1.646089361 (delta=730.027439ms)
I1008 10:38:55.488943   27221 fix.go:196] guest clock delta is within tolerance: 730.027439ms
I1008 10:38:55.488957   27221 fix.go:57] fixHost completed within 1.296697257s
I1008 10:38:55.488962   27221 start.go:80] releasing machines lock for "minikube", held for 1.297099217s
I1008 10:38:55.489025   27221 main.go:130] libmachine: (minikube) Calling .DriverName
I1008 10:38:55.489234   27221 main.go:130] libmachine: (minikube) Calling .GetIP
I1008 10:38:55.489385   27221 main.go:130] libmachine: (minikube) Calling .DriverName
I1008 10:38:55.489527   27221 main.go:130] libmachine: (minikube) Calling .DriverName
I1008 10:38:55.491284   27221 main.go:130] libmachine: (minikube) Calling .DriverName
I1008 10:38:55.492114   27221 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/
I1008 10:38:55.492148   27221 ssh_runner.go:149] Run: systemctl --version
I1008 10:38:55.492165   27221 main.go:130] libmachine: (minikube) Calling .GetSSHHostname
I1008 10:38:55.492354   27221 main.go:130] libmachine: (minikube) Calling .GetSSHPort
I1008 10:38:55.492474   27221 main.go:130] libmachine: (minikube) Calling .GetSSHHostname
I1008 10:38:55.492542   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:55.492616   27221 main.go:130] libmachine: (minikube) Calling .GetSSHPort
I1008 10:38:55.492693   27221 main.go:130] libmachine: (minikube) Calling .GetSSHUsername
I1008 10:38:55.492736   27221 main.go:130] libmachine: (minikube) Calling .GetSSHKeyPath
I1008 10:38:55.492932   27221 sshutil.go:53] new ssh client: &{IP:192.168.64.2 Port:22 SSHKeyPath:/Users/hardikdadhich/.minikube/machines/minikube/id_rsa Username:docker}
I1008 10:38:55.492962   27221 main.go:130] libmachine: (minikube) Calling .GetSSHUsername
I1008 10:38:55.493096   27221 sshutil.go:53] new ssh client: &{IP:192.168.64.2 Port:22 SSHKeyPath:/Users/hardikdadhich/.minikube/machines/minikube/id_rsa Username:docker}
I1008 10:38:55.536072   27221 preload.go:134] Checking if preload exists for k8s version v1.21.2 and runtime docker
I1008 10:38:55.536344   27221 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}}
I1008 10:39:05.543093   27221 ssh_runner.go:189] Completed: curl -sS -m 2 https://k8s.gcr.io/: (10.050937281s)
I1008 10:39:05.543242   27221 ssh_runner.go:189] Completed: docker images --format {{.Repository}}:{{.Tag}}: (10.006871015s)
W1008 10:39:05.543284   27221 start.go:655] [curl -sS -m 2 https://k8s.gcr.io/] failed: curl -sS -m 2 https://k8s.gcr.io/: Process exited with status 28
stdout:

stderr:
curl: (28) Resolving timed out after 2000 milliseconds
I1008 10:39:05.543313   27221 docker.go:535] Got preloaded images: -- stdout --
k8s.gcr.io/kube-apiserver:v1.21.2
k8s.gcr.io/kube-controller-manager:v1.21.2
k8s.gcr.io/kube-scheduler:v1.21.2
k8s.gcr.io/kube-proxy:v1.21.2
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/pause:3.4.1
kubernetesui/dashboard:v2.1.0
k8s.gcr.io/coredns/coredns:v1.8.0
k8s.gcr.io/etcd:3.4.13-0
kubernetesui/metrics-scraper:v1.0.4

-- /stdout --
W1008 10:39:05.543553   27221 out.go:230] ❗  This VM is having trouble accessing https://k8s.gcr.io
❗  This VM is having trouble accessing https://k8s.gcr.io
W1008 10:39:05.543596   27221 out.go:230] πŸ’‘  To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/
πŸ’‘  To pull new external images, you may need to configure a proxy: https://minikube.sigs.k8s.io/docs/reference/networking/proxy/
I1008 10:39:05.543864   27221 docker.go:466] Images already preloaded, skipping extraction
I1008 10:39:05.544305   27221 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd
I1008 10:39:05.560464   27221 ssh_runner.go:149] Run: sudo systemctl cat docker.service
I1008 10:39:05.572570   27221 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd
I1008 10:39:05.587082   27221 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio
I1008 10:39:05.599224   27221 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock
image-endpoint: unix:///var/run/dockershim.sock
" | sudo tee /etc/crictl.yaml"
I1008 10:39:05.754553   27221 ssh_runner.go:149] Run: sudo systemctl unmask docker.service
I1008 10:39:06.017695   27221 ssh_runner.go:149] Run: sudo systemctl enable docker.socket
I1008 10:39:06.241845   27221 ssh_runner.go:149] Run: sudo systemctl daemon-reload
I1008 10:39:06.462679   27221 ssh_runner.go:149] Run: sudo systemctl start docker
I1008 10:39:06.472949   27221 ssh_runner.go:149] Run: docker version --format {{.Server.Version}}
I1008 10:39:06.516736   27221 ssh_runner.go:149] Run: docker version --format {{.Server.Version}}
I1008 10:39:06.579655   27221 out.go:192] 🐳  Preparing Kubernetes v1.21.2 on Docker 20.10.6 ...
🐳  Preparing Kubernetes v1.21.2 on Docker 20.10.6 ...| I1008 10:39:06.580111   27221 ssh_runner.go:149] Run: grep 192.168.64.1  host.minikube.internal$ /etc/hosts
I1008 10:39:06.587760   27221 preload.go:134] Checking if preload exists for k8s version v1.21.2 and runtime docker
I1008 10:39:06.587948   27221 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}}
I1008 10:39:06.628639   27221 docker.go:535] Got preloaded images: -- stdout --
k8s.gcr.io/kube-apiserver:v1.21.2
k8s.gcr.io/kube-controller-manager:v1.21.2
k8s.gcr.io/kube-proxy:v1.21.2
k8s.gcr.io/kube-scheduler:v1.21.2
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/pause:3.4.1
kubernetesui/dashboard:v2.1.0
k8s.gcr.io/coredns/coredns:v1.8.0
k8s.gcr.io/etcd:3.4.13-0
kubernetesui/metrics-scraper:v1.0.4

-- /stdout --
I1008 10:39:06.628668   27221 docker.go:466] Images already preloaded, skipping extraction
I1008 10:39:06.628878   27221 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}}
/ I1008 10:39:06.686662   27221 docker.go:535] Got preloaded images: -- stdout --
k8s.gcr.io/kube-apiserver:v1.21.2
k8s.gcr.io/kube-controller-manager:v1.21.2
k8s.gcr.io/kube-scheduler:v1.21.2
k8s.gcr.io/kube-proxy:v1.21.2
gcr.io/k8s-minikube/storage-provisioner:v5
k8s.gcr.io/pause:3.4.1
kubernetesui/dashboard:v2.1.0
k8s.gcr.io/coredns/coredns:v1.8.0
k8s.gcr.io/etcd:3.4.13-0
kubernetesui/metrics-scraper:v1.0.4

-- /stdout --
I1008 10:39:06.686707   27221 cache_images.go:74] Images are preloaded, skipping loading
I1008 10:39:06.687012   27221 ssh_runner.go:149] Run: docker info --format {{.CgroupDriver}}
I1008 10:39:06.737355   27221 cni.go:93] Creating CNI manager for ""
I1008 10:39:06.737379   27221 cni.go:167] CNI unnecessary in this configuration, recommending no CNI
I1008 10:39:06.737396   27221 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
I1008 10:39:06.737411   27221 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.64.2 APIServerPort:8443 KubernetesVersion:v1.21.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:minikube NodeName:minikube DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.64.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.64.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}
I1008 10:39:06.737566   27221 kubeadm.go:157] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta2
kind: InitConfiguration
localAPIEndpoint:
  advertiseAddress: 192.168.64.2
  bindPort: 8443
bootstrapTokens:
  - groups:
      - system:bootstrappers:kubeadm:default-node-token
    ttl: 24h0m0s
    usages:
      - signing
      - authentication
nodeRegistration:
  criSocket: /var/run/dockershim.sock
  name: "minikube"
  kubeletExtraArgs:
    node-ip: 192.168.64.2
  taints: []
---
apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
apiServer:
  certSANs: ["127.0.0.1", "localhost", "192.168.64.2"]
  extraArgs:
    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
  extraArgs:
    allocate-node-cidrs: "true"
    leader-elect: "false"
scheduler:
  extraArgs:
    leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
dns:
  type: CoreDNS
etcd:
  local:
    dataDir: /var/lib/minikube/etcd
    extraArgs:
      proxy-refresh-interval: "70000"
kubernetesVersion: v1.21.2
networking:
  dnsDomain: cluster.local
  podSubnet: "10.244.0.0/16"
  serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
  x509:
    clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: systemd
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
  nodefs.available: "0%"
  nodefs.inodesFree: "0%"
  imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
  maxPerCore: 0

I1008 10:39:06.737685   27221 kubeadm.go:909] kubelet [Unit]
Wants=docker.socket

[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.21.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=minikube --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.64.2

[Install]
 config:
{KubernetesVersion:v1.21.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
I1008 10:39:06.737850   27221 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.21.2
I1008 10:39:06.743257   27221 binaries.go:44] Found k8s binaries, skipping transfer
I1008 10:39:06.743445   27221 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I1008 10:39:06.752133   27221 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (334 bytes)
I1008 10:39:06.764669   27221 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I1008 10:39:06.774754   27221 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (1866 bytes)
- I1008 10:39:06.785896   27221 ssh_runner.go:149] Run: grep 192.168.64.2   control-plane.minikube.internal$ /etc/hosts
I1008 10:39:06.789680   27221 certs.go:52] Setting up /Users/hardikdadhich/.minikube/profiles/minikube for IP: 192.168.64.2
I1008 10:39:06.789980   27221 certs.go:179] skipping minikubeCA CA generation: /Users/hardikdadhich/.minikube/ca.key
I1008 10:39:06.790128   27221 certs.go:179] skipping proxyClientCA CA generation: /Users/hardikdadhich/.minikube/proxy-client-ca.key
I1008 10:39:06.790293   27221 certs.go:290] skipping minikube-user signed cert generation: /Users/hardikdadhich/.minikube/profiles/minikube/client.key
I1008 10:39:06.790401   27221 certs.go:290] skipping minikube signed cert generation: /Users/hardikdadhich/.minikube/profiles/minikube/apiserver.key.a30f3483
I1008 10:39:06.790591   27221 certs.go:290] skipping aggregator signed cert generation: /Users/hardikdadhich/.minikube/profiles/minikube/proxy-client.key
I1008 10:39:06.790612   27221 vm_assets.go:99] NewFileAsset: /Users/hardikdadhich/.minikube/profiles/minikube/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
I1008 10:39:06.790701   27221 vm_assets.go:99] NewFileAsset: /Users/hardikdadhich/.minikube/profiles/minikube/apiserver.key -> /var/lib/minikube/certs/apiserver.key
I1008 10:39:06.790825   27221 vm_assets.go:99] NewFileAsset: /Users/hardikdadhich/.minikube/profiles/minikube/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
I1008 10:39:06.790919   27221 vm_assets.go:99] NewFileAsset: /Users/hardikdadhich/.minikube/profiles/minikube/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
I1008 10:39:06.790994   27221 vm_assets.go:99] NewFileAsset: /Users/hardikdadhich/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
I1008 10:39:06.791060   27221 vm_assets.go:99] NewFileAsset: /Users/hardikdadhich/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
I1008 10:39:06.791115   27221 vm_assets.go:99] NewFileAsset: /Users/hardikdadhich/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
I1008 10:39:06.791166   27221 vm_assets.go:99] NewFileAsset: /Users/hardikdadhich/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
I1008 10:39:06.791390   27221 certs.go:369] found cert: /Users/hardikdadhich/.minikube/certs/Users/hardikdadhich/.minikube/certs/ca-key.pem (1675 bytes)
I1008 10:39:06.791504   27221 certs.go:369] found cert: /Users/hardikdadhich/.minikube/certs/Users/hardikdadhich/.minikube/certs/ca.pem (1054 bytes)
I1008 10:39:06.791610   27221 certs.go:369] found cert: /Users/hardikdadhich/.minikube/certs/Users/hardikdadhich/.minikube/certs/cert.pem (1094 bytes)
I1008 10:39:06.791720   27221 certs.go:369] found cert: /Users/hardikdadhich/.minikube/certs/Users/hardikdadhich/.minikube/certs/key.pem (1675 bytes)
I1008 10:39:06.791818   27221 vm_assets.go:99] NewFileAsset: /Users/hardikdadhich/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
I1008 10:39:06.796179   27221 ssh_runner.go:316] scp /Users/hardikdadhich/.minikube/profiles/minikube/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1350 bytes)
I1008 10:39:06.815369   27221 ssh_runner.go:316] scp /Users/hardikdadhich/.minikube/profiles/minikube/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I1008 10:39:06.832802   27221 ssh_runner.go:316] scp /Users/hardikdadhich/.minikube/profiles/minikube/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1103 bytes)
I1008 10:39:06.851624   27221 ssh_runner.go:316] scp /Users/hardikdadhich/.minikube/profiles/minikube/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I1008 10:39:06.869481   27221 ssh_runner.go:316] scp /Users/hardikdadhich/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1066 bytes)
\ I1008 10:39:06.890546   27221 ssh_runner.go:316] scp /Users/hardikdadhich/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I1008 10:39:06.911357   27221 ssh_runner.go:316] scp /Users/hardikdadhich/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1074 bytes)
I1008 10:39:06.930734   27221 ssh_runner.go:316] scp /Users/hardikdadhich/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I1008 10:39:06.949517   27221 ssh_runner.go:316] scp /Users/hardikdadhich/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1066 bytes)
I1008 10:39:06.968999   27221 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
| I1008 10:39:06.986443   27221 ssh_runner.go:149] Run: openssl version
I1008 10:39:06.992091   27221 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I1008 10:39:07.004716   27221 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I1008 10:39:07.009367   27221 certs.go:410] hashing: -rw-r--r-- 1 root root 1066 Jul 31  2019 /usr/share/ca-certificates/minikubeCA.pem
I1008 10:39:07.009631   27221 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I1008 10:39:07.018037   27221 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I1008 10:39:07.029570   27221 kubeadm.go:390] StartCluster: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.22.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.64.2 Port:8443 KubernetesVersion:v1.21.2 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false}
I1008 10:39:07.029953   27221 ssh_runner.go:149] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I1008 10:39:07.075507   27221 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
/ I1008 10:39:07.086722   27221 kubeadm.go:401] found existing configuration files, will attempt cluster restart
I1008 10:39:07.086767   27221 kubeadm.go:600] restartCluster start
I1008 10:39:07.087035   27221 ssh_runner.go:149] Run: sudo test -d /data/minikube
I1008 10:39:07.099523   27221 kubeadm.go:126] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
stdout:

stderr:
I1008 10:39:07.112080   27221 kubeconfig.go:93] found "minikube" server: "https://192.168.64.2:8443"
I1008 10:39:07.117601   27221 kapi.go:59] client config for minikube: &rest.Config{Host:"https://192.168.64.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/hardikdadhich/.minikube/profiles/minikube/client.crt", KeyFile:"/Users/hardikdadhich/.minikube/profiles/minikube/client.key", CAFile:"/Users/hardikdadhich/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x23d1580), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I1008 10:39:07.119830   27221 cert_rotation.go:137] Starting client certificate rotation controller
I1008 10:39:07.137003   27221 ssh_runner.go:149] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
I1008 10:39:07.147373   27221 api_server.go:164] Checking apiserver status ...
I1008 10:39:07.147789   27221 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1008 10:39:07.162314   27221 ssh_runner.go:149] Run: sudo egrep ^[0-9]+:freezer: /proc/12119/cgroup
I1008 10:39:07.171728   27221 api_server.go:180] apiserver freezer: "7:freezer:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c27ea17c348c604beab3b0d9a4b66e.slice/docker-71402066360c157515807e78ba91ae57faa91c9759e1c1412d5e5e5d293fefa2.scope"
I1008 10:39:07.172024   27221 ssh_runner.go:149] Run: sudo cat /sys/fs/cgroup/freezer/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c27ea17c348c604beab3b0d9a4b66e.slice/docker-71402066360c157515807e78ba91ae57faa91c9759e1c1412d5e5e5d293fefa2.scope/freezer.state
I1008 10:39:07.180713   27221 api_server.go:202] freezer state: "THAWED"
I1008 10:39:07.180777   27221 api_server.go:239] Checking apiserver healthz at https://192.168.64.2:8443/healthz ...
- I1008 10:39:07.194737   27221 api_server.go:265] https://192.168.64.2:8443/healthz returned 200:
ok
I1008 10:39:07.206875   27221 kubeadm.go:584] needs reconfigure: Unauthorized
I1008 10:39:07.206903   27221 kubeadm.go:1032] stopping kube-system containers ...
I1008 10:39:07.207060   27221 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I1008 10:39:07.252271   27221 docker.go:367] Stopping containers: [b75ba62ac5aa 7e045c56607b 3c818754ca44 10769d594eca 543759b025f0 dffbda2842a1 0f5cbb356fb1 4e50b2b8f2f8 68f4e1e5f2ec 5209a81ba909 e08494600e83 71402066360c 52c97662c40f 7e05acc75346 814ef43accc5 1fc1b27904e6]
I1008 10:39:07.252528   27221 ssh_runner.go:149] Run: docker stop b75ba62ac5aa 7e045c56607b 3c818754ca44 10769d594eca 543759b025f0 dffbda2842a1 0f5cbb356fb1 4e50b2b8f2f8 68f4e1e5f2ec 5209a81ba909 e08494600e83 71402066360c 52c97662c40f 7e05acc75346 814ef43accc5 1fc1b27904e6
- I1008 10:39:13.423773   27221 ssh_runner.go:189] Completed: docker stop b75ba62ac5aa 7e045c56607b 3c818754ca44 10769d594eca 543759b025f0 dffbda2842a1 0f5cbb356fb1 4e50b2b8f2f8 68f4e1e5f2ec 5209a81ba909 e08494600e83 71402066360c 52c97662c40f 7e05acc75346 814ef43accc5 1fc1b27904e6: (6.171196583s)
I1008 10:39:13.424075   27221 ssh_runner.go:149] Run: sudo systemctl stop kubelet
\ I1008 10:39:13.513331   27221 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1008 10:39:13.527741   27221 kubeadm.go:154] found existing configuration files:
-rw------- 1 root root 5523 Oct  8 04:55 /etc/kubernetes/admin.conf
-rw------- 1 root root 5536 Oct  8 04:55 /etc/kubernetes/controller-manager.conf
-rw------- 1 root root 1911 Oct  8 04:55 /etc/kubernetes/kubelet.conf
-rw------- 1 root root 5480 Oct  8 04:55 /etc/kubernetes/scheduler.conf

I1008 10:39:13.528307   27221 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I1008 10:39:13.559770   27221 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I1008 10:39:13.570839   27221 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I1008 10:39:13.578518   27221 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1
stdout:

stderr:
WWI1008 10:39:13.578857   27221 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
| I1008 10:39:13.588164   27221 ssh_runner.go:149] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I1008 10:39:13.599380   27221 kubeadm.go:165] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1
stdout:

stderr:
I1008 10:39:13.599618   27221 ssh_runner.go:149] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I1008 10:39:13.611510   27221 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1008 10:39:13.626319   27221 kubeadm.go:676] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
I1008 10:39:13.626364   27221 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
| I1008 10:39:13.983644   27221 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
- I1008 10:39:15.503490   27221 ssh_runner.go:189] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.519825444s)
I1008 10:39:15.503518   27221 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
- I1008 10:39:15.921554   27221 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
- I1008 10:39:16.312092   27221 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
/ I1008 10:39:16.578298   27221 api_server.go:50] waiting for apiserver process to appear ...
I1008 10:39:16.584228   27221 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I1008 10:39:16.593998   27221 api_server.go:70] duration metric: took 15.699132ms to wait for apiserver process to appear ...
I1008 10:39:16.594052   27221 api_server.go:86] waiting for apiserver healthz status ...
I1008 10:39:16.594073   27221 api_server.go:239] Checking apiserver healthz at https://192.168.64.2:8443/healthz ...
- I1008 10:39:17.467940   27221 api_server.go:265] https://192.168.64.2:8443/healthz returned 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
W1008 10:39:17.473544   27221 api_server.go:101] status: https://192.168.64.2:8443/healthz returned error 403:
{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}
- I1008 10:39:17.973850   27221 api_server.go:239] Checking apiserver healthz at https://192.168.64.2:8443/healthz ...
\ I1008 10:39:17.983717   27221 api_server.go:265] https://192.168.64.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W1008 10:39:17.983791   27221 api_server.go:101] status: https://192.168.64.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
\ I1008 10:39:18.475657   27221 api_server.go:239] Checking apiserver healthz at https://192.168.64.2:8443/healthz ...
I1008 10:39:18.483301   27221 api_server.go:265] https://192.168.64.2:8443/healthz returned 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
W1008 10:39:18.483372   27221 api_server.go:101] status: https://192.168.64.2:8443/healthz returned error 500:
[+]ping ok
[+]log ok
[+]etcd ok
[+]poststarthook/start-kube-apiserver-admission-initializer ok
[+]poststarthook/generic-apiserver-start-informers ok
[+]poststarthook/priority-and-fairness-config-consumer ok
[+]poststarthook/priority-and-fairness-filter ok
[+]poststarthook/start-apiextensions-informers ok
[+]poststarthook/start-apiextensions-controllers ok
[+]poststarthook/crd-informer-synced ok
[+]poststarthook/bootstrap-controller ok
[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
[+]poststarthook/priority-and-fairness-config-producer ok
[+]poststarthook/start-cluster-authentication-info-controller ok
[+]poststarthook/aggregator-reload-proxy-client-cert ok
[+]poststarthook/start-kube-aggregator-informers ok
[+]poststarthook/apiservice-registration-controller ok
[+]poststarthook/apiservice-status-available-controller ok
[+]poststarthook/kube-apiserver-autoregistration ok
[+]autoregister-completion ok
[+]poststarthook/apiservice-openapi-controller ok
healthz check failed
| I1008 10:39:18.978365   27221 api_server.go:239] Checking apiserver healthz at https://192.168.64.2:8443/healthz ...
I1008 10:39:18.993853   27221 api_server.go:265] https://192.168.64.2:8443/healthz returned 200:
ok
W1008 10:39:19.005969   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:19.511389   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:20.010521   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:20.507565   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:21.008148   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:21.508462   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:22.011374   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:22.512494   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:23.010494   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:23.511237   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:24.010317   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:24.509670   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:25.007727   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:25.512632   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:26.011491   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:26.508369   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:27.010076   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:27.507982   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:28.008799   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:28.510982   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:29.013444   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:29.512123   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:30.009856   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:30.513600   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:31.008742   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:31.511092   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:32.007718   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:32.512675   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:33.009116   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:33.511410   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:34.007895   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:34.508714   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:35.011182   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:35.509684   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:36.008646   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:36.508745   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:37.009490   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:37.509366   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:38.008293   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:38.514672   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:39.010174   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:39.510497   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:40.012152   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:40.508987   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:41.012086   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:41.517191   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:42.011002   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:42.511498   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:43.007371   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:43.512387   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:44.012872   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:44.512567   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:45.012889   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:45.512395   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:46.010495   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:46.513589   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:47.013854   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:47.513786   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:48.012263   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:48.510235   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:49.011476   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:49.509519   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:50.013100   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:50.513177   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:51.010438   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:51.511028   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:52.007920   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:52.512277   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:53.011354   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:53.511630   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:54.014030   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:54.512601   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:55.009911   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:55.514122   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:56.012104   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:56.510892   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:57.010539   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:39:57.510485   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:58.012276   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:39:58.512824   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:39:59.011221   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:39:59.510286   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:00.012076   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:00.508919   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:01.010516   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:01.512213   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:02.012565   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:02.513561   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:03.012793   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:03.508440   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:04.009129   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:04.509529   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:05.011293   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:05.510501   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:06.012238   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:06.507878   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:07.010881   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:07.509942   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:08.011008   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:08.509483   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:09.009902   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:09.510724   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:10.013008   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:10.513465   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:11.011846   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:11.510560   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:12.010105   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:12.509855   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:13.013268   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:13.514268   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:14.011653   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:14.510225   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:15.011273   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:15.511167   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:16.012453   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:16.510446   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:17.012104   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:17.512012   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:18.010966   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:18.512076   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:19.010529   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:19.509991   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:20.009949   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:20.513665   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:21.014170   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:21.512313   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:22.011364   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:22.509444   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:23.011700   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:23.507687   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:24.010169   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:24.510250   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:25.012209   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:25.510770   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:26.009247   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:26.510134   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:27.008949   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:27.509729   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:28.009584   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:28.509363   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:29.011034   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:29.509110   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:30.010201   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:30.513953   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:31.012805   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:31.512106   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:32.009206   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:32.511466   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:33.010565   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:33.510635   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:34.012227   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:34.510155   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:35.009938   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:35.509638   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:36.008877   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:36.511159   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:37.009963   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:37.510627   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:38.011730   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:38.508074   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:39.009858   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:39.510847   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:40.010900   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:40.511707   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:41.011990   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:41.509594   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:42.010248   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:42.511776   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:43.010827   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:43.509015   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:44.007959   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:44.509700   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:45.010240   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:45.510111   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:46.010039   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:46.512563   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:47.011380   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:47.510514   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:48.010490   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:48.509700   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:49.009778   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:49.509503   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:50.009873   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:50.511461   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:51.011702   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:51.510042   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:52.012045   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:52.509088   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:53.014101   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:53.512389   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:54.007518   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:54.511785   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:55.012136   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:55.510971   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:56.009678   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:56.509730   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:57.011654   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:40:57.516150   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:58.011990   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:40:58.508931   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:40:59.012746   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:40:59.509787   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:00.011942   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:00.508876   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:01.009764   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:01.509577   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:02.010157   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:02.508251   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:03.011617   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:03.511129   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:04.011183   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:04.509423   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:05.012306   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:05.512496   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:06.011775   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:06.508557   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:07.010891   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:07.509690   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:08.009806   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:08.509452   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:09.010586   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:09.508519   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:10.011090   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:10.508675   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:11.012175   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:11.511894   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:12.012189   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:12.507885   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:13.011409   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:13.507886   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:14.011090   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:14.511656   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:15.012818   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:15.508465   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:16.008255   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:16.508724   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:17.011983   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:17.508076   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:18.009090   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:18.509907   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:19.010146   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:19.509088   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:20.010613   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:20.513372   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:21.009193   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:21.511024   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:22.011326   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:22.512329   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:23.015457   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:23.513082   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:24.008290   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:24.515626   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:25.007107   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:25.508932   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:26.015676   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:26.508564   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:27.009355   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:27.512349   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:28.009859   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:28.512101   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:29.012923   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:29.507320   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:30.011737   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:30.511051   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:31.009954   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:31.514221   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:32.010681   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:32.511286   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:33.010528   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:33.511503   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:34.008627   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:34.512306   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:35.007115   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:35.507797   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:36.011975   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:36.510217   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:37.018667   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:37.511285   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:38.011383   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:38.512780   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:39.008909   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:39.511067   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:40.010086   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:40.511679   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:41.011837   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:41.507915   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:42.008038   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:42.508524   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:43.008249   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:43.513018   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:44.011060   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:44.507792   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:45.008939   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:45.513488   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:46.008696   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:46.512637   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:47.013222   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:47.508699   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:48.009193   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:48.509495   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:49.010605   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:49.507476   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:50.007914   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:50.508278   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:51.013104   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:51.511658   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:52.012816   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:52.511482   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:53.010310   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:53.509612   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:54.016565   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:54.511644   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:55.012172   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:55.509123   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:56.010787   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:56.507803   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:57.007962   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:57.509928   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:41:58.010911   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:41:58.512065   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:41:59.008391   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:41:59.510599   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:00.008907   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:00.507762   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:01.012939   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:01.507372   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:02.011460   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:02.508052   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:03.008777   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:03.507193   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:04.011018   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:04.510458   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:05.009976   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:05.509286   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:06.012086   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:06.511901   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:07.008630   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:07.510184   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:08.009191   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:08.508628   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:09.011043   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:09.507679   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:10.012495   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:10.508534   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:11.014955   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:11.510911   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:12.011669   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:12.511360   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:13.009446   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:13.512127   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:14.013031   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:14.511140   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:15.010021   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:15.508256   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:16.010670   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:16.511035   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:17.009143   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:17.510099   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:18.012569   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:18.512581   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:19.015896   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:19.516122   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:20.011382   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:20.510891   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:21.010989   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:21.511192   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:22.011766   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:22.509465   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:23.008849   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:23.510019   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:24.012595   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:24.510242   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:25.009153   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:25.510959   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:26.007693   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:26.512529   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:27.011601   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:27.508614   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:28.008863   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:28.512232   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:29.009418   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:29.509340   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:30.010035   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:30.517501   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:31.008647   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:31.507248   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:32.009075   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:32.512851   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:33.011640   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:33.510957   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:34.018051   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:34.508817   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:35.007529   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:35.511634   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:36.012175   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:36.510732   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:37.007939   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:37.511372   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:38.011159   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:38.507700   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:39.012439   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:39.511534   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:40.007550   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:40.507679   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:41.012312   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:41.510130   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:42.012462   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:42.513299   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:43.012618   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:43.512135   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:44.013904   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:44.508826   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:45.013625   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:45.512748   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:46.013063   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:46.513014   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:47.012543   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:47.507310   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:48.013352   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:48.512479   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:49.014792   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:49.514001   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:50.010889   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:50.509450   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:51.010403   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:51.512801   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:52.013262   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:52.516689   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:53.013531   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:53.508991   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:54.008727   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:54.513088   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:55.011419   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:55.512463   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:56.013109   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:56.507566   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:57.012880   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:57.512388   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:42:58.013223   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:42:58.512888   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:42:59.012541   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:42:59.517605   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:43:00.007547   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:43:00.512663   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:43:01.011966   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:43:01.512615   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:43:02.012166   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:43:02.507912   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:43:03.008148   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:43:03.508034   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:43:04.012737   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:43:04.511646   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:43:05.013278   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:43:05.512166   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:43:06.013708   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:43:06.513279   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:43:07.013546   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:43:07.507962   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:43:08.007927   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:43:08.513138   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:43:09.013229   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:43:09.507889   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:43:10.007491   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:43:10.512829   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:43:11.013047   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:43:11.518005   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:43:12.007999   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:43:12.510266   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:43:13.007748   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:43:13.510447   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:43:14.013035   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:43:14.511470   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
- W1008 10:43:15.012441   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
\ W1008 10:43:15.512483   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
| W1008 10:43:16.008107   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ W1008 10:43:16.508074   27221 api_server.go:119] api server version match failed: server version: the server has asked for the client to provide credentials
/ I1008 10:43:17.012590   27221 kubeadm.go:604] restartCluster took 4m9.925743134s
W1008 10:43:17.013621   27221 out.go:230] 🀦  Unable to restart cluster, will reset it: apiserver health: controlPlane never updated to v1.21.2

🀦  Unable to restart cluster, will reset it: apiserver health: controlPlane never updated to v1.21.2
I1008 10:43:17.013684   27221 ssh_runner.go:149] Run: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm reset --cri-socket /var/run/dockershim.sock --force"
I1008 10:43:41.396747   27221 ssh_runner.go:189] Completed: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm reset --cri-socket /var/run/dockershim.sock --force": (24.383037964s)
I1008 10:43:41.397168   27221 ssh_runner.go:149] Run: sudo systemctl stop -f kubelet
I1008 10:43:41.407260   27221 ssh_runner.go:149] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I1008 10:43:41.432465   27221 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I1008 10:43:41.439702   27221 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I1008 10:43:41.446131   27221 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:

stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I1008 10:43:41.446169   27221 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem"
I1008 10:43:41.995057   27221 out.go:192]     β–ͺ Generating certificates and keys ...
    β–ͺ Generating certificates and keys ...| I1008 10:43:42.829069   27221 out.go:192]     β–ͺ Booting up control plane ...

    β–ͺ Booting up control plane ...| I1008 10:43:59.406952   27221 out.go:192]     β–ͺ Configuring RBAC rules ...

    β–ͺ Configuring RBAC rules ...| I1008 10:43:59.847809   27221 cni.go:93] Creating CNI manager for ""
I1008 10:43:59.847834   27221 cni.go:167] CNI unnecessary in this configuration, recommending no CNI
I1008 10:43:59.847857   27221 ssh_runner.go:149] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I1008 10:43:59.848638   27221 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I1008 10:43:59.848639   27221 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.2/kubectl label nodes minikube.k8s.io/version=v1.22.0 minikube.k8s.io/commit=a03fbcf166e6f74ef224d4a63be4277d017bb62e minikube.k8s.io/name=minikube minikube.k8s.io/updated_at=2021_10_08T10_43_59_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
/ I1008 10:43:59.866876   27221 ops.go:34] apiserver oom_adj: -16
\ I1008 10:44:00.103294   27221 kubeadm.go:985] duration metric: took 254.882601ms to wait for elevateKubeSystemPrivileges.
I1008 10:44:00.103523   27221 kubeadm.go:392] StartCluster complete in 4m53.073885597s
I1008 10:44:00.103549   27221 settings.go:142] acquiring lock: {Name:mk3e93d71a1300d616ebae997060bc6e0d0d3fe4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1008 10:44:00.103727   27221 settings.go:150] Updating kubeconfig:  /Users/hardikdadhich/.kube/config
I1008 10:44:00.114298   27221 lock.go:36] WriteFile acquiring /Users/hardikdadhich/.kube/config: {Name:mka4ca1bdbb61e100f6009ff91c5d57849bc9756 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I1008 10:44:00.119361   27221 kapi.go:59] client config for minikube: &rest.Config{Host:"https://192.168.64.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/hardikdadhich/.minikube/profiles/minikube/client.crt", KeyFile:"/Users/hardikdadhich/.minikube/profiles/minikube/client.key", CAFile:"/Users/hardikdadhich/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x23d1580), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
W1008 10:44:00.141668   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
| W1008 10:44:00.645480   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
/ W1008 10:44:01.147327   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
- W1008 10:44:01.646504   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
\ W1008 10:44:02.145595   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
| W1008 10:44:02.644330   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
| W1008 10:44:03.146539   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
/ W1008 10:44:03.646693   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
- W1008 10:44:04.147227   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
\ W1008 10:44:04.647249   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
| W1008 10:44:05.146262   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
/ W1008 10:44:05.644873   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
/ W1008 10:44:06.146376   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
- W1008 10:44:06.646455   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
\ W1008 10:44:07.147841   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
| W1008 10:44:07.647333   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
/ W1008 10:44:08.143773   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
/ W1008 10:44:08.645451   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
- W1008 10:44:09.148213   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
\ W1008 10:44:09.648385   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
| W1008 10:44:10.146355   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
/ W1008 10:44:10.649354   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
- W1008 10:44:11.144129   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
- W1008 10:44:11.647344   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
\ W1008 10:44:12.146728   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
| W1008 10:44:12.648345   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
/ W1008 10:44:13.147419   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
- W1008 10:44:13.645346   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
- W1008 10:44:14.148009   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
\ W1008 10:44:14.647629   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
| W1008 10:44:15.147408   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
/ W1008 10:44:15.644568   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
- W1008 10:44:16.144311   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
\ W1008 10:44:16.643250   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
\ W1008 10:44:17.146799   27221 kapi.go:226] failed getting deployment scale, will retry: Unauthorized
``

here is minikube version

<img width="1416" alt="Screenshot 2021-10-08 at 10 47 16 AM" src="https://user-images.githubusercontent.com/25060629/136502248-369befd0-6a1d-4d0f-a576-22cf7dfa6667.png">
`

it failed at the end by saying :

Exiting due to GUEST_START: wait 6m0s for node: wait for healthy API server: controlPlane never updated to v1.21.2



Anything worked for you guys? please let me know
spowelljr commented 3 years ago

Hi @hardik-dadhich, can you try running minikube delete --all --purge and then starting minikube again after, I believe that should solve the issue you're facing.

tamalCodes commented 2 years ago

Hi @hardik-dadhich, can you try running minikube delete --all --purge and then starting minikube again after, I believe that should solve the issue you're facing.

Doesn't work. I just cannot start it ,no devops for me ig.

praveenydv commented 2 years ago

Hi @hardik-dadhich, can you try running minikube delete --all --purge and then starting minikube again after, I believe that should solve the issue you're facing.

this worked for me

tamalCodes commented 2 years ago

Hi @hardik-dadhich, can you try running minikube delete --all --purge and then starting minikube again after, I believe that should solve the issue you're facing.

Doesn't work. I just cannot start it ,no devops for me ig.

Update : Fixed.

minikube start --vm-driver=docker has some version based bugs or something like that maybe ? IDK i used kvm2 instead of docker and it worked fine

klaases commented 2 years ago

Hi @BioGeek, I see that https://github.com/kubernetes/website/issues/26998 is now closed.

Are you still experiencing this issue?

BioGeek commented 2 years ago

@klaases When I opened this issue, I was still using WSL. I have since switched to using Linux full time, so this issue is no longer relevant for me. Hence, I will close this issue.

gajalakshmi2901 commented 1 year ago

Hi @hardik-dadhich, can you try running minikube delete --all --purge and then starting minikube again after, I believe that should solve the issue you're facing.

Doesn't work. I just cannot start it ,no devops for me ig.

Update : Fixed.

minikube start --vm-driver=docker has some version based bugs or something like that maybe ? IDK i used kvm2 instead of docker and it worked fine

have you tried to implement using terraform . I'm facing the same issue . Would you mind providing the code?

yaguirre commented 1 year ago

Hi @hardik-dadhich, can you try running minikube delete --all --purge and then starting minikube again after, I believe that should solve the issue you're facing.

This worked for me too