search

kubernetes / minikube

Run Kubernetes locally
https://minikube.sigs.k8s.io/
Apache License 2.0
29.5k stars 4.89k forks source link

minikube PersistentVolume issues #12311

Closed dtln820 closed 3 years ago

dtln820 commented 3 years ago

Can't run the Cassandra nodes, it always fail saying that 'pod has unbound immediate PersistentVolumeClaims'. Tested on macOS & Ubuntu. minikube version: 1.22.0 Tried to resolve the issue by this (https://stackoverflow.com/a/52669115/6678347) answer - unsuccessfully.

Steps to reproduce the issue: Steps described at this link: https://kubernetes.io/docs/tutorials/stateful-application/cassandra/

Full output of minikube logs command:

==> Audit <== |---------|------------------------|----------|------|---------|--------------------------------|--------------------------------| | Command | Args | Profile | User | Version | Start Time | End Time | |---------|------------------------|----------|------|---------|--------------------------------|--------------------------------| | start | --memory 4096 --cpus=3 | minikube | sde3 | v1.22.0 | Thu, 19 Aug 2021 18:26:11 EEST | Thu, 19 Aug 2021 18:28:23 EEST | | stop | | minikube | sde3 | v1.22.0 | Thu, 19 Aug 2021 18:31:17 EEST | Thu, 19 Aug 2021 18:31:30 EEST | | delete | | minikube | sde3 | v1.22.0 | Thu, 19 Aug 2021 18:31:31 EEST | Thu, 19 Aug 2021 18:31:31 EEST | | start | --memory 4096 --cpus=3 | minikube | sde3 | v1.22.0 | Thu, 19 Aug 2021 18:32:25 EEST | Thu, 19 Aug 2021 18:34:37 EEST | |---------|------------------------|----------|------|---------|--------------------------------|--------------------------------| ==> Last Start <== Log file created at: 2021/08/19 18:32:25 Running on machine: SDE3s-MacBook-Pro Binary: Built with gc go1.16.4 for darwin/amd64 Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg I0819 18:32:25.755865 3613 out.go:286] Setting OutFile to fd 1 ... I0819 18:32:25.756212 3613 out.go:338] isatty.IsTerminal(1) = true I0819 18:32:25.756217 3613 out.go:299] Setting ErrFile to fd 2... I0819 18:32:25.756221 3613 out.go:338] isatty.IsTerminal(2) = true I0819 18:32:25.756357 3613 root.go:312] Updating PATH: /Users/sde3/.minikube/bin I0819 18:32:25.756849 3613 out.go:293] Setting JSON to false I0819 18:32:25.790413 3613 start.go:111] hostinfo: {"hostname":"SDE3s-MacBook-Pro.local","uptime":491,"bootTime":1629386654,"procs":384,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"11.4","kernelVersion":"20.5.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"52a1e876-863e-38e3-ac80-09bbab13b752"} W0819 18:32:25.790565 3613 start.go:119] gopshost.Virtualization returned error: not implemented yet I0819 18:32:25.803865 3613 out.go:165] 😄 minikube v1.22.0 on Darwin 11.4 I0819 18:32:25.804147 3613 notify.go:169] Checking for updates... I0819 18:32:25.804529 3613 driver.go:335] Setting default libvirt URI to qemu:///system I0819 18:32:25.804572 3613 global.go:111] Querying for installed drivers using PATH=/Users/sde3/.minikube/bin:/Users/sde3/.npm/bin:/Users/sde3/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/share/dotnet:~/.dotnet/tools:/Library/Apple/usr/bin I0819 18:32:26.032618 3613 global.go:119] virtualbox default: true priority: 6, state: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc:} I0819 18:32:26.032857 3613 global.go:119] vmware default: true priority: 7, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "docker-machine-driver-vmware": executable file not found in $PATH Reason: Fix:Install docker-machine-driver-vmware Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/vmware/} I0819 18:32:26.032878 3613 global.go:119] vmwarefusion default: false priority: 1, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:the 'vmwarefusion' driver is no longer available Reason: Fix:Switch to the newer 'vmware' driver by using '--driver=vmware'. This may require first deleting your existing cluster Doc:https://minikube.sigs.k8s.io/docs/drivers/vmware/} I0819 18:32:26.032955 3613 global.go:119] docker default: true priority: 9, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "docker": executable file not found in $PATH Reason: Fix:Install Docker Doc:https://minikube.sigs.k8s.io/docs/drivers/docker/} I0819 18:32:26.033066 3613 global.go:119] hyperkit default: true priority: 8, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "hyperkit": executable file not found in $PATH Reason: Fix:Run 'brew install hyperkit' Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/hyperkit/} I0819 18:32:26.033125 3613 global.go:119] parallels default: true priority: 7, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "prlctl": executable file not found in $PATH Reason: Fix:Install Parallels Desktop for Mac Doc:https://minikube.sigs.k8s.io/docs/drivers/parallels/} I0819 18:32:26.033223 3613 global.go:119] podman default: true priority: 3, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "podman": executable file not found in $PATH Reason: Fix:Install Podman Doc:https://minikube.sigs.k8s.io/docs/drivers/podman/} I0819 18:32:26.033230 3613 global.go:119] ssh default: false priority: 4, state: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc:} I0819 18:32:26.033246 3613 driver.go:270] not recommending "ssh" due to default: false I0819 18:32:26.033260 3613 driver.go:305] Picked: virtualbox I0819 18:32:26.033266 3613 driver.go:306] Alternatives: [ssh] I0819 18:32:26.033269 3613 driver.go:307] Rejects: [vmwarefusion docker hyperkit parallels podman vmware] I0819 18:32:26.057996 3613 out.go:165] ✨ Automatically selected the virtualbox driver I0819 18:32:26.058041 3613 start.go:278] selected driver: virtualbox I0819 18:32:26.058048 3613 start.go:751] validating driver "virtualbox" against I0819 18:32:26.058063 3613 start.go:762] status for virtualbox: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc:} I0819 18:32:26.069150 3613 start_flags.go:261] no existing cluster config was found, will generate one from the flags I0819 18:32:26.069342 3613 start_flags.go:669] Wait components to verify : map[apiserver:true system_pods:true] I0819 18:32:26.069377 3613 cni.go:93] Creating CNI manager for "" I0819 18:32:26.069388 3613 cni.go:167] CNI unnecessary in this configuration, recommending no CNI I0819 18:32:26.069405 3613 start_flags.go:275] config: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:4096 CPUs:3 DiskSize:20000 VMDriver: Driver:virtualbox HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false} I0819 18:32:26.069624 3613 iso.go:123] acquiring lock: {Name:mkddc34d3fb1ca76a9eb9960157b7bc78ef5b82f Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0819 18:32:26.083856 3613 out.go:165] 👍 Starting control plane node minikube in cluster minikube I0819 18:32:26.083897 3613 preload.go:134] Checking if preload exists for k8s version v1.21.2 and runtime docker I0819 18:32:26.083937 3613 preload.go:150] Found local preload: /Users/sde3/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.2-docker-overlay2-amd64.tar.lz4 I0819 18:32:26.083951 3613 cache.go:56] Caching tarball of preloaded images I0819 18:32:26.084100 3613 preload.go:174] Found /Users/sde3/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download I0819 18:32:26.084113 3613 cache.go:59] Finished verifying existence of preloaded tar for v1.21.2 on docker I0819 18:32:26.084479 3613 profile.go:148] Saving config to /Users/sde3/.minikube/profiles/minikube/config.json ... I0819 18:32:26.084514 3613 lock.go:36] WriteFile acquiring /Users/sde3/.minikube/profiles/minikube/config.json: {Name:mk9b01de5c0fbeff406dcdcd5240ec60a308aa4c Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0819 18:32:26.084895 3613 cache.go:205] Successfully downloaded all kic artifacts I0819 18:32:26.084928 3613 start.go:313] acquiring machines lock for minikube: {Name:mk07d9e57ead15299e91ccc00305c11003d33a8b Clock:{} Delay:500ms Timeout:13m0s Cancel:} I0819 18:32:26.085010 3613 start.go:317] acquired machines lock for "minikube" in 67.816µs I0819 18:32:26.085075 3613 start.go:89] Provisioning new machine with config: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.22.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:4096 CPUs:3 DiskSize:20000 VMDriver: Driver:virtualbox HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.21.2 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false} &{Name: IP: Port:8443 KubernetesVersion:v1.21.2 ControlPlane:true Worker:true} I0819 18:32:26.085175 3613 start.go:126] createHost starting for "" (driver="virtualbox") I0819 18:32:26.099228 3613 out.go:192] 🔥 Creating virtualbox VM (CPUs=3, Memory=4096MB, Disk=20000MB) ... I0819 18:32:26.099596 3613 start.go:160] libmachine.API.Create for "minikube" (driver="virtualbox") I0819 18:32:26.099629 3613 client.go:168] LocalClient.Create starting I0819 18:32:26.099804 3613 main.go:130] libmachine: Reading certificate data from /Users/sde3/.minikube/certs/ca.pem I0819 18:32:26.099867 3613 main.go:130] libmachine: Decoding PEM data... I0819 18:32:26.099894 3613 main.go:130] libmachine: Parsing certificate... I0819 18:32:26.100095 3613 main.go:130] libmachine: Reading certificate data from /Users/sde3/.minikube/certs/cert.pem I0819 18:32:26.100154 3613 main.go:130] libmachine: Decoding PEM data... I0819 18:32:26.100169 3613 main.go:130] libmachine: Parsing certificate... I0819 18:32:26.100230 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage --version I0819 18:32:26.120509 3613 main.go:130] libmachine: STDOUT: { 6.1.26r145957 } I0819 18:32:26.120585 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:26.120710 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage list hostonlyifs I0819 18:32:26.181972 3613 main.go:130] libmachine: STDOUT: { Name: vboxnet0 GUID: 786f6276-656e-4074-8000-0a0027000000 DHCP: Disabled IPAddress: 192.168.99.1 NetworkMask: 255.255.255.0 IPV6Address: IPV6NetworkMaskPrefixLength: 0 HardwareAddress: 0a:00:27:00:00:00 MediumType: Ethernet Wireless: No Status: Up VBoxNetworkName: HostInterfaceNetworking-vboxnet0 } I0819 18:32:26.182005 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:26.182790 3613 main.go:130] libmachine: Downloading /Users/sde3/.minikube/cache/boot2docker.iso from file:///Users/sde3/.minikube/cache/iso/minikube-v1.22.0.iso... I0819 18:32:27.030068 3613 main.go:130] libmachine: Creating VirtualBox VM... I0819 18:32:27.030095 3613 main.go:130] libmachine: Creating SSH key... I0819 18:32:27.145962 3613 main.go:130] libmachine: Creating disk image... I0819 18:32:27.145980 3613 main.go:130] libmachine: Creating 20000 MB hard disk image... I0819 18:32:27.145987 3613 main.go:130] libmachine: Writing magic tar header I0819 18:32:27.146025 3613 main.go:130] libmachine: Writing SSH key tar header I0819 18:32:27.146140 3613 main.go:130] libmachine: Calling inner createDiskImage I0819 18:32:27.146160 3613 main.go:130] libmachine: /usr/local/bin/VBoxManage convertfromraw stdin /Users/sde3/.minikube/machines/minikube/disk.vmdk 20971520000 --format VMDK I0819 18:32:27.146200 3613 main.go:130] libmachine: Starting command I0819 18:32:27.149795 3613 main.go:130] libmachine: Copying to stdin I0819 18:32:27.149841 3613 main.go:130] libmachine: Filling zeroes I0819 18:32:33.413384 3613 main.go:130] libmachine: Closing STDIN I0819 18:32:33.413406 3613 main.go:130] libmachine: Waiting on cmd I0819 18:32:33.416183 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage createvm --basefolder /Users/sde3/.minikube/machines/minikube --name minikube --register I0819 18:32:33.646269 3613 main.go:130] libmachine: STDOUT: { Virtual machine 'minikube' is created and registered. UUID: c920483a-6afe-428f-ba48-e3f81db2be7c Settings file: '/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox' } I0819 18:32:33.646309 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:33.646317 3613 main.go:130] libmachine: VM CPUS: 3 I0819 18:32:33.646324 3613 main.go:130] libmachine: VM Memory: 4096 I0819 18:32:33.646408 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage modifyvm minikube --firmware bios --bioslogofadein off --bioslogofadeout off --bioslogodisplaytime 0 --biosbootmenu disabled --ostype Linux26_64 --cpus 3 --memory 4096 --acpi on --ioapic on --rtcuseutc on --natdnshostresolver1 on --natdnsproxy1 off --cpuhotplug off --pae on --hpet on --hwvirtex on --nestedpaging on --largepages on --vtxvpid on --accelerate3d off --boot1 dvd I0819 18:32:33.698042 3613 main.go:130] libmachine: STDOUT: { } I0819 18:32:33.698092 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:33.698171 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage modifyvm minikube --nic1 nat --nictype1 virtio --cableconnected1 on I0819 18:32:33.748432 3613 main.go:130] libmachine: STDOUT: { } I0819 18:32:33.748471 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:33.748520 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage storagectl minikube --name SATA --add sata --hostiocache on I0819 18:32:33.796212 3613 main.go:130] libmachine: STDOUT: { } I0819 18:32:33.796233 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:33.796351 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage storageattach minikube --storagectl SATA --port 0 --device 0 --type dvddrive --medium /Users/sde3/.minikube/machines/minikube/boot2docker.iso I0819 18:32:33.846827 3613 main.go:130] libmachine: STDOUT: { } I0819 18:32:33.846900 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:33.846970 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage storageattach minikube --storagectl SATA --port 1 --device 0 --type hdd --medium /Users/sde3/.minikube/machines/minikube/disk.vmdk I0819 18:32:33.899194 3613 main.go:130] libmachine: STDOUT: { } I0819 18:32:33.899224 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:33.899275 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage guestproperty set minikube /VirtualBox/GuestAdd/SharedFolders/MountPrefix / I0819 18:32:33.946410 3613 main.go:130] libmachine: STDOUT: { } I0819 18:32:33.946442 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:33.946542 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage guestproperty set minikube /VirtualBox/GuestAdd/SharedFolders/MountDir / I0819 18:32:33.995544 3613 main.go:130] libmachine: STDOUT: { } I0819 18:32:33.995578 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:33.995612 3613 main.go:130] libmachine: setting up shareDir '/Users' -> 'Users' I0819 18:32:33.995698 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage sharedfolder add minikube --name Users --hostpath /Users --automount I0819 18:32:34.043758 3613 main.go:130] libmachine: STDOUT: { } I0819 18:32:34.043795 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:34.043836 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage setextradata minikube VBoxInternal2/SharedFoldersEnableSymlinksCreate/Users 1 I0819 18:32:34.091817 3613 main.go:130] libmachine: STDOUT: { } I0819 18:32:34.091850 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:34.091937 3613 main.go:130] libmachine: Starting the VM... I0819 18:32:34.091983 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage showvminfo minikube --machinereadable I0819 18:32:34.169198 3613 main.go:130] libmachine: STDOUT: { name="minikube" groups="/" ostype="Linux 2.6 / 3.x / 4.x (64-bit)" UUID="c920483a-6afe-428f-ba48-e3f81db2be7c" CfgFile="/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox" SnapFldr="/Users/sde3/.minikube/machines/minikube/minikube/Snapshots" LogFldr="/Users/sde3/.minikube/machines/minikube/minikube/Logs" hardwareuuid="c920483a-6afe-428f-ba48-e3f81db2be7c" memory=4096 pagefusion="off" vram=8 cpuexecutioncap=100 hpet="on" cpu-profile="host" chipset="piix3" firmware="BIOS" cpus=3 pae="on" longmode="on" triplefaultreset="off" apic="on" x2apic="off" nested-hw-virt="off" cpuid-portability-level=0 bootmenu="disabled" boot1="dvd" boot2="dvd" boot3="disk" boot4="none" acpi="on" ioapic="on" biosapic="apic" biossystemtimeoffset=0 rtcuseutc="on" hwvirtex="on" nestedpaging="on" largepages="on" vtxvpid="on" vtxux="on" paravirtprovider="default" effparavirtprovider="kvm" VMState="poweroff" VMStateChangeTime="2021-08-19T15:32:33.627000000" graphicscontroller="vboxvga" monitorcount=1 accelerate3d="off" accelerate2dvideo="off" teleporterenabled="off" teleporterport=0 teleporteraddress="" teleporterpassword="" tracing-enabled="off" tracing-allow-vm-access="off" tracing-config="" autostart-enabled="off" autostart-delay=0 defaultfrontend="" vmprocpriority="default" storagecontrollername0="SATA" storagecontrollertype0="IntelAhci" storagecontrollerinstance0="0" storagecontrollermaxportcount0="30" storagecontrollerportcount0="30" storagecontrollerbootable0="on" "SATA-0-0"="/Users/sde3/.minikube/machines/minikube/boot2docker.iso" "SATA-ImageUUID-0-0"="e19bbcd1-04d1-4c45-b05a-07bf985467e0" "SATA-tempeject"="off" "SATA-IsEjected"="off" "SATA-1-0"="/Users/sde3/.minikube/machines/minikube/disk.vmdk" "SATA-ImageUUID-1-0"="adc5121f-6e26-48ab-ba4b-ca777f440673" "SATA-2-0"="none" "SATA-3-0"="none" "SATA-4-0"="none" "SATA-5-0"="none" "SATA-6-0"="none" "SATA-7-0"="none" "SATA-8-0"="none" "SATA-9-0"="none" "SATA-10-0"="none" "SATA-11-0"="none" "SATA-12-0"="none" "SATA-13-0"="none" "SATA-14-0"="none" "SATA-15-0"="none" "SATA-16-0"="none" "SATA-17-0"="none" "SATA-18-0"="none" "SATA-19-0"="none" "SATA-20-0"="none" "SATA-21-0"="none" "SATA-22-0"="none" "SATA-23-0"="none" "SATA-24-0"="none" "SATA-25-0"="none" "SATA-26-0"="none" "SATA-27-0"="none" "SATA-28-0"="none" "SATA-29-0"="none" natnet1="nat" macaddress1="080027DC3858" cableconnected1="on" nic1="nat" nictype1="virtio" nicspeed1="0" mtu="0" sockSnd="64" sockRcv="64" tcpWndSnd="64" tcpWndRcv="64" nic2="none" nic3="none" nic4="none" nic5="none" nic6="none" nic7="none" nic8="none" hidpointing="ps2mouse" hidkeyboard="ps2kbd" uart1="off" uart2="off" uart3="off" uart4="off" lpt1="off" lpt2="off" audio="coreaudio" audio_out="off" audio_in="off" clipboard="disabled" draganddrop="disabled" vrde="off" usb="off" ehci="off" xhci="off" SharedFolderNameMachineMapping1="Users" SharedFolderPathMachineMapping1="/Users" videocap="off" videocapaudio="off" capturescreens="" capturefilename="/Users/sde3/.minikube/machines/minikube/minikube/minikube.webm" captureres="1024x768" capturevideorate=512 capturevideofps=25 captureopts="" GuestMemoryBalloon=0 } I0819 18:32:34.169227 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:34.169333 3613 main.go:130] libmachine: Check network to re-create if needed... I0819 18:32:34.169360 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage list hostonlyifs I0819 18:32:34.229453 3613 main.go:130] libmachine: STDOUT: { Name: vboxnet0 GUID: 786f6276-656e-4074-8000-0a0027000000 DHCP: Disabled IPAddress: 192.168.99.1 NetworkMask: 255.255.255.0 IPV6Address: IPV6NetworkMaskPrefixLength: 0 HardwareAddress: 0a:00:27:00:00:00 MediumType: Ethernet Wireless: No Status: Up VBoxNetworkName: HostInterfaceNetworking-vboxnet0 } I0819 18:32:34.229502 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:34.230152 3613 main.go:130] libmachine: Searching for hostonly interface for IPv4: 192.168.99.1 and Mask: ffffff00 I0819 18:32:34.230165 3613 main.go:130] libmachine: Found: vboxnet0 I0819 18:32:34.230182 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage list dhcpservers I0819 18:32:34.275868 3613 main.go:130] libmachine: STDOUT: { NetworkName: HostInterfaceNetworking-vboxnet0 Dhcpd IP: 192.168.99.16 LowerIPAddress: 192.168.99.100 UpperIPAddress: 192.168.99.254 NetworkMask: 255.255.255.0 Enabled: Yes Global Configuration: minLeaseTime: default defaultLeaseTime: default maxLeaseTime: default Forced options: None Suppressed opts.: None 1/legacy: 255.255.255.0 Groups: None Individual Configs: None } I0819 18:32:34.275907 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:34.276001 3613 main.go:130] libmachine: Removing orphan DHCP servers... I0819 18:32:34.276018 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage list hostonlyifs I0819 18:32:34.336623 3613 main.go:130] libmachine: STDOUT: { Name: vboxnet0 GUID: 786f6276-656e-4074-8000-0a0027000000 DHCP: Disabled IPAddress: 192.168.99.1 NetworkMask: 255.255.255.0 IPV6Address: IPV6NetworkMaskPrefixLength: 0 HardwareAddress: 0a:00:27:00:00:00 MediumType: Ethernet Wireless: No Status: Up VBoxNetworkName: HostInterfaceNetworking-vboxnet0 } I0819 18:32:34.336662 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:34.336796 3613 main.go:130] libmachine: Adding/Modifying DHCP server "192.168.99.19" with address range "192.168.99.100" - "192.168.99.254"... I0819 18:32:34.336817 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage list dhcpservers I0819 18:32:34.380833 3613 main.go:130] libmachine: STDOUT: { NetworkName: HostInterfaceNetworking-vboxnet0 Dhcpd IP: 192.168.99.16 LowerIPAddress: 192.168.99.100 UpperIPAddress: 192.168.99.254 NetworkMask: 255.255.255.0 Enabled: Yes Global Configuration: minLeaseTime: default defaultLeaseTime: default maxLeaseTime: default Forced options: None Suppressed opts.: None 1/legacy: 255.255.255.0 Groups: None Individual Configs: None } I0819 18:32:34.380922 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:34.381290 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage dhcpserver modify --netname HostInterfaceNetworking-vboxnet0 --ip 192.168.99.19 --netmask 255.255.255.0 --lowerip 192.168.99.100 --upperip 192.168.99.254 --enable I0819 18:32:34.427693 3613 main.go:130] libmachine: STDOUT: { } I0819 18:32:34.427732 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:34.427789 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage modifyvm minikube --nic2 hostonly --nictype2 virtio --nicpromisc2 deny --hostonlyadapter2 vboxnet0 --cableconnected2 on I0819 18:32:34.477915 3613 main.go:130] libmachine: STDOUT: { } I0819 18:32:34.477950 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:34.478196 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage modifyvm minikube --natpf1 delete ssh I0819 18:32:34.523544 3613 main.go:130] libmachine: STDOUT: { } I0819 18:32:34.523597 3613 main.go:130] libmachine: STDERR: { VBoxManage: error: Code NS_ERROR_INVALID_ARG (0x80070057) - Invalid argument value (extended info not available) VBoxManage: error: Context: "RemoveRedirect(Bstr(ValueUnion.psz).raw())" at line 1936 of file VBoxManageModifyVM.cpp } I0819 18:32:34.523654 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage modifyvm minikube --natpf1 ssh,tcp,127.0.0.1,49545,,22 I0819 18:32:34.572351 3613 main.go:130] libmachine: STDOUT: { } I0819 18:32:34.572397 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:34.572527 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage startvm minikube --type headless I0819 18:32:34.917386 3613 main.go:130] libmachine: STDOUT: { Waiting for VM "minikube" to power on... VM "minikube" has been successfully started. } I0819 18:32:34.917411 3613 main.go:130] libmachine: STDERR: { } I0819 18:32:34.917425 3613 main.go:130] libmachine: Checking vm logs: /Users/sde3/.minikube/machines/minikube/minikube/Logs/VBox.log I0819 18:32:34.918126 3613 main.go:130] libmachine: Waiting for an IP... I0819 18:32:34.918135 3613 main.go:130] libmachine: Getting to WaitForSSH function... I0819 18:32:34.918396 3613 main.go:130] libmachine: Using SSH client type: native I0819 18:32:34.918645 3613 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x13f9760] 0x13f9720 [] 0s} 127.0.0.1 49545 } I0819 18:32:34.918651 3613 main.go:130] libmachine: About to run SSH command: exit 0 I0819 18:33:05.647808 3613 main.go:130] libmachine: SSH cmd err, output: : I0819 18:33:05.647841 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage showvminfo minikube --machinereadable I0819 18:33:05.735682 3613 main.go:130] libmachine: STDOUT: { name="minikube" groups="/" ostype="Linux 2.6 / 3.x / 4.x (64-bit)" UUID="c920483a-6afe-428f-ba48-e3f81db2be7c" CfgFile="/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox" SnapFldr="/Users/sde3/.minikube/machines/minikube/minikube/Snapshots" LogFldr="/Users/sde3/.minikube/machines/minikube/minikube/Logs" hardwareuuid="c920483a-6afe-428f-ba48-e3f81db2be7c" memory=4096 pagefusion="off" vram=8 cpuexecutioncap=100 hpet="on" cpu-profile="host" chipset="piix3" firmware="BIOS" cpus=3 pae="on" longmode="on" triplefaultreset="off" apic="on" x2apic="off" nested-hw-virt="off" cpuid-portability-level=0 bootmenu="disabled" boot1="dvd" boot2="dvd" boot3="disk" boot4="none" acpi="on" ioapic="on" biosapic="apic" biossystemtimeoffset=0 rtcuseutc="on" hwvirtex="on" nestedpaging="on" largepages="on" vtxvpid="on" vtxux="on" paravirtprovider="default" effparavirtprovider="kvm" VMState="running" VMStateChangeTime="2021-08-19T15:32:34.902000000" graphicscontroller="vboxvga" monitorcount=1 accelerate3d="off" accelerate2dvideo="off" teleporterenabled="off" teleporterport=0 teleporteraddress="" teleporterpassword="" tracing-enabled="off" tracing-allow-vm-access="off" tracing-config="" autostart-enabled="off" autostart-delay=0 defaultfrontend="" vmprocpriority="default" storagecontrollername0="SATA" storagecontrollertype0="IntelAhci" storagecontrollerinstance0="0" storagecontrollermaxportcount0="30" storagecontrollerportcount0="30" storagecontrollerbootable0="on" "SATA-0-0"="/Users/sde3/.minikube/machines/minikube/boot2docker.iso" "SATA-ImageUUID-0-0"="e19bbcd1-04d1-4c45-b05a-07bf985467e0" "SATA-tempeject"="off" "SATA-IsEjected"="off" "SATA-1-0"="/Users/sde3/.minikube/machines/minikube/disk.vmdk" "SATA-ImageUUID-1-0"="adc5121f-6e26-48ab-ba4b-ca777f440673" "SATA-2-0"="none" "SATA-3-0"="none" "SATA-4-0"="none" "SATA-5-0"="none" "SATA-6-0"="none" "SATA-7-0"="none" "SATA-8-0"="none" "SATA-9-0"="none" "SATA-10-0"="none" "SATA-11-0"="none" "SATA-12-0"="none" "SATA-13-0"="none" "SATA-14-0"="none" "SATA-15-0"="none" "SATA-16-0"="none" "SATA-17-0"="none" "SATA-18-0"="none" "SATA-19-0"="none" "SATA-20-0"="none" "SATA-21-0"="none" "SATA-22-0"="none" "SATA-23-0"="none" "SATA-24-0"="none" "SATA-25-0"="none" "SATA-26-0"="none" "SATA-27-0"="none" "SATA-28-0"="none" "SATA-29-0"="none" natnet1="nat" macaddress1="080027DC3858" cableconnected1="on" nic1="nat" nictype1="virtio" nicspeed1="0" mtu="0" sockSnd="64" sockRcv="64" tcpWndSnd="64" tcpWndRcv="64" Forwarding(0)="ssh,tcp,127.0.0.1,49545,,22" hostonlyadapter2="vboxnet0" macaddress2="080027AFB224" cableconnected2="on" nic2="hostonly" nictype2="virtio" nicspeed2="0" nic3="none" nic4="none" nic5="none" nic6="none" nic7="none" nic8="none" hidpointing="ps2mouse" hidkeyboard="ps2kbd" uart1="off" uart2="off" uart3="off" uart4="off" lpt1="off" lpt2="off" audio="coreaudio" audio_out="off" audio_in="off" clipboard="disabled" draganddrop="disabled" SessionName="headless" VideoMode="720,400,0"@0,0 1 vrde="off" usb="off" ehci="off" xhci="off" SharedFolderNameMachineMapping1="Users" SharedFolderPathMachineMapping1="/Users" VRDEActiveConnection="off" VRDEClients==0 videocap="off" videocapaudio="off" capturescreens="" capturefilename="/Users/sde3/.minikube/machines/minikube/minikube/minikube.webm" captureres="1024x768" capturevideorate=512 capturevideofps=25 captureopts="" GuestMemoryBalloon=0 GuestOSType="Linux26_64" GuestAdditionsRunLevel=2 GuestAdditionsVersion="5.2.42 r137960" GuestAdditionsFacility_VirtualBox Base Driver=50,1629387175471 GuestAdditionsFacility_VirtualBox System Service=50,1629387175811 GuestAdditionsFacility_Seamless Mode=0,1629387176738 GuestAdditionsFacility_Graphics Mode=0,1629387175471 } I0819 18:33:05.735722 3613 main.go:130] libmachine: STDERR: { } I0819 18:33:05.735842 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage showvminfo minikube --machinereadable I0819 18:33:05.820743 3613 main.go:130] libmachine: STDOUT: { name="minikube" groups="/" ostype="Linux 2.6 / 3.x / 4.x (64-bit)" UUID="c920483a-6afe-428f-ba48-e3f81db2be7c" CfgFile="/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox" SnapFldr="/Users/sde3/.minikube/machines/minikube/minikube/Snapshots" LogFldr="/Users/sde3/.minikube/machines/minikube/minikube/Logs" hardwareuuid="c920483a-6afe-428f-ba48-e3f81db2be7c" memory=4096 pagefusion="off" vram=8 cpuexecutioncap=100 hpet="on" cpu-profile="host" chipset="piix3" firmware="BIOS" cpus=3 pae="on" longmode="on" triplefaultreset="off" apic="on" x2apic="off" nested-hw-virt="off" cpuid-portability-level=0 bootmenu="disabled" boot1="dvd" boot2="dvd" boot3="disk" boot4="none" acpi="on" ioapic="on" biosapic="apic" biossystemtimeoffset=0 rtcuseutc="on" hwvirtex="on" nestedpaging="on" largepages="on" vtxvpid="on" vtxux="on" paravirtprovider="default" effparavirtprovider="kvm" VMState="running" VMStateChangeTime="2021-08-19T15:32:34.902000000" graphicscontroller="vboxvga" monitorcount=1 accelerate3d="off" accelerate2dvideo="off" teleporterenabled="off" teleporterport=0 teleporteraddress="" teleporterpassword="" tracing-enabled="off" tracing-allow-vm-access="off" tracing-config="" autostart-enabled="off" autostart-delay=0 defaultfrontend="" vmprocpriority="default" storagecontrollername0="SATA" storagecontrollertype0="IntelAhci" storagecontrollerinstance0="0" storagecontrollermaxportcount0="30" storagecontrollerportcount0="30" storagecontrollerbootable0="on" "SATA-0-0"="/Users/sde3/.minikube/machines/minikube/boot2docker.iso" "SATA-ImageUUID-0-0"="e19bbcd1-04d1-4c45-b05a-07bf985467e0" "SATA-tempeject"="off" "SATA-IsEjected"="off" "SATA-1-0"="/Users/sde3/.minikube/machines/minikube/disk.vmdk" "SATA-ImageUUID-1-0"="adc5121f-6e26-48ab-ba4b-ca777f440673" "SATA-2-0"="none" "SATA-3-0"="none" "SATA-4-0"="none" "SATA-5-0"="none" "SATA-6-0"="none" "SATA-7-0"="none" "SATA-8-0"="none" "SATA-9-0"="none" "SATA-10-0"="none" "SATA-11-0"="none" "SATA-12-0"="none" "SATA-13-0"="none" "SATA-14-0"="none" "SATA-15-0"="none" "SATA-16-0"="none" "SATA-17-0"="none" "SATA-18-0"="none" "SATA-19-0"="none" "SATA-20-0"="none" "SATA-21-0"="none" "SATA-22-0"="none" "SATA-23-0"="none" "SATA-24-0"="none" "SATA-25-0"="none" "SATA-26-0"="none" "SATA-27-0"="none" "SATA-28-0"="none" "SATA-29-0"="none" natnet1="nat" macaddress1="080027DC3858" cableconnected1="on" nic1="nat" nictype1="virtio" nicspeed1="0" mtu="0" sockSnd="64" sockRcv="64" tcpWndSnd="64" tcpWndRcv="64" Forwarding(0)="ssh,tcp,127.0.0.1,49545,,22" hostonlyadapter2="vboxnet0" macaddress2="080027AFB224" cableconnected2="on" nic2="hostonly" nictype2="virtio" nicspeed2="0" nic3="none" nic4="none" nic5="none" nic6="none" nic7="none" nic8="none" hidpointing="ps2mouse" hidkeyboard="ps2kbd" uart1="off" uart2="off" uart3="off" uart4="off" lpt1="off" lpt2="off" audio="coreaudio" audio_out="off" audio_in="off" clipboard="disabled" draganddrop="disabled" SessionName="headless" VideoMode="720,400,0"@0,0 1 vrde="off" usb="off" ehci="off" xhci="off" SharedFolderNameMachineMapping1="Users" SharedFolderPathMachineMapping1="/Users" VRDEActiveConnection="off" VRDEClients==0 videocap="off" videocapaudio="off" capturescreens="" capturefilename="/Users/sde3/.minikube/machines/minikube/minikube/minikube.webm" captureres="1024x768" capturevideorate=512 capturevideofps=25 captureopts="" GuestMemoryBalloon=0 GuestOSType="Linux26_64" GuestAdditionsRunLevel=2 GuestAdditionsVersion="5.2.42 r137960" GuestAdditionsFacility_VirtualBox Base Driver=50,1629387175471 GuestAdditionsFacility_VirtualBox System Service=50,1629387175811 GuestAdditionsFacility_Seamless Mode=0,1629387176738 GuestAdditionsFacility_Graphics Mode=0,1629387175471 } I0819 18:33:05.820785 3613 main.go:130] libmachine: STDERR: { } I0819 18:33:05.821099 3613 main.go:130] libmachine: Host-only MAC: 080027afb224 I0819 18:33:05.821218 3613 main.go:130] libmachine: Using SSH client type: native I0819 18:33:05.821518 3613 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x13f9760] 0x13f9720 [] 0s} 127.0.0.1 49545 } I0819 18:33:05.821530 3613 main.go:130] libmachine: About to run SSH command: ip addr show I0819 18:33:05.942447 3613 main.go:130] libmachine: SSH cmd err, output: : 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:dc:38:58 brd ff:ff:ff:ff:ff:ff inet 10.0.2.15/24 brd 10.0.2.255 scope global dynamic eth0 valid_lft 86390sec preferred_lft 86390sec 3: eth1: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:af:b2:24 brd ff:ff:ff:ff:ff:ff inet 192.168.99.101/24 brd 192.168.99.255 scope global dynamic eth1 valid_lft 590sec preferred_lft 590sec 4: sit0@NONE: mtu 1480 qdisc noop state DOWN group default qlen 1000 link/sit 0.0.0.0 brd 0.0.0.0 I0819 18:33:05.942488 3613 main.go:130] libmachine: SSH returned: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:dc:38:58 brd ff:ff:ff:ff:ff:ff inet 10.0.2.15/24 brd 10.0.2.255 scope global dynamic eth0 valid_lft 86390sec preferred_lft 86390sec 3: eth1: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:af:b2:24 brd ff:ff:ff:ff:ff:ff inet 192.168.99.101/24 brd 192.168.99.255 scope global dynamic eth1 valid_lft 590sec preferred_lft 590sec 4: sit0@NONE: mtu 1480 qdisc noop state DOWN group default qlen 1000 link/sit 0.0.0.0 brd 0.0.0.0 END SSH I0819 18:33:05.942498 3613 main.go:130] libmachine: IP is 192.168.99.101 I0819 18:33:05.942508 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage showvminfo minikube --machinereadable I0819 18:33:06.026318 3613 main.go:130] libmachine: STDOUT: { name="minikube" groups="/" ostype="Linux 2.6 / 3.x / 4.x (64-bit)" UUID="c920483a-6afe-428f-ba48-e3f81db2be7c" CfgFile="/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox" SnapFldr="/Users/sde3/.minikube/machines/minikube/minikube/Snapshots" LogFldr="/Users/sde3/.minikube/machines/minikube/minikube/Logs" hardwareuuid="c920483a-6afe-428f-ba48-e3f81db2be7c" memory=4096 pagefusion="off" vram=8 cpuexecutioncap=100 hpet="on" cpu-profile="host" chipset="piix3" firmware="BIOS" cpus=3 pae="on" longmode="on" triplefaultreset="off" apic="on" x2apic="off" nested-hw-virt="off" cpuid-portability-level=0 bootmenu="disabled" boot1="dvd" boot2="dvd" boot3="disk" boot4="none" acpi="on" ioapic="on" biosapic="apic" biossystemtimeoffset=0 rtcuseutc="on" hwvirtex="on" nestedpaging="on" largepages="on" vtxvpid="on" vtxux="on" paravirtprovider="default" effparavirtprovider="kvm" VMState="running" VMStateChangeTime="2021-08-19T15:32:34.902000000" graphicscontroller="vboxvga" monitorcount=1 accelerate3d="off" accelerate2dvideo="off" teleporterenabled="off" teleporterport=0 teleporteraddress="" teleporterpassword="" tracing-enabled="off" tracing-allow-vm-access="off" tracing-config="" autostart-enabled="off" autostart-delay=0 defaultfrontend="" vmprocpriority="default" storagecontrollername0="SATA" storagecontrollertype0="IntelAhci" storagecontrollerinstance0="0" storagecontrollermaxportcount0="30" storagecontrollerportcount0="30" storagecontrollerbootable0="on" "SATA-0-0"="/Users/sde3/.minikube/machines/minikube/boot2docker.iso" "SATA-ImageUUID-0-0"="e19bbcd1-04d1-4c45-b05a-07bf985467e0" "SATA-tempeject"="off" "SATA-IsEjected"="off" "SATA-1-0"="/Users/sde3/.minikube/machines/minikube/disk.vmdk" "SATA-ImageUUID-1-0"="adc5121f-6e26-48ab-ba4b-ca777f440673" "SATA-2-0"="none" "SATA-3-0"="none" "SATA-4-0"="none" "SATA-5-0"="none" "SATA-6-0"="none" "SATA-7-0"="none" "SATA-8-0"="none" "SATA-9-0"="none" "SATA-10-0"="none" "SATA-11-0"="none" "SATA-12-0"="none" "SATA-13-0"="none" "SATA-14-0"="none" "SATA-15-0"="none" "SATA-16-0"="none" "SATA-17-0"="none" "SATA-18-0"="none" "SATA-19-0"="none" "SATA-20-0"="none" "SATA-21-0"="none" "SATA-22-0"="none" "SATA-23-0"="none" "SATA-24-0"="none" "SATA-25-0"="none" "SATA-26-0"="none" "SATA-27-0"="none" "SATA-28-0"="none" "SATA-29-0"="none" natnet1="nat" macaddress1="080027DC3858" cableconnected1="on" nic1="nat" nictype1="virtio" nicspeed1="0" mtu="0" sockSnd="64" sockRcv="64" tcpWndSnd="64" tcpWndRcv="64" Forwarding(0)="ssh,tcp,127.0.0.1,49545,,22" hostonlyadapter2="vboxnet0" macaddress2="080027AFB224" cableconnected2="on" nic2="hostonly" nictype2="virtio" nicspeed2="0" nic3="none" nic4="none" nic5="none" nic6="none" nic7="none" nic8="none" hidpointing="ps2mouse" hidkeyboard="ps2kbd" uart1="off" uart2="off" uart3="off" uart4="off" lpt1="off" lpt2="off" audio="coreaudio" audio_out="off" audio_in="off" clipboard="disabled" draganddrop="disabled" SessionName="headless" VideoMode="720,400,0"@0,0 1 vrde="off" usb="off" ehci="off" xhci="off" SharedFolderNameMachineMapping1="Users" SharedFolderPathMachineMapping1="/Users" VRDEActiveConnection="off" VRDEClients==0 videocap="off" videocapaudio="off" capturescreens="" capturefilename="/Users/sde3/.minikube/machines/minikube/minikube/minikube.webm" captureres="1024x768" capturevideorate=512 capturevideofps=25 captureopts="" GuestMemoryBalloon=0 GuestOSType="Linux26_64" GuestAdditionsRunLevel=2 GuestAdditionsVersion="5.2.42 r137960" GuestAdditionsFacility_VirtualBox Base Driver=50,1629387175471 GuestAdditionsFacility_VirtualBox System Service=50,1629387175811 GuestAdditionsFacility_Seamless Mode=0,1629387176738 GuestAdditionsFacility_Graphics Mode=0,1629387175471 } I0819 18:33:06.026348 3613 main.go:130] libmachine: STDERR: { } I0819 18:33:06.026514 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage showvminfo minikube --machinereadable I0819 18:33:06.112376 3613 main.go:130] libmachine: STDOUT: { name="minikube" groups="/" ostype="Linux 2.6 / 3.x / 4.x (64-bit)" UUID="c920483a-6afe-428f-ba48-e3f81db2be7c" CfgFile="/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox" SnapFldr="/Users/sde3/.minikube/machines/minikube/minikube/Snapshots" LogFldr="/Users/sde3/.minikube/machines/minikube/minikube/Logs" hardwareuuid="c920483a-6afe-428f-ba48-e3f81db2be7c" memory=4096 pagefusion="off" vram=8 cpuexecutioncap=100 hpet="on" cpu-profile="host" chipset="piix3" firmware="BIOS" cpus=3 pae="on" longmode="on" triplefaultreset="off" apic="on" x2apic="off" nested-hw-virt="off" cpuid-portability-level=0 bootmenu="disabled" boot1="dvd" boot2="dvd" boot3="disk" boot4="none" acpi="on" ioapic="on" biosapic="apic" biossystemtimeoffset=0 rtcuseutc="on" hwvirtex="on" nestedpaging="on" largepages="on" vtxvpid="on" vtxux="on" paravirtprovider="default" effparavirtprovider="kvm" VMState="running" VMStateChangeTime="2021-08-19T15:32:34.902000000" graphicscontroller="vboxvga" monitorcount=1 accelerate3d="off" accelerate2dvideo="off" teleporterenabled="off" teleporterport=0 teleporteraddress="" teleporterpassword="" tracing-enabled="off" tracing-allow-vm-access="off" tracing-config="" autostart-enabled="off" autostart-delay=0 defaultfrontend="" vmprocpriority="default" storagecontrollername0="SATA" storagecontrollertype0="IntelAhci" storagecontrollerinstance0="0" storagecontrollermaxportcount0="30" storagecontrollerportcount0="30" storagecontrollerbootable0="on" "SATA-0-0"="/Users/sde3/.minikube/machines/minikube/boot2docker.iso" "SATA-ImageUUID-0-0"="e19bbcd1-04d1-4c45-b05a-07bf985467e0" "SATA-tempeject"="off" "SATA-IsEjected"="off" "SATA-1-0"="/Users/sde3/.minikube/machines/minikube/disk.vmdk" "SATA-ImageUUID-1-0"="adc5121f-6e26-48ab-ba4b-ca777f440673" "SATA-2-0"="none" "SATA-3-0"="none" "SATA-4-0"="none" "SATA-5-0"="none" "SATA-6-0"="none" "SATA-7-0"="none" "SATA-8-0"="none" "SATA-9-0"="none" "SATA-10-0"="none" "SATA-11-0"="none" "SATA-12-0"="none" "SATA-13-0"="none" "SATA-14-0"="none" "SATA-15-0"="none" "SATA-16-0"="none" "SATA-17-0"="none" "SATA-18-0"="none" "SATA-19-0"="none" "SATA-20-0"="none" "SATA-21-0"="none" "SATA-22-0"="none" "SATA-23-0"="none" "SATA-24-0"="none" "SATA-25-0"="none" "SATA-26-0"="none" "SATA-27-0"="none" "SATA-28-0"="none" "SATA-29-0"="none" natnet1="nat" macaddress1="080027DC3858" cableconnected1="on" nic1="nat" nictype1="virtio" nicspeed1="0" mtu="0" sockSnd="64" sockRcv="64" tcpWndSnd="64" tcpWndRcv="64" Forwarding(0)="ssh,tcp,127.0.0.1,49545,,22" hostonlyadapter2="vboxnet0" macaddress2="080027AFB224" cableconnected2="on" nic2="hostonly" nictype2="virtio" nicspeed2="0" nic3="none" nic4="none" nic5="none" nic6="none" nic7="none" nic8="none" hidpointing="ps2mouse" hidkeyboard="ps2kbd" uart1="off" uart2="off" uart3="off" uart4="off" lpt1="off" lpt2="off" audio="coreaudio" audio_out="off" audio_in="off" clipboard="disabled" draganddrop="disabled" SessionName="headless" VideoMode="720,400,0"@0,0 1 vrde="off" usb="off" ehci="off" xhci="off" SharedFolderNameMachineMapping1="Users" SharedFolderPathMachineMapping1="/Users" VRDEActiveConnection="off" VRDEClients==0 videocap="off" videocapaudio="off" capturescreens="" capturefilename="/Users/sde3/.minikube/machines/minikube/minikube/minikube.webm" captureres="1024x768" capturevideorate=512 capturevideofps=25 captureopts="" GuestMemoryBalloon=0 GuestOSType="Linux26_64" GuestAdditionsRunLevel=2 GuestAdditionsVersion="5.2.42 r137960" GuestAdditionsFacility_VirtualBox Base Driver=50,1629387175471 GuestAdditionsFacility_VirtualBox System Service=50,1629387175811 GuestAdditionsFacility_Seamless Mode=0,1629387176738 GuestAdditionsFacility_Graphics Mode=0,1629387175471 } I0819 18:33:06.112402 3613 main.go:130] libmachine: STDERR: { } I0819 18:33:06.112661 3613 main.go:130] libmachine: Host-only MAC: 080027afb224 I0819 18:33:06.112784 3613 main.go:130] libmachine: Using SSH client type: native I0819 18:33:06.113011 3613 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x13f9760] 0x13f9720 [] 0s} 127.0.0.1 49545 } I0819 18:33:06.113019 3613 main.go:130] libmachine: About to run SSH command: ip addr show I0819 18:33:06.190159 3613 main.go:130] libmachine: SSH cmd err, output: : 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:dc:38:58 brd ff:ff:ff:ff:ff:ff inet 10.0.2.15/24 brd 10.0.2.255 scope global dynamic eth0 valid_lft 86390sec preferred_lft 86390sec 3: eth1: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:af:b2:24 brd ff:ff:ff:ff:ff:ff inet 192.168.99.101/24 brd 192.168.99.255 scope global dynamic eth1 valid_lft 590sec preferred_lft 590sec 4: sit0@NONE: mtu 1480 qdisc noop state DOWN group default qlen 1000 link/sit 0.0.0.0 brd 0.0.0.0 I0819 18:33:06.190200 3613 main.go:130] libmachine: SSH returned: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:dc:38:58 brd ff:ff:ff:ff:ff:ff inet 10.0.2.15/24 brd 10.0.2.255 scope global dynamic eth0 valid_lft 86390sec preferred_lft 86390sec 3: eth1: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:af:b2:24 brd ff:ff:ff:ff:ff:ff inet 192.168.99.101/24 brd 192.168.99.255 scope global dynamic eth1 valid_lft 590sec preferred_lft 590sec 4: sit0@NONE: mtu 1480 qdisc noop state DOWN group default qlen 1000 link/sit 0.0.0.0 brd 0.0.0.0 END SSH I0819 18:33:06.190221 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage list hostonlyifs I0819 18:33:06.249377 3613 main.go:130] libmachine: STDOUT: { Name: vboxnet0 GUID: 786f6276-656e-4074-8000-0a0027000000 DHCP: Disabled IPAddress: 192.168.99.1 NetworkMask: 255.255.255.0 IPV6Address: IPV6NetworkMaskPrefixLength: 0 HardwareAddress: 0a:00:27:00:00:00 MediumType: Ethernet Wireless: No Status: Up VBoxNetworkName: HostInterfaceNetworking-vboxnet0 } I0819 18:33:06.249414 3613 main.go:130] libmachine: STDERR: { } I0819 18:33:06.249767 3613 main.go:130] libmachine: Found: vboxnet0 I0819 18:33:06.249789 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage showvminfo minikube --machinereadable I0819 18:33:06.336016 3613 main.go:130] libmachine: STDOUT: { name="minikube" groups="/" ostype="Linux 2.6 / 3.x / 4.x (64-bit)" UUID="c920483a-6afe-428f-ba48-e3f81db2be7c" CfgFile="/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox" SnapFldr="/Users/sde3/.minikube/machines/minikube/minikube/Snapshots" LogFldr="/Users/sde3/.minikube/machines/minikube/minikube/Logs" hardwareuuid="c920483a-6afe-428f-ba48-e3f81db2be7c" memory=4096 pagefusion="off" vram=8 cpuexecutioncap=100 hpet="on" cpu-profile="host" chipset="piix3" firmware="BIOS" cpus=3 pae="on" longmode="on" triplefaultreset="off" apic="on" x2apic="off" nested-hw-virt="off" cpuid-portability-level=0 bootmenu="disabled" boot1="dvd" boot2="dvd" boot3="disk" boot4="none" acpi="on" ioapic="on" biosapic="apic" biossystemtimeoffset=0 rtcuseutc="on" hwvirtex="on" nestedpaging="on" largepages="on" vtxvpid="on" vtxux="on" paravirtprovider="default" effparavirtprovider="kvm" VMState="running" VMStateChangeTime="2021-08-19T15:32:34.902000000" graphicscontroller="vboxvga" monitorcount=1 accelerate3d="off" accelerate2dvideo="off" teleporterenabled="off" teleporterport=0 teleporteraddress="" teleporterpassword="" tracing-enabled="off" tracing-allow-vm-access="off" tracing-config="" autostart-enabled="off" autostart-delay=0 defaultfrontend="" vmprocpriority="default" storagecontrollername0="SATA" storagecontrollertype0="IntelAhci" storagecontrollerinstance0="0" storagecontrollermaxportcount0="30" storagecontrollerportcount0="30" storagecontrollerbootable0="on" "SATA-0-0"="/Users/sde3/.minikube/machines/minikube/boot2docker.iso" "SATA-ImageUUID-0-0"="e19bbcd1-04d1-4c45-b05a-07bf985467e0" "SATA-tempeject"="off" "SATA-IsEjected"="off" "SATA-1-0"="/Users/sde3/.minikube/machines/minikube/disk.vmdk" "SATA-ImageUUID-1-0"="adc5121f-6e26-48ab-ba4b-ca777f440673" "SATA-2-0"="none" "SATA-3-0"="none" "SATA-4-0"="none" "SATA-5-0"="none" "SATA-6-0"="none" "SATA-7-0"="none" "SATA-8-0"="none" "SATA-9-0"="none" "SATA-10-0"="none" "SATA-11-0"="none" "SATA-12-0"="none" "SATA-13-0"="none" "SATA-14-0"="none" "SATA-15-0"="none" "SATA-16-0"="none" "SATA-17-0"="none" "SATA-18-0"="none" "SATA-19-0"="none" "SATA-20-0"="none" "SATA-21-0"="none" "SATA-22-0"="none" "SATA-23-0"="none" "SATA-24-0"="none" "SATA-25-0"="none" "SATA-26-0"="none" "SATA-27-0"="none" "SATA-28-0"="none" "SATA-29-0"="none" natnet1="nat" macaddress1="080027DC3858" cableconnected1="on" nic1="nat" nictype1="virtio" nicspeed1="0" mtu="0" sockSnd="64" sockRcv="64" tcpWndSnd="64" tcpWndRcv="64" Forwarding(0)="ssh,tcp,127.0.0.1,49545,,22" hostonlyadapter2="vboxnet0" macaddress2="080027AFB224" cableconnected2="on" nic2="hostonly" nictype2="virtio" nicspeed2="0" nic3="none" nic4="none" nic5="none" nic6="none" nic7="none" nic8="none" hidpointing="ps2mouse" hidkeyboard="ps2kbd" uart1="off" uart2="off" uart3="off" uart4="off" lpt1="off" lpt2="off" audio="coreaudio" audio_out="off" audio_in="off" clipboard="disabled" draganddrop="disabled" SessionName="headless" VideoMode="720,400,0"@0,0 1 vrde="off" usb="off" ehci="off" xhci="off" SharedFolderNameMachineMapping1="Users" SharedFolderPathMachineMapping1="/Users" VRDEActiveConnection="off" VRDEClients==0 videocap="off" videocapaudio="off" capturescreens="" capturefilename="/Users/sde3/.minikube/machines/minikube/minikube/minikube.webm" captureres="1024x768" capturevideorate=512 capturevideofps=25 captureopts="" GuestMemoryBalloon=0 GuestOSType="Linux26_64" GuestAdditionsRunLevel=2 GuestAdditionsVersion="5.2.42 r137960" GuestAdditionsFacility_VirtualBox Base Driver=50,1629387175471 GuestAdditionsFacility_VirtualBox System Service=50,1629387175811 GuestAdditionsFacility_Seamless Mode=0,1629387176738 GuestAdditionsFacility_Graphics Mode=0,1629387175471 } I0819 18:33:06.336067 3613 main.go:130] libmachine: STDERR: { } I0819 18:33:06.336223 3613 machine.go:88] provisioning docker machine ... I0819 18:33:06.336256 3613 buildroot.go:166] provisioning hostname "minikube" I0819 18:33:06.336386 3613 main.go:130] libmachine: Using SSH client type: native I0819 18:33:06.336676 3613 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x13f9760] 0x13f9720 [] 0s} 127.0.0.1 49545 } I0819 18:33:06.336686 3613 main.go:130] libmachine: About to run SSH command: sudo hostname minikube && echo "minikube" | sudo tee /etc/hostname I0819 18:33:06.450637 3613 main.go:130] libmachine: SSH cmd err, output: : minikube I0819 18:33:06.450779 3613 main.go:130] libmachine: Using SSH client type: native I0819 18:33:06.450988 3613 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x13f9760] 0x13f9720 [] 0s} 127.0.0.1 49545 } I0819 18:33:06.451001 3613 main.go:130] libmachine: About to run SSH command: if ! grep -xq '.*\sminikube' /etc/hosts; then if grep -xq '127.0.1.1\s.*' /etc/hosts; then sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 minikube/g' /etc/hosts; else echo '127.0.1.1 minikube' | sudo tee -a /etc/hosts; fi fi I0819 18:33:06.535220 3613 main.go:130] libmachine: SSH cmd err, output: : I0819 18:33:06.535248 3613 buildroot.go:172] set auth options {CertDir:/Users/sde3/.minikube CaCertPath:/Users/sde3/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/sde3/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/sde3/.minikube/machines/server.pem ServerKeyPath:/Users/sde3/.minikube/machines/server-key.pem ClientKeyPath:/Users/sde3/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/sde3/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/sde3/.minikube} I0819 18:33:06.535278 3613 buildroot.go:174] setting up certificates I0819 18:33:06.535292 3613 provision.go:83] configureAuth start I0819 18:33:06.535311 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage showvminfo minikube --machinereadable I0819 18:33:06.624590 3613 main.go:130] libmachine: STDOUT: { name="minikube" groups="/" ostype="Linux 2.6 / 3.x / 4.x (64-bit)" UUID="c920483a-6afe-428f-ba48-e3f81db2be7c" CfgFile="/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox" SnapFldr="/Users/sde3/.minikube/machines/minikube/minikube/Snapshots" LogFldr="/Users/sde3/.minikube/machines/minikube/minikube/Logs" hardwareuuid="c920483a-6afe-428f-ba48-e3f81db2be7c" memory=4096 pagefusion="off" vram=8 cpuexecutioncap=100 hpet="on" cpu-profile="host" chipset="piix3" firmware="BIOS" cpus=3 pae="on" longmode="on" triplefaultreset="off" apic="on" x2apic="off" nested-hw-virt="off" cpuid-portability-level=0 bootmenu="disabled" boot1="dvd" boot2="dvd" boot3="disk" boot4="none" acpi="on" ioapic="on" biosapic="apic" biossystemtimeoffset=0 rtcuseutc="on" hwvirtex="on" nestedpaging="on" largepages="on" vtxvpid="on" vtxux="on" paravirtprovider="default" effparavirtprovider="kvm" VMState="running" VMStateChangeTime="2021-08-19T15:32:34.902000000" graphicscontroller="vboxvga" monitorcount=1 accelerate3d="off" accelerate2dvideo="off" teleporterenabled="off" teleporterport=0 teleporteraddress="" teleporterpassword="" tracing-enabled="off" tracing-allow-vm-access="off" tracing-config="" autostart-enabled="off" autostart-delay=0 defaultfrontend="" vmprocpriority="default" storagecontrollername0="SATA" storagecontrollertype0="IntelAhci" storagecontrollerinstance0="0" storagecontrollermaxportcount0="30" storagecontrollerportcount0="30" storagecontrollerbootable0="on" "SATA-0-0"="/Users/sde3/.minikube/machines/minikube/boot2docker.iso" "SATA-ImageUUID-0-0"="e19bbcd1-04d1-4c45-b05a-07bf985467e0" "SATA-tempeject"="off" "SATA-IsEjected"="off" "SATA-1-0"="/Users/sde3/.minikube/machines/minikube/disk.vmdk" "SATA-ImageUUID-1-0"="adc5121f-6e26-48ab-ba4b-ca777f440673" "SATA-2-0"="none" "SATA-3-0"="none" "SATA-4-0"="none" "SATA-5-0"="none" "SATA-6-0"="none" "SATA-7-0"="none" "SATA-8-0"="none" "SATA-9-0"="none" "SATA-10-0"="none" "SATA-11-0"="none" "SATA-12-0"="none" "SATA-13-0"="none" "SATA-14-0"="none" "SATA-15-0"="none" "SATA-16-0"="none" "SATA-17-0"="none" "SATA-18-0"="none" "SATA-19-0"="none" "SATA-20-0"="none" "SATA-21-0"="none" "SATA-22-0"="none" "SATA-23-0"="none" "SATA-24-0"="none" "SATA-25-0"="none" "SATA-26-0"="none" "SATA-27-0"="none" "SATA-28-0"="none" "SATA-29-0"="none" natnet1="nat" macaddress1="080027DC3858" cableconnected1="on" nic1="nat" nictype1="virtio" nicspeed1="0" mtu="0" sockSnd="64" sockRcv="64" tcpWndSnd="64" tcpWndRcv="64" Forwarding(0)="ssh,tcp,127.0.0.1,49545,,22" hostonlyadapter2="vboxnet0" macaddress2="080027AFB224" cableconnected2="on" nic2="hostonly" nictype2="virtio" nicspeed2="0" nic3="none" nic4="none" nic5="none" nic6="none" nic7="none" nic8="none" hidpointing="ps2mouse" hidkeyboard="ps2kbd" uart1="off" uart2="off" uart3="off" uart4="off" lpt1="off" lpt2="off" audio="coreaudio" audio_out="off" audio_in="off" clipboard="disabled" draganddrop="disabled" SessionName="headless" VideoMode="720,400,0"@0,0 1 vrde="off" usb="off" ehci="off" xhci="off" SharedFolderNameMachineMapping1="Users" SharedFolderPathMachineMapping1="/Users" VRDEActiveConnection="off" VRDEClients==0 videocap="off" videocapaudio="off" capturescreens="" capturefilename="/Users/sde3/.minikube/machines/minikube/minikube/minikube.webm" captureres="1024x768" capturevideorate=512 capturevideofps=25 captureopts="" GuestMemoryBalloon=0 GuestOSType="Linux26_64" GuestAdditionsRunLevel=2 GuestAdditionsVersion="5.2.42 r137960" GuestAdditionsFacility_VirtualBox Base Driver=50,1629387175471 GuestAdditionsFacility_VirtualBox System Service=50,1629387175811 GuestAdditionsFacility_Seamless Mode=0,1629387176738 GuestAdditionsFacility_Graphics Mode=0,1629387175471 } I0819 18:33:06.624638 3613 main.go:130] libmachine: STDERR: { } I0819 18:33:06.624845 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage showvminfo minikube --machinereadable I0819 18:33:06.718199 3613 main.go:130] libmachine: STDOUT: { name="minikube" groups="/" ostype="Linux 2.6 / 3.x / 4.x (64-bit)" UUID="c920483a-6afe-428f-ba48-e3f81db2be7c" CfgFile="/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox" SnapFldr="/Users/sde3/.minikube/machines/minikube/minikube/Snapshots" LogFldr="/Users/sde3/.minikube/machines/minikube/minikube/Logs" hardwareuuid="c920483a-6afe-428f-ba48-e3f81db2be7c" memory=4096 pagefusion="off" vram=8 cpuexecutioncap=100 hpet="on" cpu-profile="host" chipset="piix3" firmware="BIOS" cpus=3 pae="on" longmode="on" triplefaultreset="off" apic="on" x2apic="off" nested-hw-virt="off" cpuid-portability-level=0 bootmenu="disabled" boot1="dvd" boot2="dvd" boot3="disk" boot4="none" acpi="on" ioapic="on" biosapic="apic" biossystemtimeoffset=0 rtcuseutc="on" hwvirtex="on" nestedpaging="on" largepages="on" vtxvpid="on" vtxux="on" paravirtprovider="default" effparavirtprovider="kvm" VMState="running" VMStateChangeTime="2021-08-19T15:32:34.902000000" graphicscontroller="vboxvga" monitorcount=1 accelerate3d="off" accelerate2dvideo="off" teleporterenabled="off" teleporterport=0 teleporteraddress="" teleporterpassword="" tracing-enabled="off" tracing-allow-vm-access="off" tracing-config="" autostart-enabled="off" autostart-delay=0 defaultfrontend="" vmprocpriority="default" storagecontrollername0="SATA" storagecontrollertype0="IntelAhci" storagecontrollerinstance0="0" storagecontrollermaxportcount0="30" storagecontrollerportcount0="30" storagecontrollerbootable0="on" "SATA-0-0"="/Users/sde3/.minikube/machines/minikube/boot2docker.iso" "SATA-ImageUUID-0-0"="e19bbcd1-04d1-4c45-b05a-07bf985467e0" "SATA-tempeject"="off" "SATA-IsEjected"="off" "SATA-1-0"="/Users/sde3/.minikube/machines/minikube/disk.vmdk" "SATA-ImageUUID-1-0"="adc5121f-6e26-48ab-ba4b-ca777f440673" "SATA-2-0"="none" "SATA-3-0"="none" "SATA-4-0"="none" "SATA-5-0"="none" "SATA-6-0"="none" "SATA-7-0"="none" "SATA-8-0"="none" "SATA-9-0"="none" "SATA-10-0"="none" "SATA-11-0"="none" "SATA-12-0"="none" "SATA-13-0"="none" "SATA-14-0"="none" "SATA-15-0"="none" "SATA-16-0"="none" "SATA-17-0"="none" "SATA-18-0"="none" "SATA-19-0"="none" "SATA-20-0"="none" "SATA-21-0"="none" "SATA-22-0"="none" "SATA-23-0"="none" "SATA-24-0"="none" "SATA-25-0"="none" "SATA-26-0"="none" "SATA-27-0"="none" "SATA-28-0"="none" "SATA-29-0"="none" natnet1="nat" macaddress1="080027DC3858" cableconnected1="on" nic1="nat" nictype1="virtio" nicspeed1="0" mtu="0" sockSnd="64" sockRcv="64" tcpWndSnd="64" tcpWndRcv="64" Forwarding(0)="ssh,tcp,127.0.0.1,49545,,22" hostonlyadapter2="vboxnet0" macaddress2="080027AFB224" cableconnected2="on" nic2="hostonly" nictype2="virtio" nicspeed2="0" nic3="none" nic4="none" nic5="none" nic6="none" nic7="none" nic8="none" hidpointing="ps2mouse" hidkeyboard="ps2kbd" uart1="off" uart2="off" uart3="off" uart4="off" lpt1="off" lpt2="off" audio="coreaudio" audio_out="off" audio_in="off" clipboard="disabled" draganddrop="disabled" SessionName="headless" VideoMode="720,400,0"@0,0 1 vrde="off" usb="off" ehci="off" xhci="off" SharedFolderNameMachineMapping1="Users" SharedFolderPathMachineMapping1="/Users" VRDEActiveConnection="off" VRDEClients==0 videocap="off" videocapaudio="off" capturescreens="" capturefilename="/Users/sde3/.minikube/machines/minikube/minikube/minikube.webm" captureres="1024x768" capturevideorate=512 capturevideofps=25 captureopts="" GuestMemoryBalloon=0 GuestOSType="Linux26_64" GuestAdditionsRunLevel=2 GuestAdditionsVersion="5.2.42 r137960" GuestAdditionsFacility_VirtualBox Base Driver=50,1629387175471 GuestAdditionsFacility_VirtualBox System Service=50,1629387175811 GuestAdditionsFacility_Seamless Mode=0,1629387176738 GuestAdditionsFacility_Graphics Mode=0,1629387175471 } I0819 18:33:06.718240 3613 main.go:130] libmachine: STDERR: { } I0819 18:33:06.718510 3613 main.go:130] libmachine: Host-only MAC: 080027afb224 I0819 18:33:06.718647 3613 main.go:130] libmachine: Using SSH client type: native I0819 18:33:06.718922 3613 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x13f9760] 0x13f9720 [] 0s} 127.0.0.1 49545 } I0819 18:33:06.718930 3613 main.go:130] libmachine: About to run SSH command: ip addr show I0819 18:33:06.813691 3613 main.go:130] libmachine: SSH cmd err, output: : 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:dc:38:58 brd ff:ff:ff:ff:ff:ff inet 10.0.2.15/24 brd 10.0.2.255 scope global dynamic eth0 valid_lft 86389sec preferred_lft 86389sec 3: eth1: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:af:b2:24 brd ff:ff:ff:ff:ff:ff inet 192.168.99.101/24 brd 192.168.99.255 scope global dynamic eth1 valid_lft 589sec preferred_lft 589sec 4: sit0@NONE: mtu 1480 qdisc noop state DOWN group default qlen 1000 link/sit 0.0.0.0 brd 0.0.0.0 I0819 18:33:06.813733 3613 main.go:130] libmachine: SSH returned: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:dc:38:58 brd ff:ff:ff:ff:ff:ff inet 10.0.2.15/24 brd 10.0.2.255 scope global dynamic eth0 valid_lft 86389sec preferred_lft 86389sec 3: eth1: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:af:b2:24 brd ff:ff:ff:ff:ff:ff inet 192.168.99.101/24 brd 192.168.99.255 scope global dynamic eth1 valid_lft 589sec preferred_lft 589sec 4: sit0@NONE: mtu 1480 qdisc noop state DOWN group default qlen 1000 link/sit 0.0.0.0 brd 0.0.0.0 END SSH I0819 18:33:06.813751 3613 provision.go:137] copyHostCerts I0819 18:33:06.813875 3613 exec_runner.go:145] found /Users/sde3/.minikube/ca.pem, removing ... I0819 18:33:06.813886 3613 exec_runner.go:190] rm: /Users/sde3/.minikube/ca.pem I0819 18:33:06.814085 3613 exec_runner.go:152] cp: /Users/sde3/.minikube/certs/ca.pem --> /Users/sde3/.minikube/ca.pem (1070 bytes) I0819 18:33:06.814414 3613 exec_runner.go:145] found /Users/sde3/.minikube/cert.pem, removing ... I0819 18:33:06.814421 3613 exec_runner.go:190] rm: /Users/sde3/.minikube/cert.pem I0819 18:33:06.814524 3613 exec_runner.go:152] cp: /Users/sde3/.minikube/certs/cert.pem --> /Users/sde3/.minikube/cert.pem (1115 bytes) I0819 18:33:06.814765 3613 exec_runner.go:145] found /Users/sde3/.minikube/key.pem, removing ... I0819 18:33:06.814770 3613 exec_runner.go:190] rm: /Users/sde3/.minikube/key.pem I0819 18:33:06.814887 3613 exec_runner.go:152] cp: /Users/sde3/.minikube/certs/key.pem --> /Users/sde3/.minikube/key.pem (1679 bytes) I0819 18:33:06.815079 3613 provision.go:111] generating server cert: /Users/sde3/.minikube/machines/server.pem ca-key=/Users/sde3/.minikube/certs/ca.pem private-key=/Users/sde3/.minikube/certs/ca-key.pem org=sde3.minikube san=[192.168.99.101 127.0.0.1 localhost 127.0.0.1 minikube minikube] I0819 18:33:07.170217 3613 provision.go:171] copyRemoteCerts I0819 18:33:07.171605 3613 ssh_runner.go:149] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker I0819 18:33:07.171633 3613 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49545 SSHKeyPath:/Users/sde3/.minikube/machines/minikube/id_rsa Username:docker} I0819 18:33:07.224675 3613 ssh_runner.go:316] scp /Users/sde3/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1070 bytes) I0819 18:33:07.237191 3613 ssh_runner.go:316] scp /Users/sde3/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes) I0819 18:33:07.248372 3613 ssh_runner.go:316] scp /Users/sde3/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes) I0819 18:33:07.264583 3613 provision.go:86] duration metric: configureAuth took 729.273966ms I0819 18:33:07.264598 3613 buildroot.go:189] setting minikube options for container-runtime I0819 18:33:07.264870 3613 main.go:130] libmachine: Using SSH client type: native I0819 18:33:07.265051 3613 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x13f9760] 0x13f9720 [] 0s} 127.0.0.1 49545 } I0819 18:33:07.265059 3613 main.go:130] libmachine: About to run SSH command: df --output=fstype / | tail -n 1 I0819 18:33:07.343227 3613 main.go:130] libmachine: SSH cmd err, output: : tmpfs I0819 18:33:07.343239 3613 buildroot.go:70] root file system type: tmpfs I0819 18:33:07.343526 3613 provision.go:308] Updating docker unit: /lib/systemd/system/docker.service ... I0819 18:33:07.343643 3613 main.go:130] libmachine: Using SSH client type: native I0819 18:33:07.343867 3613 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x13f9760] 0x13f9720 [] 0s} 127.0.0.1 49545 } I0819 18:33:07.343944 3613 main.go:130] libmachine: About to run SSH command: sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com After=network.target minikube-automount.service docker.socket Requires= minikube-automount.service docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=virtualbox --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP \$MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target " | sudo tee /lib/systemd/system/docker.service.new I0819 18:33:07.425986 3613 main.go:130] libmachine: SSH cmd err, output: : [Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com After=network.target minikube-automount.service docker.socket Requires= minikube-automount.service docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=virtualbox --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP $MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target I0819 18:33:07.426099 3613 main.go:130] libmachine: Using SSH client type: native I0819 18:33:07.426268 3613 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x13f9760] 0x13f9720 [] 0s} 127.0.0.1 49545 } I0819 18:33:07.426282 3613 main.go:130] libmachine: About to run SSH command: sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; } I0819 18:33:08.630678 3613 main.go:130] libmachine: SSH cmd err, output: : diff: can't stat '/lib/systemd/system/docker.service': No such file or directory Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service. I0819 18:33:08.630695 3613 machine.go:91] provisioned docker machine in 2.294459263s I0819 18:33:08.630701 3613 client.go:171] LocalClient.Create took 42.531068928s I0819 18:33:08.630726 3613 start.go:168] duration metric: libmachine.API.Create for "minikube" took 42.531129879s I0819 18:33:08.630741 3613 start.go:267] post-start starting for "minikube" (driver="virtualbox") I0819 18:33:08.630744 3613 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs] I0819 18:33:08.630862 3613 ssh_runner.go:149] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs I0819 18:33:08.630874 3613 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49545 SSHKeyPath:/Users/sde3/.minikube/machines/minikube/id_rsa Username:docker} I0819 18:33:08.671394 3613 ssh_runner.go:149] Run: cat /etc/os-release I0819 18:33:08.675416 3613 info.go:137] Remote host: Buildroot 2020.02.12 I0819 18:33:08.675433 3613 filesync.go:126] Scanning /Users/sde3/.minikube/addons for local assets ... I0819 18:33:08.675641 3613 filesync.go:126] Scanning /Users/sde3/.minikube/files for local assets ... I0819 18:33:08.675727 3613 start.go:270] post-start completed in 44.980568ms I0819 18:33:08.676571 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage showvminfo minikube --machinereadable I0819 18:33:08.775059 3613 main.go:130] libmachine: STDOUT: { name="minikube" groups="/" ostype="Linux 2.6 / 3.x / 4.x (64-bit)" UUID="c920483a-6afe-428f-ba48-e3f81db2be7c" CfgFile="/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox" SnapFldr="/Users/sde3/.minikube/machines/minikube/minikube/Snapshots" LogFldr="/Users/sde3/.minikube/machines/minikube/minikube/Logs" hardwareuuid="c920483a-6afe-428f-ba48-e3f81db2be7c" memory=4096 pagefusion="off" vram=8 cpuexecutioncap=100 hpet="on" cpu-profile="host" chipset="piix3" firmware="BIOS" cpus=3 pae="on" longmode="on" triplefaultreset="off" apic="on" x2apic="off" nested-hw-virt="off" cpuid-portability-level=0 bootmenu="disabled" boot1="dvd" boot2="dvd" boot3="disk" boot4="none" acpi="on" ioapic="on" biosapic="apic" biossystemtimeoffset=0 rtcuseutc="on" hwvirtex="on" nestedpaging="on" largepages="on" vtxvpid="on" vtxux="on" paravirtprovider="default" effparavirtprovider="kvm" VMState="running" VMStateChangeTime="2021-08-19T15:32:34.902000000" graphicscontroller="vboxvga" monitorcount=1 accelerate3d="off" accelerate2dvideo="off" teleporterenabled="off" teleporterport=0 teleporteraddress="" teleporterpassword="" tracing-enabled="off" tracing-allow-vm-access="off" tracing-config="" autostart-enabled="off" autostart-delay=0 defaultfrontend="" vmprocpriority="default" storagecontrollername0="SATA" storagecontrollertype0="IntelAhci" storagecontrollerinstance0="0" storagecontrollermaxportcount0="30" storagecontrollerportcount0="30" storagecontrollerbootable0="on" "SATA-0-0"="/Users/sde3/.minikube/machines/minikube/boot2docker.iso" "SATA-ImageUUID-0-0"="e19bbcd1-04d1-4c45-b05a-07bf985467e0" "SATA-tempeject"="off" "SATA-IsEjected"="off" "SATA-1-0"="/Users/sde3/.minikube/machines/minikube/disk.vmdk" "SATA-ImageUUID-1-0"="adc5121f-6e26-48ab-ba4b-ca777f440673" "SATA-2-0"="none" "SATA-3-0"="none" "SATA-4-0"="none" "SATA-5-0"="none" "SATA-6-0"="none" "SATA-7-0"="none" "SATA-8-0"="none" "SATA-9-0"="none" "SATA-10-0"="none" "SATA-11-0"="none" "SATA-12-0"="none" "SATA-13-0"="none" "SATA-14-0"="none" "SATA-15-0"="none" "SATA-16-0"="none" "SATA-17-0"="none" "SATA-18-0"="none" "SATA-19-0"="none" "SATA-20-0"="none" "SATA-21-0"="none" "SATA-22-0"="none" "SATA-23-0"="none" "SATA-24-0"="none" "SATA-25-0"="none" "SATA-26-0"="none" "SATA-27-0"="none" "SATA-28-0"="none" "SATA-29-0"="none" natnet1="nat" macaddress1="080027DC3858" cableconnected1="on" nic1="nat" nictype1="virtio" nicspeed1="0" mtu="0" sockSnd="64" sockRcv="64" tcpWndSnd="64" tcpWndRcv="64" Forwarding(0)="ssh,tcp,127.0.0.1,49545,,22" hostonlyadapter2="vboxnet0" macaddress2="080027AFB224" cableconnected2="on" nic2="hostonly" nictype2="virtio" nicspeed2="0" nic3="none" nic4="none" nic5="none" nic6="none" nic7="none" nic8="none" hidpointing="ps2mouse" hidkeyboard="ps2kbd" uart1="off" uart2="off" uart3="off" uart4="off" lpt1="off" lpt2="off" audio="coreaudio" audio_out="off" audio_in="off" clipboard="disabled" draganddrop="disabled" SessionName="headless" VideoMode="720,400,0"@0,0 1 vrde="off" usb="off" ehci="off" xhci="off" SharedFolderNameMachineMapping1="Users" SharedFolderPathMachineMapping1="/Users" VRDEActiveConnection="off" VRDEClients==0 videocap="off" videocapaudio="off" capturescreens="" capturefilename="/Users/sde3/.minikube/machines/minikube/minikube/minikube.webm" captureres="1024x768" capturevideorate=512 capturevideofps=25 captureopts="" GuestMemoryBalloon=0 GuestOSType="Linux26_64" GuestAdditionsRunLevel=2 GuestAdditionsVersion="5.2.42 r137960" GuestAdditionsFacility_VirtualBox Base Driver=50,1629387175471 GuestAdditionsFacility_VirtualBox System Service=50,1629387175811 GuestAdditionsFacility_Seamless Mode=0,1629387176738 GuestAdditionsFacility_Graphics Mode=0,1629387175471 } I0819 18:33:08.775106 3613 main.go:130] libmachine: STDERR: { } I0819 18:33:08.775228 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage showvminfo minikube --machinereadable I0819 18:33:08.861018 3613 main.go:130] libmachine: STDOUT: { name="minikube" groups="/" ostype="Linux 2.6 / 3.x / 4.x (64-bit)" UUID="c920483a-6afe-428f-ba48-e3f81db2be7c" CfgFile="/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox" SnapFldr="/Users/sde3/.minikube/machines/minikube/minikube/Snapshots" LogFldr="/Users/sde3/.minikube/machines/minikube/minikube/Logs" hardwareuuid="c920483a-6afe-428f-ba48-e3f81db2be7c" memory=4096 pagefusion="off" vram=8 cpuexecutioncap=100 hpet="on" cpu-profile="host" chipset="piix3" firmware="BIOS" cpus=3 pae="on" longmode="on" triplefaultreset="off" apic="on" x2apic="off" nested-hw-virt="off" cpuid-portability-level=0 bootmenu="disabled" boot1="dvd" boot2="dvd" boot3="disk" boot4="none" acpi="on" ioapic="on" biosapic="apic" biossystemtimeoffset=0 rtcuseutc="on" hwvirtex="on" nestedpaging="on" largepages="on" vtxvpid="on" vtxux="on" paravirtprovider="default" effparavirtprovider="kvm" VMState="running" VMStateChangeTime="2021-08-19T15:32:34.902000000" graphicscontroller="vboxvga" monitorcount=1 accelerate3d="off" accelerate2dvideo="off" teleporterenabled="off" teleporterport=0 teleporteraddress="" teleporterpassword="" tracing-enabled="off" tracing-allow-vm-access="off" tracing-config="" autostart-enabled="off" autostart-delay=0 defaultfrontend="" vmprocpriority="default" storagecontrollername0="SATA" storagecontrollertype0="IntelAhci" storagecontrollerinstance0="0" storagecontrollermaxportcount0="30" storagecontrollerportcount0="30" storagecontrollerbootable0="on" "SATA-0-0"="/Users/sde3/.minikube/machines/minikube/boot2docker.iso" "SATA-ImageUUID-0-0"="e19bbcd1-04d1-4c45-b05a-07bf985467e0" "SATA-tempeject"="off" "SATA-IsEjected"="off" "SATA-1-0"="/Users/sde3/.minikube/machines/minikube/disk.vmdk" "SATA-ImageUUID-1-0"="adc5121f-6e26-48ab-ba4b-ca777f440673" "SATA-2-0"="none" "SATA-3-0"="none" "SATA-4-0"="none" "SATA-5-0"="none" "SATA-6-0"="none" "SATA-7-0"="none" "SATA-8-0"="none" "SATA-9-0"="none" "SATA-10-0"="none" "SATA-11-0"="none" "SATA-12-0"="none" "SATA-13-0"="none" "SATA-14-0"="none" "SATA-15-0"="none" "SATA-16-0"="none" "SATA-17-0"="none" "SATA-18-0"="none" "SATA-19-0"="none" "SATA-20-0"="none" "SATA-21-0"="none" "SATA-22-0"="none" "SATA-23-0"="none" "SATA-24-0"="none" "SATA-25-0"="none" "SATA-26-0"="none" "SATA-27-0"="none" "SATA-28-0"="none" "SATA-29-0"="none" natnet1="nat" macaddress1="080027DC3858" cableconnected1="on" nic1="nat" nictype1="virtio" nicspeed1="0" mtu="0" sockSnd="64" sockRcv="64" tcpWndSnd="64" tcpWndRcv="64" Forwarding(0)="ssh,tcp,127.0.0.1,49545,,22" hostonlyadapter2="vboxnet0" macaddress2="080027AFB224" cableconnected2="on" nic2="hostonly" nictype2="virtio" nicspeed2="0" nic3="none" nic4="none" nic5="none" nic6="none" nic7="none" nic8="none" hidpointing="ps2mouse" hidkeyboard="ps2kbd" uart1="off" uart2="off" uart3="off" uart4="off" lpt1="off" lpt2="off" audio="coreaudio" audio_out="off" audio_in="off" clipboard="disabled" draganddrop="disabled" SessionName="headless" VideoMode="720,400,0"@0,0 1 vrde="off" usb="off" ehci="off" xhci="off" SharedFolderNameMachineMapping1="Users" SharedFolderPathMachineMapping1="/Users" VRDEActiveConnection="off" VRDEClients==0 videocap="off" videocapaudio="off" capturescreens="" capturefilename="/Users/sde3/.minikube/machines/minikube/minikube/minikube.webm" captureres="1024x768" capturevideorate=512 capturevideofps=25 captureopts="" GuestMemoryBalloon=0 GuestOSType="Linux26_64" GuestAdditionsRunLevel=2 GuestAdditionsVersion="5.2.42 r137960" GuestAdditionsFacility_VirtualBox Base Driver=50,1629387175471 GuestAdditionsFacility_VirtualBox System Service=50,1629387175811 GuestAdditionsFacility_Seamless Mode=0,1629387176738 GuestAdditionsFacility_Graphics Mode=0,1629387175471 } I0819 18:33:08.861052 3613 main.go:130] libmachine: STDERR: { } I0819 18:33:08.861362 3613 main.go:130] libmachine: Host-only MAC: 080027afb224 I0819 18:33:08.861542 3613 main.go:130] libmachine: Using SSH client type: native I0819 18:33:08.861769 3613 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x13f9760] 0x13f9720 [] 0s} 127.0.0.1 49545 } I0819 18:33:08.861778 3613 main.go:130] libmachine: About to run SSH command: ip addr show I0819 18:33:08.968278 3613 main.go:130] libmachine: SSH cmd err, output: : 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:dc:38:58 brd ff:ff:ff:ff:ff:ff inet 10.0.2.15/24 brd 10.0.2.255 scope global dynamic eth0 valid_lft 86387sec preferred_lft 86387sec 3: eth1: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:af:b2:24 brd ff:ff:ff:ff:ff:ff inet 192.168.99.101/24 brd 192.168.99.255 scope global dynamic eth1 valid_lft 587sec preferred_lft 587sec 4: sit0@NONE: mtu 1480 qdisc noop state DOWN group default qlen 1000 link/sit 0.0.0.0 brd 0.0.0.0 5: docker0: mtu 1500 qdisc noqueue state DOWN group default link/ether 02:42:41:32:b0:ad brd ff:ff:ff:ff:ff:ff inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 valid_lft forever preferred_lft forever I0819 18:33:08.968323 3613 main.go:130] libmachine: SSH returned: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:dc:38:58 brd ff:ff:ff:ff:ff:ff inet 10.0.2.15/24 brd 10.0.2.255 scope global dynamic eth0 valid_lft 86387sec preferred_lft 86387sec 3: eth1: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:af:b2:24 brd ff:ff:ff:ff:ff:ff inet 192.168.99.101/24 brd 192.168.99.255 scope global dynamic eth1 valid_lft 587sec preferred_lft 587sec 4: sit0@NONE: mtu 1480 qdisc noop state DOWN group default qlen 1000 link/sit 0.0.0.0 brd 0.0.0.0 5: docker0: mtu 1500 qdisc noqueue state DOWN group default link/ether 02:42:41:32:b0:ad brd ff:ff:ff:ff:ff:ff inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 valid_lft forever preferred_lft forever END SSH I0819 18:33:08.968446 3613 profile.go:148] Saving config to /Users/sde3/.minikube/profiles/minikube/config.json ... I0819 18:33:08.969033 3613 start.go:129] duration metric: createHost completed in 42.883792553s I0819 18:33:08.969042 3613 start.go:80] releasing machines lock for "minikube", held for 42.884022457s I0819 18:33:08.969074 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage showvminfo minikube --machinereadable I0819 18:33:09.057234 3613 main.go:130] libmachine: STDOUT: { name="minikube" groups="/" ostype="Linux 2.6 / 3.x / 4.x (64-bit)" UUID="c920483a-6afe-428f-ba48-e3f81db2be7c" CfgFile="/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox" SnapFldr="/Users/sde3/.minikube/machines/minikube/minikube/Snapshots" LogFldr="/Users/sde3/.minikube/machines/minikube/minikube/Logs" hardwareuuid="c920483a-6afe-428f-ba48-e3f81db2be7c" memory=4096 pagefusion="off" vram=8 cpuexecutioncap=100 hpet="on" cpu-profile="host" chipset="piix3" firmware="BIOS" cpus=3 pae="on" longmode="on" triplefaultreset="off" apic="on" x2apic="off" nested-hw-virt="off" cpuid-portability-level=0 bootmenu="disabled" boot1="dvd" boot2="dvd" boot3="disk" boot4="none" acpi="on" ioapic="on" biosapic="apic" biossystemtimeoffset=0 rtcuseutc="on" hwvirtex="on" nestedpaging="on" largepages="on" vtxvpid="on" vtxux="on" paravirtprovider="default" effparavirtprovider="kvm" VMState="running" VMStateChangeTime="2021-08-19T15:32:34.902000000" graphicscontroller="vboxvga" monitorcount=1 accelerate3d="off" accelerate2dvideo="off" teleporterenabled="off" teleporterport=0 teleporteraddress="" teleporterpassword="" tracing-enabled="off" tracing-allow-vm-access="off" tracing-config="" autostart-enabled="off" autostart-delay=0 defaultfrontend="" vmprocpriority="default" storagecontrollername0="SATA" storagecontrollertype0="IntelAhci" storagecontrollerinstance0="0" storagecontrollermaxportcount0="30" storagecontrollerportcount0="30" storagecontrollerbootable0="on" "SATA-0-0"="/Users/sde3/.minikube/machines/minikube/boot2docker.iso" "SATA-ImageUUID-0-0"="e19bbcd1-04d1-4c45-b05a-07bf985467e0" "SATA-tempeject"="off" "SATA-IsEjected"="off" "SATA-1-0"="/Users/sde3/.minikube/machines/minikube/disk.vmdk" "SATA-ImageUUID-1-0"="adc5121f-6e26-48ab-ba4b-ca777f440673" "SATA-2-0"="none" "SATA-3-0"="none" "SATA-4-0"="none" "SATA-5-0"="none" "SATA-6-0"="none" "SATA-7-0"="none" "SATA-8-0"="none" "SATA-9-0"="none" "SATA-10-0"="none" "SATA-11-0"="none" "SATA-12-0"="none" "SATA-13-0"="none" "SATA-14-0"="none" "SATA-15-0"="none" "SATA-16-0"="none" "SATA-17-0"="none" "SATA-18-0"="none" "SATA-19-0"="none" "SATA-20-0"="none" "SATA-21-0"="none" "SATA-22-0"="none" "SATA-23-0"="none" "SATA-24-0"="none" "SATA-25-0"="none" "SATA-26-0"="none" "SATA-27-0"="none" "SATA-28-0"="none" "SATA-29-0"="none" natnet1="nat" macaddress1="080027DC3858" cableconnected1="on" nic1="nat" nictype1="virtio" nicspeed1="0" mtu="0" sockSnd="64" sockRcv="64" tcpWndSnd="64" tcpWndRcv="64" Forwarding(0)="ssh,tcp,127.0.0.1,49545,,22" hostonlyadapter2="vboxnet0" macaddress2="080027AFB224" cableconnected2="on" nic2="hostonly" nictype2="virtio" nicspeed2="0" nic3="none" nic4="none" nic5="none" nic6="none" nic7="none" nic8="none" hidpointing="ps2mouse" hidkeyboard="ps2kbd" uart1="off" uart2="off" uart3="off" uart4="off" lpt1="off" lpt2="off" audio="coreaudio" audio_out="off" audio_in="off" clipboard="disabled" draganddrop="disabled" SessionName="headless" VideoMode="720,400,0"@0,0 1 vrde="off" usb="off" ehci="off" xhci="off" SharedFolderNameMachineMapping1="Users" SharedFolderPathMachineMapping1="/Users" VRDEActiveConnection="off" VRDEClients==0 videocap="off" videocapaudio="off" capturescreens="" capturefilename="/Users/sde3/.minikube/machines/minikube/minikube/minikube.webm" captureres="1024x768" capturevideorate=512 capturevideofps=25 captureopts="" GuestMemoryBalloon=0 GuestOSType="Linux26_64" GuestAdditionsRunLevel=2 GuestAdditionsVersion="5.2.42 r137960" GuestAdditionsFacility_VirtualBox Base Driver=50,1629387175471 GuestAdditionsFacility_VirtualBox System Service=50,1629387175811 GuestAdditionsFacility_Seamless Mode=0,1629387176738 GuestAdditionsFacility_Graphics Mode=0,1629387175471 } I0819 18:33:09.057270 3613 main.go:130] libmachine: STDERR: { } I0819 18:33:09.057412 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage showvminfo minikube --machinereadable I0819 18:33:09.145223 3613 main.go:130] libmachine: STDOUT: { name="minikube" groups="/" ostype="Linux 2.6 / 3.x / 4.x (64-bit)" UUID="c920483a-6afe-428f-ba48-e3f81db2be7c" CfgFile="/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox" SnapFldr="/Users/sde3/.minikube/machines/minikube/minikube/Snapshots" LogFldr="/Users/sde3/.minikube/machines/minikube/minikube/Logs" hardwareuuid="c920483a-6afe-428f-ba48-e3f81db2be7c" memory=4096 pagefusion="off" vram=8 cpuexecutioncap=100 hpet="on" cpu-profile="host" chipset="piix3" firmware="BIOS" cpus=3 pae="on" longmode="on" triplefaultreset="off" apic="on" x2apic="off" nested-hw-virt="off" cpuid-portability-level=0 bootmenu="disabled" boot1="dvd" boot2="dvd" boot3="disk" boot4="none" acpi="on" ioapic="on" biosapic="apic" biossystemtimeoffset=0 rtcuseutc="on" hwvirtex="on" nestedpaging="on" largepages="on" vtxvpid="on" vtxux="on" paravirtprovider="default" effparavirtprovider="kvm" VMState="running" VMStateChangeTime="2021-08-19T15:32:34.902000000" graphicscontroller="vboxvga" monitorcount=1 accelerate3d="off" accelerate2dvideo="off" teleporterenabled="off" teleporterport=0 teleporteraddress="" teleporterpassword="" tracing-enabled="off" tracing-allow-vm-access="off" tracing-config="" autostart-enabled="off" autostart-delay=0 defaultfrontend="" vmprocpriority="default" storagecontrollername0="SATA" storagecontrollertype0="IntelAhci" storagecontrollerinstance0="0" storagecontrollermaxportcount0="30" storagecontrollerportcount0="30" storagecontrollerbootable0="on" "SATA-0-0"="/Users/sde3/.minikube/machines/minikube/boot2docker.iso" "SATA-ImageUUID-0-0"="e19bbcd1-04d1-4c45-b05a-07bf985467e0" "SATA-tempeject"="off" "SATA-IsEjected"="off" "SATA-1-0"="/Users/sde3/.minikube/machines/minikube/disk.vmdk" "SATA-ImageUUID-1-0"="adc5121f-6e26-48ab-ba4b-ca777f440673" "SATA-2-0"="none" "SATA-3-0"="none" "SATA-4-0"="none" "SATA-5-0"="none" "SATA-6-0"="none" "SATA-7-0"="none" "SATA-8-0"="none" "SATA-9-0"="none" "SATA-10-0"="none" "SATA-11-0"="none" "SATA-12-0"="none" "SATA-13-0"="none" "SATA-14-0"="none" "SATA-15-0"="none" "SATA-16-0"="none" "SATA-17-0"="none" "SATA-18-0"="none" "SATA-19-0"="none" "SATA-20-0"="none" "SATA-21-0"="none" "SATA-22-0"="none" "SATA-23-0"="none" "SATA-24-0"="none" "SATA-25-0"="none" "SATA-26-0"="none" "SATA-27-0"="none" "SATA-28-0"="none" "SATA-29-0"="none" natnet1="nat" macaddress1="080027DC3858" cableconnected1="on" nic1="nat" nictype1="virtio" nicspeed1="0" mtu="0" sockSnd="64" sockRcv="64" tcpWndSnd="64" tcpWndRcv="64" Forwarding(0)="ssh,tcp,127.0.0.1,49545,,22" hostonlyadapter2="vboxnet0" macaddress2="080027AFB224" cableconnected2="on" nic2="hostonly" nictype2="virtio" nicspeed2="0" nic3="none" nic4="none" nic5="none" nic6="none" nic7="none" nic8="none" hidpointing="ps2mouse" hidkeyboard="ps2kbd" uart1="off" uart2="off" uart3="off" uart4="off" lpt1="off" lpt2="off" audio="coreaudio" audio_out="off" audio_in="off" clipboard="disabled" draganddrop="disabled" SessionName="headless" VideoMode="720,400,0"@0,0 1 vrde="off" usb="off" ehci="off" xhci="off" SharedFolderNameMachineMapping1="Users" SharedFolderPathMachineMapping1="/Users" VRDEActiveConnection="off" VRDEClients==0 videocap="off" videocapaudio="off" capturescreens="" capturefilename="/Users/sde3/.minikube/machines/minikube/minikube/minikube.webm" captureres="1024x768" capturevideorate=512 capturevideofps=25 captureopts="" GuestMemoryBalloon=0 GuestOSType="Linux26_64" GuestAdditionsRunLevel=2 GuestAdditionsVersion="5.2.42 r137960" GuestAdditionsFacility_VirtualBox Base Driver=50,1629387175471 GuestAdditionsFacility_VirtualBox System Service=50,1629387175811 GuestAdditionsFacility_Seamless Mode=0,1629387176738 GuestAdditionsFacility_Graphics Mode=0,1629387175471 } I0819 18:33:09.145262 3613 main.go:130] libmachine: STDERR: { } I0819 18:33:09.145628 3613 main.go:130] libmachine: Host-only MAC: 080027afb224 I0819 18:33:09.145739 3613 main.go:130] libmachine: Using SSH client type: native I0819 18:33:09.146021 3613 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x13f9760] 0x13f9720 [] 0s} 127.0.0.1 49545 } I0819 18:33:09.146029 3613 main.go:130] libmachine: About to run SSH command: ip addr show I0819 18:33:09.225727 3613 main.go:130] libmachine: SSH cmd err, output: : 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:dc:38:58 brd ff:ff:ff:ff:ff:ff inet 10.0.2.15/24 brd 10.0.2.255 scope global dynamic eth0 valid_lft 86387sec preferred_lft 86387sec 3: eth1: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:af:b2:24 brd ff:ff:ff:ff:ff:ff inet 192.168.99.101/24 brd 192.168.99.255 scope global dynamic eth1 valid_lft 587sec preferred_lft 587sec 4: sit0@NONE: mtu 1480 qdisc noop state DOWN group default qlen 1000 link/sit 0.0.0.0 brd 0.0.0.0 5: docker0: mtu 1500 qdisc noqueue state DOWN group default link/ether 02:42:41:32:b0:ad brd ff:ff:ff:ff:ff:ff inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 valid_lft forever preferred_lft forever I0819 18:33:09.225784 3613 main.go:130] libmachine: SSH returned: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever 2: eth0: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:dc:38:58 brd ff:ff:ff:ff:ff:ff inet 10.0.2.15/24 brd 10.0.2.255 scope global dynamic eth0 valid_lft 86387sec preferred_lft 86387sec 3: eth1: mtu 1500 qdisc pfifo_fast state UP group default qlen 1000 link/ether 08:00:27:af:b2:24 brd ff:ff:ff:ff:ff:ff inet 192.168.99.101/24 brd 192.168.99.255 scope global dynamic eth1 valid_lft 587sec preferred_lft 587sec 4: sit0@NONE: mtu 1480 qdisc noop state DOWN group default qlen 1000 link/sit 0.0.0.0 brd 0.0.0.0 5: docker0: mtu 1500 qdisc noqueue state DOWN group default link/ether 02:42:41:32:b0:ad brd ff:ff:ff:ff:ff:ff inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 valid_lft forever preferred_lft forever END SSH I0819 18:33:09.230542 3613 ssh_runner.go:149] Run: systemctl --version I0819 18:33:09.230566 3613 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49545 SSHKeyPath:/Users/sde3/.minikube/machines/minikube/id_rsa Username:docker} I0819 18:33:09.232420 3613 ssh_runner.go:149] Run: curl -sS -m 2 https://k8s.gcr.io/ I0819 18:33:09.232469 3613 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49545 SSHKeyPath:/Users/sde3/.minikube/machines/minikube/id_rsa Username:docker} I0819 18:33:09.277095 3613 preload.go:134] Checking if preload exists for k8s version v1.21.2 and runtime docker I0819 18:33:09.277282 3613 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}} I0819 18:33:09.515803 3613 docker.go:535] Got preloaded images: I0819 18:33:09.515817 3613 docker.go:541] k8s.gcr.io/kube-apiserver:v1.21.2 wasn't preloaded I0819 18:33:09.515943 3613 ssh_runner.go:149] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json I0819 18:33:09.522219 3613 ssh_runner.go:149] Run: which lz4 I0819 18:33:09.528582 3613 ssh_runner.go:149] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4 I0819 18:33:09.533352 3613 ssh_runner.go:306] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1 stdout: stderr: stat: cannot stat '/preloaded.tar.lz4': No such file or directory I0819 18:33:09.533387 3613 ssh_runner.go:316] scp /Users/sde3/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v11-v1.21.2-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (526530599 bytes) I0819 18:34:04.784971 3613 docker.go:500] Took 55.258270 seconds to copy over tarball I0819 18:34:04.789046 3613 ssh_runner.go:149] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4 I0819 18:34:10.673031 3613 ssh_runner.go:189] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (5.883955916s) I0819 18:34:10.673052 3613 ssh_runner.go:100] rm: /preloaded.tar.lz4 I0819 18:34:10.712196 3613 ssh_runner.go:149] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json I0819 18:34:10.726657 3613 ssh_runner.go:316] scp memory --> /var/lib/docker/image/overlay2/repositories.json (3152 bytes) I0819 18:34:10.740697 3613 ssh_runner.go:149] Run: sudo systemctl daemon-reload I0819 18:34:10.865894 3613 ssh_runner.go:149] Run: sudo systemctl restart docker I0819 18:34:12.781510 3613 ssh_runner.go:189] Completed: sudo systemctl restart docker: (1.915597176s) I0819 18:34:12.781690 3613 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd I0819 18:34:12.795329 3613 ssh_runner.go:149] Run: sudo systemctl cat docker.service I0819 18:34:12.810321 3613 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service containerd I0819 18:34:12.820659 3613 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio I0819 18:34:12.829047 3613 ssh_runner.go:149] Run: sudo systemctl stop -f crio I0819 18:34:12.850989 3613 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service crio I0819 18:34:12.859010 3613 ssh_runner.go:149] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock image-endpoint: unix:///var/run/dockershim.sock " | sudo tee /etc/crictl.yaml" I0819 18:34:12.870746 3613 ssh_runner.go:149] Run: sudo systemctl unmask docker.service I0819 18:34:12.985674 3613 ssh_runner.go:149] Run: sudo systemctl enable docker.socket I0819 18:34:13.107572 3613 ssh_runner.go:149] Run: sudo systemctl daemon-reload I0819 18:34:13.260598 3613 ssh_runner.go:149] Run: sudo systemctl start docker I0819 18:34:13.272561 3613 ssh_runner.go:149] Run: docker version --format {{.Server.Version}} I0819 18:34:13.323510 3613 ssh_runner.go:149] Run: docker version --format {{.Server.Version}} I0819 18:34:13.389781 3613 out.go:192] 🐳 Preparing Kubernetes v1.21.2 on Docker 20.10.6 ... I0819 18:34:13.578404 3613 ssh_runner.go:149] Run: grep 192.168.99.1 host.minikube.internal$ /etc/hosts I0819 18:34:13.583056 3613 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.99.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts"" I0819 18:34:13.592563 3613 preload.go:134] Checking if preload exists for k8s version v1.21.2 and runtime docker I0819 18:34:13.592698 3613 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}} I0819 18:34:13.626949 3613 docker.go:535] Got preloaded images: -- stdout -- k8s.gcr.io/kube-apiserver:v1.21.2 k8s.gcr.io/kube-proxy:v1.21.2 k8s.gcr.io/kube-controller-manager:v1.21.2 k8s.gcr.io/kube-scheduler:v1.21.2 gcr.io/k8s-minikube/storage-provisioner:v5 k8s.gcr.io/pause:3.4.1 kubernetesui/dashboard:v2.1.0 k8s.gcr.io/coredns/coredns:v1.8.0 k8s.gcr.io/etcd:3.4.13-0 kubernetesui/metrics-scraper:v1.0.4 -- /stdout -- I0819 18:34:13.626978 3613 docker.go:466] Images already preloaded, skipping extraction I0819 18:34:13.627098 3613 ssh_runner.go:149] Run: docker images --format {{.Repository}}:{{.Tag}} I0819 18:34:13.664935 3613 docker.go:535] Got preloaded images: -- stdout -- k8s.gcr.io/kube-apiserver:v1.21.2 k8s.gcr.io/kube-controller-manager:v1.21.2 k8s.gcr.io/kube-proxy:v1.21.2 k8s.gcr.io/kube-scheduler:v1.21.2 gcr.io/k8s-minikube/storage-provisioner:v5 k8s.gcr.io/pause:3.4.1 kubernetesui/dashboard:v2.1.0 k8s.gcr.io/coredns/coredns:v1.8.0 k8s.gcr.io/etcd:3.4.13-0 kubernetesui/metrics-scraper:v1.0.4 -- /stdout -- I0819 18:34:13.664990 3613 cache_images.go:74] Images are preloaded, skipping loading I0819 18:34:13.665247 3613 ssh_runner.go:149] Run: docker info --format {{.CgroupDriver}} I0819 18:34:13.721535 3613 cni.go:93] Creating CNI manager for "" I0819 18:34:13.721548 3613 cni.go:167] CNI unnecessary in this configuration, recommending no CNI I0819 18:34:13.721565 3613 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16 I0819 18:34:13.721583 3613 kubeadm.go:153] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.99.101 APIServerPort:8443 KubernetesVersion:v1.21.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:minikube NodeName:minikube DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.99.101"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.99.101 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]} I0819 18:34:13.721748 3613 kubeadm.go:157] kubeadm config: apiVersion: kubeadm.k8s.io/v1beta2 kind: InitConfiguration localAPIEndpoint: advertiseAddress: 192.168.99.101 bindPort: 8443 bootstrapTokens: - groups: - system:bootstrappers:kubeadm:default-node-token ttl: 24h0m0s usages: - signing - authentication nodeRegistration: criSocket: /var/run/dockershim.sock name: "minikube" kubeletExtraArgs: node-ip: 192.168.99.101 taints: [] --- apiVersion: kubeadm.k8s.io/v1beta2 kind: ClusterConfiguration apiServer: certSANs: ["127.0.0.1", "localhost", "192.168.99.101"] extraArgs: enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota" controllerManager: extraArgs: allocate-node-cidrs: "true" leader-elect: "false" scheduler: extraArgs: leader-elect: "false" certificatesDir: /var/lib/minikube/certs clusterName: mk controlPlaneEndpoint: control-plane.minikube.internal:8443 dns: type: CoreDNS etcd: local: dataDir: /var/lib/minikube/etcd extraArgs: proxy-refresh-interval: "70000" kubernetesVersion: v1.21.2 networking: dnsDomain: cluster.local podSubnet: "10.244.0.0/16" serviceSubnet: 10.96.0.0/12 --- apiVersion: kubelet.config.k8s.io/v1beta1 kind: KubeletConfiguration authentication: x509: clientCAFile: /var/lib/minikube/certs/ca.crt cgroupDriver: systemd clusterDomain: "cluster.local" # disable disk resource management by default imageGCHighThresholdPercent: 100 evictionHard: nodefs.available: "0%!"(MISSING) nodefs.inodesFree: "0%!"(MISSING) imagefs.available: "0%!"(MISSING) failSwapOn: false staticPodPath: /etc/kubernetes/manifests --- apiVersion: kubeproxy.config.k8s.io/v1alpha1 kind: KubeProxyConfiguration clusterCIDR: "10.244.0.0/16" metricsBindAddress: 0.0.0.0:10249 conntrack: maxPerCore: 0 I0819 18:34:13.721964 3613 kubeadm.go:909] kubelet [Unit] Wants=docker.socket [Service] ExecStart= ExecStart=/var/lib/minikube/binaries/v1.21.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=minikube --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.99.101 [Install] config: {KubernetesVersion:v1.21.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} I0819 18:34:13.722115 3613 ssh_runner.go:149] Run: sudo ls /var/lib/minikube/binaries/v1.21.2 I0819 18:34:13.732675 3613 binaries.go:44] Found k8s binaries, skipping transfer I0819 18:34:13.732841 3613 ssh_runner.go:149] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube I0819 18:34:13.740714 3613 ssh_runner.go:316] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (336 bytes) I0819 18:34:13.752675 3613 ssh_runner.go:316] scp memory --> /lib/systemd/system/kubelet.service (352 bytes) I0819 18:34:13.762955 3613 ssh_runner.go:316] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (1872 bytes) I0819 18:34:13.774081 3613 ssh_runner.go:149] Run: grep 192.168.99.101 control-plane.minikube.internal$ /etc/hosts I0819 18:34:13.777739 3613 ssh_runner.go:149] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.99.101 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts"" I0819 18:34:13.787461 3613 certs.go:52] Setting up /Users/sde3/.minikube/profiles/minikube for IP: 192.168.99.101 I0819 18:34:13.787647 3613 certs.go:179] skipping minikubeCA CA generation: /Users/sde3/.minikube/ca.key I0819 18:34:13.787701 3613 certs.go:179] skipping proxyClientCA CA generation: /Users/sde3/.minikube/proxy-client-ca.key I0819 18:34:13.787777 3613 certs.go:294] generating minikube-user signed cert: /Users/sde3/.minikube/profiles/minikube/client.key I0819 18:34:13.787785 3613 crypto.go:69] Generating cert /Users/sde3/.minikube/profiles/minikube/client.crt with IP's: [] I0819 18:34:13.856274 3613 crypto.go:157] Writing cert to /Users/sde3/.minikube/profiles/minikube/client.crt ... I0819 18:34:13.856290 3613 lock.go:36] WriteFile acquiring /Users/sde3/.minikube/profiles/minikube/client.crt: {Name:mk82a018af8ffdadfca9abf143d62284f5c7d9af Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0819 18:34:13.856655 3613 crypto.go:165] Writing key to /Users/sde3/.minikube/profiles/minikube/client.key ... I0819 18:34:13.856664 3613 lock.go:36] WriteFile acquiring /Users/sde3/.minikube/profiles/minikube/client.key: {Name:mk1abf7451b1040b05818201d849023d574e81a3 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0819 18:34:13.856900 3613 certs.go:294] generating minikube signed cert: /Users/sde3/.minikube/profiles/minikube/apiserver.key.f5415961 I0819 18:34:13.856904 3613 crypto.go:69] Generating cert /Users/sde3/.minikube/profiles/minikube/apiserver.crt.f5415961 with IP's: [192.168.99.101 10.96.0.1 127.0.0.1 10.0.0.1] I0819 18:34:14.232061 3613 crypto.go:157] Writing cert to /Users/sde3/.minikube/profiles/minikube/apiserver.crt.f5415961 ... I0819 18:34:14.232076 3613 lock.go:36] WriteFile acquiring /Users/sde3/.minikube/profiles/minikube/apiserver.crt.f5415961: {Name:mk202beb461e2962a49b233d2da91d33a8e51505 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0819 18:34:14.234903 3613 crypto.go:165] Writing key to /Users/sde3/.minikube/profiles/minikube/apiserver.key.f5415961 ... I0819 18:34:14.234919 3613 lock.go:36] WriteFile acquiring /Users/sde3/.minikube/profiles/minikube/apiserver.key.f5415961: {Name:mk8b144bb7483a066fa66ba2318e76620fb39822 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0819 18:34:14.235949 3613 certs.go:305] copying /Users/sde3/.minikube/profiles/minikube/apiserver.crt.f5415961 -> /Users/sde3/.minikube/profiles/minikube/apiserver.crt I0819 18:34:14.236638 3613 certs.go:309] copying /Users/sde3/.minikube/profiles/minikube/apiserver.key.f5415961 -> /Users/sde3/.minikube/profiles/minikube/apiserver.key I0819 18:34:14.237946 3613 certs.go:294] generating aggregator signed cert: /Users/sde3/.minikube/profiles/minikube/proxy-client.key I0819 18:34:14.237963 3613 crypto.go:69] Generating cert /Users/sde3/.minikube/profiles/minikube/proxy-client.crt with IP's: [] I0819 18:34:14.688792 3613 crypto.go:157] Writing cert to /Users/sde3/.minikube/profiles/minikube/proxy-client.crt ... I0819 18:34:14.688811 3613 lock.go:36] WriteFile acquiring /Users/sde3/.minikube/profiles/minikube/proxy-client.crt: {Name:mk3fabeec80174357170438e7a6f1015db3b5e33 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0819 18:34:14.689183 3613 crypto.go:165] Writing key to /Users/sde3/.minikube/profiles/minikube/proxy-client.key ... I0819 18:34:14.689189 3613 lock.go:36] WriteFile acquiring /Users/sde3/.minikube/profiles/minikube/proxy-client.key: {Name:mk725a136b0e81f26810637474412a2f697f885e Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0819 18:34:14.689829 3613 certs.go:369] found cert: /Users/sde3/.minikube/certs/Users/sde3/.minikube/certs/ca-key.pem (1679 bytes) I0819 18:34:14.689910 3613 certs.go:369] found cert: /Users/sde3/.minikube/certs/Users/sde3/.minikube/certs/ca.pem (1070 bytes) I0819 18:34:14.689962 3613 certs.go:369] found cert: /Users/sde3/.minikube/certs/Users/sde3/.minikube/certs/cert.pem (1115 bytes) I0819 18:34:14.690007 3613 certs.go:369] found cert: /Users/sde3/.minikube/certs/Users/sde3/.minikube/certs/key.pem (1679 bytes) I0819 18:34:14.691105 3613 ssh_runner.go:316] scp /Users/sde3/.minikube/profiles/minikube/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes) I0819 18:34:14.705585 3613 ssh_runner.go:316] scp /Users/sde3/.minikube/profiles/minikube/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes) I0819 18:34:14.724345 3613 ssh_runner.go:316] scp /Users/sde3/.minikube/profiles/minikube/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes) I0819 18:34:14.742017 3613 ssh_runner.go:316] scp /Users/sde3/.minikube/profiles/minikube/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes) I0819 18:34:14.755729 3613 ssh_runner.go:316] scp /Users/sde3/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes) I0819 18:34:14.775472 3613 ssh_runner.go:316] scp /Users/sde3/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes) I0819 18:34:14.791136 3613 ssh_runner.go:316] scp /Users/sde3/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes) I0819 18:34:14.810706 3613 ssh_runner.go:316] scp /Users/sde3/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes) I0819 18:34:14.835580 3613 ssh_runner.go:316] scp /Users/sde3/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes) I0819 18:34:14.852822 3613 ssh_runner.go:316] scp memory --> /var/lib/minikube/kubeconfig (740 bytes) I0819 18:34:14.864331 3613 ssh_runner.go:149] Run: openssl version I0819 18:34:14.869976 3613 ssh_runner.go:149] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem" I0819 18:34:14.877015 3613 ssh_runner.go:149] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem I0819 18:34:14.880986 3613 certs.go:410] hashing: -rw-r--r-- 1 root root 1111 Aug 19 15:27 /usr/share/ca-certificates/minikubeCA.pem I0819 18:34:14.881091 3613 ssh_runner.go:149] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem I0819 18:34:14.886543 3613 ssh_runner.go:149] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0" I0819 18:34:14.892910 3613 kubeadm.go:390] StartCluster: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.22.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:4096 CPUs:3 DiskSize:20000 VMDriver: Driver:virtualbox HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.99.101 Port:8443 KubernetesVersion:v1.21.2 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false} I0819 18:34:14.893048 3613 ssh_runner.go:149] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}} I0819 18:34:14.928105 3613 ssh_runner.go:149] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd I0819 18:34:14.940942 3613 ssh_runner.go:149] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml I0819 18:34:14.949232 3613 ssh_runner.go:149] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf I0819 18:34:14.955007 3613 kubeadm.go:151] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2 stdout: stderr: ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory I0819 18:34:14.955030 3613 ssh_runner.go:240] Start: /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.21.2:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem" I0819 18:34:15.587608 3613 out.go:192] ▪ Generating certificates and keys ... I0819 18:34:19.165657 3613 out.go:192] ▪ Booting up control plane ... I0819 18:34:35.251136 3613 out.go:192] ▪ Configuring RBAC rules ... I0819 18:34:35.688509 3613 cni.go:93] Creating CNI manager for "" I0819 18:34:35.688519 3613 cni.go:167] CNI unnecessary in this configuration, recommending no CNI I0819 18:34:35.688547 3613 ssh_runner.go:149] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj" I0819 18:34:35.688707 3613 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig I0819 18:34:35.688707 3613 ssh_runner.go:149] Run: sudo /var/lib/minikube/binaries/v1.21.2/kubectl label nodes minikube.k8s.io/version=v1.22.0 minikube.k8s.io/commit=a03fbcf166e6f74ef224d4a63be4277d017bb62e minikube.k8s.io/name=minikube minikube.k8s.io/updated_at=2021_08_19T18_34_35_0700 --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig I0819 18:34:35.909652 3613 ops.go:34] apiserver oom_adj: -16 I0819 18:34:35.909693 3613 kubeadm.go:985] duration metric: took 221.119191ms to wait for elevateKubeSystemPrivileges. I0819 18:34:35.909705 3613 kubeadm.go:392] StartCluster complete in 21.016797369s I0819 18:34:35.909736 3613 settings.go:142] acquiring lock: {Name:mk1fc3f9cb95f413f31f7d9e6caf38bda4f907c5 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0819 18:34:35.909841 3613 settings.go:150] Updating kubeconfig: /Users/sde3/.kube/config I0819 18:34:35.910852 3613 lock.go:36] WriteFile acquiring /Users/sde3/.kube/config: {Name:mk4ecc95bfb01e9c1ecc9eafb8c26b892f0d564f Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0819 18:34:36.451082 3613 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "minikube" rescaled to 1 I0819 18:34:36.451128 3613 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml" I0819 18:34:36.451122 3613 start.go:220] Will wait 6m0s for node &{Name: IP:192.168.99.101 Port:8443 KubernetesVersion:v1.21.2 ControlPlane:true Worker:true} I0819 18:34:36.463134 3613 out.go:165] 🔎 Verifying Kubernetes components... I0819 18:34:36.451171 3613 addons.go:342] enableAddons start: toEnable=map[], additional=[] I0819 18:34:36.463241 3613 addons.go:59] Setting storage-provisioner=true in profile "minikube" I0819 18:34:36.463258 3613 addons.go:135] Setting addon storage-provisioner=true in "minikube" W0819 18:34:36.463262 3613 addons.go:147] addon storage-provisioner should already be in state true I0819 18:34:36.463258 3613 addons.go:59] Setting default-storageclass=true in profile "minikube" I0819 18:34:36.463286 3613 host.go:66] Checking if "minikube" exists ... I0819 18:34:36.463294 3613 ssh_runner.go:149] Run: sudo systemctl is-active --quiet service kubelet I0819 18:34:36.463283 3613 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "minikube" I0819 18:34:36.463912 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage showvminfo minikube --machinereadable I0819 18:34:36.466266 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage showvminfo minikube --machinereadable I0819 18:34:36.613315 3613 main.go:130] libmachine: STDOUT: { name="minikube" groups="/" ostype="Linux 2.6 / 3.x / 4.x (64-bit)" UUID="c920483a-6afe-428f-ba48-e3f81db2be7c" CfgFile="/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox" SnapFldr="/Users/sde3/.minikube/machines/minikube/minikube/Snapshots" LogFldr="/Users/sde3/.minikube/machines/minikube/minikube/Logs" hardwareuuid="c920483a-6afe-428f-ba48-e3f81db2be7c" memory=4096 pagefusion="off" vram=8 cpuexecutioncap=100 hpet="on" cpu-profile="host" chipset="piix3" firmware="BIOS" cpus=3 pae="on" longmode="on" triplefaultreset="off" apic="on" x2apic="off" nested-hw-virt="off" cpuid-portability-level=0 bootmenu="disabled" boot1="dvd" boot2="dvd" boot3="disk" boot4="none" acpi="on" ioapic="on" biosapic="apic" biossystemtimeoffset=0 rtcuseutc="on" hwvirtex="on" nestedpaging="on" largepages="on" vtxvpid="on" vtxux="on" paravirtprovider="default" effparavirtprovider="kvm" VMState="running" VMStateChangeTime="2021-08-19T15:32:34.902000000" graphicscontroller="vboxvga" monitorcount=1 accelerate3d="off" accelerate2dvideo="off" teleporterenabled="off" teleporterport=0 teleporteraddress="" teleporterpassword="" tracing-enabled="off" tracing-allow-vm-access="off" tracing-config="" autostart-enabled="off" autostart-delay=0 defaultfrontend="" vmprocpriority="default" storagecontrollername0="SATA" storagecontrollertype0="IntelAhci" storagecontrollerinstance0="0" storagecontrollermaxportcount0="30" storagecontrollerportcount0="30" storagecontrollerbootable0="on" "SATA-0-0"="/Users/sde3/.minikube/machines/minikube/boot2docker.iso" "SATA-ImageUUID-0-0"="e19bbcd1-04d1-4c45-b05a-07bf985467e0" "SATA-tempeject"="off" "SATA-IsEjected"="off" "SATA-1-0"="/Users/sde3/.minikube/machines/minikube/disk.vmdk" "SATA-ImageUUID-1-0"="adc5121f-6e26-48ab-ba4b-ca777f440673" "SATA-2-0"="none" "SATA-3-0"="none" "SATA-4-0"="none" "SATA-5-0"="none" "SATA-6-0"="none" "SATA-7-0"="none" "SATA-8-0"="none" "SATA-9-0"="none" "SATA-10-0"="none" "SATA-11-0"="none" "SATA-12-0"="none" "SATA-13-0"="none" "SATA-14-0"="none" "SATA-15-0"="none" "SATA-16-0"="none" "SATA-17-0"="none" "SATA-18-0"="none" "SATA-19-0"="none" "SATA-20-0"="none" "SATA-21-0"="none" "SATA-22-0"="none" "SATA-23-0"="none" "SATA-24-0"="none" "SATA-25-0"="none" "SATA-26-0"="none" "SATA-27-0"="none" "SATA-28-0"="none" "SATA-29-0"="none" natnet1="nat" macaddress1="080027DC3858" cableconnected1="on" nic1="nat" nictype1="virtio" nicspeed1="0" mtu="0" sockSnd="64" sockRcv="64" tcpWndSnd="64" tcpWndRcv="64" Forwarding(0)="ssh,tcp,127.0.0.1,49545,,22" hostonlyadapter2="vboxnet0" macaddress2="080027AFB224" cableconnected2="on" nic2="hostonly" nictype2="virtio" nicspeed2="0" nic3="none" nic4="none" nic5="none" nic6="none" nic7="none" nic8="none" hidpointing="ps2mouse" hidkeyboard="ps2kbd" uart1="off" uart2="off" uart3="off" uart4="off" lpt1="off" lpt2="off" audio="coreaudio" audio_out="off" audio_in="off" clipboard="disabled" draganddrop="disabled" SessionName="headless" VideoMode="720,400,0"@0,0 1 vrde="off" usb="off" ehci="off" xhci="off" SharedFolderNameMachineMapping1="Users" SharedFolderPathMachineMapping1="/Users" VRDEActiveConnection="off" VRDEClients==0 videocap="off" videocapaudio="off" capturescreens="" capturefilename="/Users/sde3/.minikube/machines/minikube/minikube/minikube.webm" captureres="1024x768" capturevideorate=512 capturevideofps=25 captureopts="" GuestMemoryBalloon=0 GuestOSType="Linux26_64" GuestAdditionsRunLevel=2 GuestAdditionsVersion="5.2.42 r137960" GuestAdditionsFacility_VirtualBox Base Driver=50,1629387175471 GuestAdditionsFacility_VirtualBox System Service=50,1629387175811 GuestAdditionsFacility_Seamless Mode=0,1629387176738 GuestAdditionsFacility_Graphics Mode=0,1629387175471 } I0819 18:34:36.613355 3613 main.go:130] libmachine: STDERR: { } I0819 18:34:36.616110 3613 main.go:130] libmachine: STDOUT: { name="minikube" groups="/" ostype="Linux 2.6 / 3.x / 4.x (64-bit)" UUID="c920483a-6afe-428f-ba48-e3f81db2be7c" CfgFile="/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox" SnapFldr="/Users/sde3/.minikube/machines/minikube/minikube/Snapshots" LogFldr="/Users/sde3/.minikube/machines/minikube/minikube/Logs" hardwareuuid="c920483a-6afe-428f-ba48-e3f81db2be7c" memory=4096 pagefusion="off" vram=8 cpuexecutioncap=100 hpet="on" cpu-profile="host" chipset="piix3" firmware="BIOS" cpus=3 pae="on" longmode="on" triplefaultreset="off" apic="on" x2apic="off" nested-hw-virt="off" cpuid-portability-level=0 bootmenu="disabled" boot1="dvd" boot2="dvd" boot3="disk" boot4="none" acpi="on" ioapic="on" biosapic="apic" biossystemtimeoffset=0 rtcuseutc="on" hwvirtex="on" nestedpaging="on" largepages="on" vtxvpid="on" vtxux="on" paravirtprovider="default" effparavirtprovider="kvm" VMState="running" VMStateChangeTime="2021-08-19T15:32:34.902000000" graphicscontroller="vboxvga" monitorcount=1 accelerate3d="off" accelerate2dvideo="off" teleporterenabled="off" teleporterport=0 teleporteraddress="" teleporterpassword="" tracing-enabled="off" tracing-allow-vm-access="off" tracing-config="" autostart-enabled="off" autostart-delay=0 defaultfrontend="" vmprocpriority="default" storagecontrollername0="SATA" storagecontrollertype0="IntelAhci" storagecontrollerinstance0="0" storagecontrollermaxportcount0="30" storagecontrollerportcount0="30" storagecontrollerbootable0="on" "SATA-0-0"="/Users/sde3/.minikube/machines/minikube/boot2docker.iso" "SATA-ImageUUID-0-0"="e19bbcd1-04d1-4c45-b05a-07bf985467e0" "SATA-tempeject"="off" "SATA-IsEjected"="off" "SATA-1-0"="/Users/sde3/.minikube/machines/minikube/disk.vmdk" "SATA-ImageUUID-1-0"="adc5121f-6e26-48ab-ba4b-ca777f440673" "SATA-2-0"="none" "SATA-3-0"="none" "SATA-4-0"="none" "SATA-5-0"="none" "SATA-6-0"="none" "SATA-7-0"="none" "SATA-8-0"="none" "SATA-9-0"="none" "SATA-10-0"="none" "SATA-11-0"="none" "SATA-12-0"="none" "SATA-13-0"="none" "SATA-14-0"="none" "SATA-15-0"="none" "SATA-16-0"="none" "SATA-17-0"="none" "SATA-18-0"="none" "SATA-19-0"="none" "SATA-20-0"="none" "SATA-21-0"="none" "SATA-22-0"="none" "SATA-23-0"="none" "SATA-24-0"="none" "SATA-25-0"="none" "SATA-26-0"="none" "SATA-27-0"="none" "SATA-28-0"="none" "SATA-29-0"="none" natnet1="nat" macaddress1="080027DC3858" cableconnected1="on" nic1="nat" nictype1="virtio" nicspeed1="0" mtu="0" sockSnd="64" sockRcv="64" tcpWndSnd="64" tcpWndRcv="64" Forwarding(0)="ssh,tcp,127.0.0.1,49545,,22" hostonlyadapter2="vboxnet0" macaddress2="080027AFB224" cableconnected2="on" nic2="hostonly" nictype2="virtio" nicspeed2="0" nic3="none" nic4="none" nic5="none" nic6="none" nic7="none" nic8="none" hidpointing="ps2mouse" hidkeyboard="ps2kbd" uart1="off" uart2="off" uart3="off" uart4="off" lpt1="off" lpt2="off" audio="coreaudio" audio_out="off" audio_in="off" clipboard="disabled" draganddrop="disabled" SessionName="headless" VideoMode="720,400,0"@0,0 1 vrde="off" usb="off" ehci="off" xhci="off" SharedFolderNameMachineMapping1="Users" SharedFolderPathMachineMapping1="/Users" VRDEActiveConnection="off" VRDEClients==0 videocap="off" videocapaudio="off" capturescreens="" capturefilename="/Users/sde3/.minikube/machines/minikube/minikube/minikube.webm" captureres="1024x768" capturevideorate=512 capturevideofps=25 captureopts="" GuestMemoryBalloon=0 GuestOSType="Linux26_64" GuestAdditionsRunLevel=2 GuestAdditionsVersion="5.2.42 r137960" GuestAdditionsFacility_VirtualBox Base Driver=50,1629387175471 GuestAdditionsFacility_VirtualBox System Service=50,1629387175811 GuestAdditionsFacility_Seamless Mode=0,1629387176738 GuestAdditionsFacility_Graphics Mode=0,1629387175471 } I0819 18:34:36.630251 3613 out.go:165] ▪ Using image gcr.io/k8s-minikube/storage-provisioner:v5 I0819 18:34:36.630327 3613 main.go:130] libmachine: STDERR: { } I0819 18:34:36.630561 3613 addons.go:275] installing /etc/kubernetes/addons/storage-provisioner.yaml I0819 18:34:36.630571 3613 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes) I0819 18:34:36.630592 3613 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49545 SSHKeyPath:/Users/sde3/.minikube/machines/minikube/id_rsa Username:docker} I0819 18:34:36.642913 3613 addons.go:135] Setting addon default-storageclass=true in "minikube" W0819 18:34:36.642921 3613 addons.go:147] addon default-storageclass should already be in state true I0819 18:34:36.642938 3613 host.go:66] Checking if "minikube" exists ... I0819 18:34:36.643363 3613 main.go:130] libmachine: COMMAND: /usr/local/bin/VBoxManage showvminfo minikube --machinereadable I0819 18:34:36.756239 3613 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml I0819 18:34:36.788833 3613 main.go:130] libmachine: STDOUT: { name="minikube" groups="/" ostype="Linux 2.6 / 3.x / 4.x (64-bit)" UUID="c920483a-6afe-428f-ba48-e3f81db2be7c" CfgFile="/Users/sde3/.minikube/machines/minikube/minikube/minikube.vbox" SnapFldr="/Users/sde3/.minikube/machines/minikube/minikube/Snapshots" LogFldr="/Users/sde3/.minikube/machines/minikube/minikube/Logs" hardwareuuid="c920483a-6afe-428f-ba48-e3f81db2be7c" memory=4096 pagefusion="off" vram=8 cpuexecutioncap=100 hpet="on" cpu-profile="host" chipset="piix3" firmware="BIOS" cpus=3 pae="on" longmode="on" triplefaultreset="off" apic="on" x2apic="off" nested-hw-virt="off" cpuid-portability-level=0 bootmenu="disabled" boot1="dvd" boot2="dvd" boot3="disk" boot4="none" acpi="on" ioapic="on" biosapic="apic" biossystemtimeoffset=0 rtcuseutc="on" hwvirtex="on" nestedpaging="on" largepages="on" vtxvpid="on" vtxux="on" paravirtprovider="default" effparavirtprovider="kvm" VMState="running" VMStateChangeTime="2021-08-19T15:32:34.902000000" graphicscontroller="vboxvga" monitorcount=1 accelerate3d="off" accelerate2dvideo="off" teleporterenabled="off" teleporterport=0 teleporteraddress="" teleporterpassword="" tracing-enabled="off" tracing-allow-vm-access="off" tracing-config="" autostart-enabled="off" autostart-delay=0 defaultfrontend="" vmprocpriority="default" storagecontrollername0="SATA" storagecontrollertype0="IntelAhci" storagecontrollerinstance0="0" storagecontrollermaxportcount0="30" storagecontrollerportcount0="30" storagecontrollerbootable0="on" "SATA-0-0"="/Users/sde3/.minikube/machines/minikube/boot2docker.iso" "SATA-ImageUUID-0-0"="e19bbcd1-04d1-4c45-b05a-07bf985467e0" "SATA-tempeject"="off" "SATA-IsEjected"="off" "SATA-1-0"="/Users/sde3/.minikube/machines/minikube/disk.vmdk" "SATA-ImageUUID-1-0"="adc5121f-6e26-48ab-ba4b-ca777f440673" "SATA-2-0"="none" "SATA-3-0"="none" "SATA-4-0"="none" "SATA-5-0"="none" "SATA-6-0"="none" "SATA-7-0"="none" "SATA-8-0"="none" "SATA-9-0"="none" "SATA-10-0"="none" "SATA-11-0"="none" "SATA-12-0"="none" "SATA-13-0"="none" "SATA-14-0"="none" "SATA-15-0"="none" "SATA-16-0"="none" "SATA-17-0"="none" "SATA-18-0"="none" "SATA-19-0"="none" "SATA-20-0"="none" "SATA-21-0"="none" "SATA-22-0"="none" "SATA-23-0"="none" "SATA-24-0"="none" "SATA-25-0"="none" "SATA-26-0"="none" "SATA-27-0"="none" "SATA-28-0"="none" "SATA-29-0"="none" natnet1="nat" macaddress1="080027DC3858" cableconnected1="on" nic1="nat" nictype1="virtio" nicspeed1="0" mtu="0" sockSnd="64" sockRcv="64" tcpWndSnd="64" tcpWndRcv="64" Forwarding(0)="ssh,tcp,127.0.0.1,49545,,22" hostonlyadapter2="vboxnet0" macaddress2="080027AFB224" cableconnected2="on" nic2="hostonly" nictype2="virtio" nicspeed2="0" nic3="none" nic4="none" nic5="none" nic6="none" nic7="none" nic8="none" hidpointing="ps2mouse" hidkeyboard="ps2kbd" uart1="off" uart2="off" uart3="off" uart4="off" lpt1="off" lpt2="off" audio="coreaudio" audio_out="off" audio_in="off" clipboard="disabled" draganddrop="disabled" SessionName="headless" VideoMode="720,400,0"@0,0 1 vrde="off" usb="off" ehci="off" xhci="off" SharedFolderNameMachineMapping1="Users" SharedFolderPathMachineMapping1="/Users" VRDEActiveConnection="off" VRDEClients==0 videocap="off" videocapaudio="off" capturescreens="" capturefilename="/Users/sde3/.minikube/machines/minikube/minikube/minikube.webm" captureres="1024x768" capturevideorate=512 capturevideofps=25 captureopts="" GuestMemoryBalloon=0 GuestOSType="Linux26_64" GuestAdditionsRunLevel=2 GuestAdditionsVersion="5.2.42 r137960" GuestAdditionsFacility_VirtualBox Base Driver=50,1629387175471 GuestAdditionsFacility_VirtualBox System Service=50,1629387175811 GuestAdditionsFacility_Seamless Mode=0,1629387176738 GuestAdditionsFacility_Graphics Mode=0,1629387175471 } I0819 18:34:36.788848 3613 main.go:130] libmachine: STDERR: { } I0819 18:34:36.788956 3613 addons.go:275] installing /etc/kubernetes/addons/storageclass.yaml I0819 18:34:36.788961 3613 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes) I0819 18:34:36.788970 3613 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49545 SSHKeyPath:/Users/sde3/.minikube/machines/minikube/id_rsa Username:docker} I0819 18:34:36.805496 3613 ssh_runner.go:149] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.99.1 host.minikube.internal\n fallthrough\n }' | sudo /var/lib/minikube/binaries/v1.21.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -" I0819 18:34:36.812111 3613 api_server.go:50] waiting for apiserver process to appear ... I0819 18:34:36.812188 3613 ssh_runner.go:149] Run: sudo pgrep -xnf kube-apiserver.*minikube.* I0819 18:34:36.869316 3613 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml I0819 18:34:37.368342 3613 start.go:730] {"host.minikube.internal": 192.168.99.1} host record injected into CoreDNS I0819 18:34:37.368385 3613 api_server.go:70] duration metric: took 917.235531ms to wait for apiserver process to appear ... I0819 18:34:37.368411 3613 api_server.go:86] waiting for apiserver healthz status ... I0819 18:34:37.368434 3613 api_server.go:239] Checking apiserver healthz at https://192.168.99.101:8443/healthz ... I0819 18:34:37.383575 3613 api_server.go:265] https://192.168.99.101:8443/healthz returned 200: ok I0819 18:34:37.384970 3613 api_server.go:139] control plane version: v1.21.2 I0819 18:34:37.384982 3613 api_server.go:129] duration metric: took 16.564606ms to wait for apiserver health ... I0819 18:34:37.384996 3613 system_pods.go:43] waiting for kube-system pods to appear ... I0819 18:34:37.403727 3613 system_pods.go:59] 5 kube-system pods found I0819 18:34:37.403747 3613 system_pods.go:61] "etcd-minikube" [67ecb7be-e9da-47d6-9403-b9f3f7a34762] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd]) I0819 18:34:37.403750 3613 system_pods.go:61] "kube-apiserver-minikube" [9d0654d2-c0ba-4d64-8909-2f344e988c1f] Pending I0819 18:34:37.403755 3613 system_pods.go:61] "kube-controller-manager-minikube" [24a062ff-8fe2-4798-b0ac-761cb16e312a] Pending I0819 18:34:37.403757 3613 system_pods.go:61] "kube-scheduler-minikube" [0a032085-3742-4248-9fc7-af3755d63a49] Pending I0819 18:34:37.403761 3613 system_pods.go:61] "storage-provisioner" [f57511d6-0000-447a-b9db-39f369626334] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.) I0819 18:34:37.403766 3613 system_pods.go:74] duration metric: took 18.767409ms to wait for pod list to return data ... I0819 18:34:37.403773 3613 kubeadm.go:547] duration metric: took 952.63092ms to wait for : map[apiserver:true system_pods:true] ... I0819 18:34:37.403789 3613 node_conditions.go:102] verifying NodePressure condition ... I0819 18:34:37.415708 3613 node_conditions.go:122] node storage ephemeral capacity is 17784752Ki I0819 18:34:37.415732 3613 node_conditions.go:123] node cpu capacity is 3 I0819 18:34:37.415755 3613 node_conditions.go:105] duration metric: took 11.960504ms to run NodePressure ... I0819 18:34:37.415765 3613 start.go:225] waiting for startup goroutines ... I0819 18:34:37.440410 3613 out.go:165] 🌟 Enabled addons: storage-provisioner, default-storageclass I0819 18:34:37.440449 3613 addons.go:344] enableAddons completed in 989.299034ms I0819 18:34:37.502702 3613 start.go:462] kubectl: 1.22.0, cluster: 1.21.2 (minor skew: 1) I0819 18:34:37.514141 3613 out.go:165] 🏄 Done! kubectl is now configured to use "minikube" cluster and "default" namespace by default ==> Docker <== -- Logs begin at Thu 2021-08-19 15:32:55 UTC, end at Thu 2021-08-19 15:49:45 UTC. -- Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.992384782Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1 Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.992540364Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1 Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.992575889Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1 Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.992589882Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1 Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.992601005Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1 Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.992612772Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1 Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.992624477Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1 Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.992635578Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1 Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.992646382Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1 Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.992657376Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1 Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.992686642Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1 Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.992701087Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1 Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.992712603Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1 Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.992725069Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1 Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.992954292Z" level=info msg=serving... address=/var/run/docker/containerd/containerd-debug.sock Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.993021990Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock.ttrpc Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.993054996Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock Aug 19 15:34:11 minikube dockerd[2717]: time="2021-08-19T15:34:11.993067689Z" level=info msg="containerd successfully booted in 0.030773s" Aug 19 15:34:11 minikube dockerd[2709]: time="2021-08-19T15:34:11.998700395Z" level=info msg="parsed scheme: \"unix\"" module=grpc Aug 19 15:34:11 minikube dockerd[2709]: time="2021-08-19T15:34:11.998737035Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc Aug 19 15:34:11 minikube dockerd[2709]: time="2021-08-19T15:34:11.998799702Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock 0 }] }" module=grpc Aug 19 15:34:11 minikube dockerd[2709]: time="2021-08-19T15:34:11.998812862Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc Aug 19 15:34:11 minikube dockerd[2709]: time="2021-08-19T15:34:11.999844484Z" level=info msg="parsed scheme: \"unix\"" module=grpc Aug 19 15:34:11 minikube dockerd[2709]: time="2021-08-19T15:34:11.999871916Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc Aug 19 15:34:11 minikube dockerd[2709]: time="2021-08-19T15:34:11.999887563Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock 0 }] }" module=grpc Aug 19 15:34:11 minikube dockerd[2709]: time="2021-08-19T15:34:11.999898498Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc Aug 19 15:34:12 minikube dockerd[2709]: time="2021-08-19T15:34:12.360325365Z" level=warning msg="Your kernel does not support cgroup blkio weight" Aug 19 15:34:12 minikube dockerd[2709]: time="2021-08-19T15:34:12.360360964Z" level=warning msg="Your kernel does not support cgroup blkio weight_device" Aug 19 15:34:12 minikube dockerd[2709]: time="2021-08-19T15:34:12.360367500Z" level=warning msg="Your kernel does not support cgroup blkio throttle.read_bps_device" Aug 19 15:34:12 minikube dockerd[2709]: time="2021-08-19T15:34:12.360372631Z" level=warning msg="Your kernel does not support cgroup blkio throttle.write_bps_device" Aug 19 15:34:12 minikube dockerd[2709]: time="2021-08-19T15:34:12.360378317Z" level=warning msg="Your kernel does not support cgroup blkio throttle.read_iops_device" Aug 19 15:34:12 minikube dockerd[2709]: time="2021-08-19T15:34:12.360383380Z" level=warning msg="Your kernel does not support cgroup blkio throttle.write_iops_device" Aug 19 15:34:12 minikube dockerd[2709]: time="2021-08-19T15:34:12.360654202Z" level=info msg="Loading containers: start." Aug 19 15:34:12 minikube dockerd[2709]: time="2021-08-19T15:34:12.640199379Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address" Aug 19 15:34:12 minikube dockerd[2709]: time="2021-08-19T15:34:12.740583582Z" level=info msg="Loading containers: done." Aug 19 15:34:12 minikube dockerd[2709]: time="2021-08-19T15:34:12.771345987Z" level=info msg="Docker daemon" commit=8728dd2 graphdriver(s)=overlay2 version=20.10.6 Aug 19 15:34:12 minikube dockerd[2709]: time="2021-08-19T15:34:12.771407816Z" level=info msg="Daemon has completed initialization" Aug 19 15:34:12 minikube systemd[1]: Started Docker Application Container Engine. Aug 19 15:34:12 minikube dockerd[2709]: time="2021-08-19T15:34:12.803480129Z" level=info msg="API listen on [::]:2376" Aug 19 15:34:12 minikube dockerd[2709]: time="2021-08-19T15:34:12.810717935Z" level=info msg="API listen on /var/run/docker.sock" Aug 19 15:34:25 minikube dockerd[2717]: time="2021-08-19T15:34:25.697786470Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/1ab0a0d9c30f616b40e5a7bb5a86edc1578ab33f829a608823c4cd4c818ce4f6 pid=3673 Aug 19 15:34:25 minikube dockerd[2717]: time="2021-08-19T15:34:25.718283948Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/363ba9cb5c9ea90297a586b583d63a5c1dd97ebc0a343a65a65b983b62440087 pid=3698 Aug 19 15:34:25 minikube dockerd[2717]: time="2021-08-19T15:34:25.885169754Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/a4addf16b7dde33a8abbade5ac5ffecdd7a4ab24641ed88bb9e657a74cf49fe8 pid=3757 Aug 19 15:34:25 minikube dockerd[2717]: time="2021-08-19T15:34:25.998646299Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/67c61e8dbdc4c112c3e9888f7a3694cc6ca5b4e2dad2d5784d7eb125cadd0a0f pid=3817 Aug 19 15:34:26 minikube dockerd[2717]: time="2021-08-19T15:34:26.549458184Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/1a5de026d8cfd23605ff1ca76fe22659359179eebf714983849af868a02d76ab pid=3913 Aug 19 15:34:26 minikube dockerd[2717]: time="2021-08-19T15:34:26.591797103Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/e4bfca006cb9ca264c0925fb24066d512213eb439ae1f194d3c9388eb028744a pid=3938 Aug 19 15:34:26 minikube dockerd[2717]: time="2021-08-19T15:34:26.669219627Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/ebbe76ab29ab7ed3d3aaa5986249465a11380f546c80715e9a25e7c5ec1a610b pid=3968 Aug 19 15:34:26 minikube dockerd[2717]: time="2021-08-19T15:34:26.785965200Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/fbc1623393d29763163510aa40214e351447657a06e0ce5e532a59b18406f101 pid=4039 Aug 19 15:34:50 minikube dockerd[2717]: time="2021-08-19T15:34:50.077194123Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/00d9c2e5288e283b41443790aad41d677459bac55a6b35d43f34d2e455511073 pid=4975 Aug 19 15:34:50 minikube dockerd[2717]: time="2021-08-19T15:34:50.337243923Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/ee64f526cc358050b662842cda88db990acaf35ce2e9fd25ac892ddf3846b790 pid=5028 Aug 19 15:34:50 minikube dockerd[2717]: time="2021-08-19T15:34:50.413725027Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/784a66bb6fa759db988a928a6826ddac53c66596acd81c046087193386eef583 pid=5063 Aug 19 15:34:51 minikube dockerd[2717]: time="2021-08-19T15:34:51.104802742Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/0efac7b06e6bdd9dba1f71221930e16902ecb63845ac28c590f4c4ca310d6ff3 pid=5224 Aug 19 15:34:51 minikube dockerd[2717]: time="2021-08-19T15:34:51.906103989Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/4de31d63869be2c243216a55903137ec1b796eafd165f6a8ffe8b9ff27ecdf9c pid=5286 Aug 19 15:34:52 minikube dockerd[2717]: time="2021-08-19T15:34:52.416232727Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/e3fb939149cad329e7aead9499239a6dcd7f615730bca37dc3619cc57868d298 pid=5329 Aug 19 15:46:40 minikube dockerd[2717]: time="2021-08-19T15:46:40.473679353Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/32238e1ec1f97e25a9c87275b1edef24ed913db3643b62b5e2ad7510a315f250 pid=9101 Aug 19 15:47:12 minikube dockerd[2717]: time="2021-08-19T15:47:12.564554198Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/1923fb2f47f8085d8a568401ff74dc6f70d518fe2790ddce5686f6c64422ec5d pid=9385 Aug 19 15:47:46 minikube dockerd[2717]: time="2021-08-19T15:47:46.642581099Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/11d14bbb589f41b79297f445b5f72b92d9db63c3558a13092558894f050425c5 pid=9912 Aug 19 15:47:48 minikube dockerd[2717]: time="2021-08-19T15:47:48.343584126Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/f8813265c69b1ed4804bf8d718f4abb692dcd0cc68aacfea4ff2686214092540 pid=9982 Aug 19 15:48:52 minikube dockerd[2717]: time="2021-08-19T15:48:52.687473619Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/6eb0236ebe6a93a9e85dd3754158f95bd91b0aac2188e1aae0b21aaa759002f3 pid=11461 Aug 19 15:48:54 minikube dockerd[2717]: time="2021-08-19T15:48:54.353732352Z" level=info msg="starting signal loop" namespace=moby path=/run/docker/containerd/daemon/io.containerd.runtime.v2.task/moby/b508819d52cf610de162921f10dc5d672459dc8ca520e80757833ce0c1740f09 pid=11569 ==> container status <== CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID b508819d52cf6 gcr.io/google-samples/cassandra@sha256:7a3d20afa0a46ed073a5c587b4f37e21fa860e83c60b9c42fec1e1e739d64007 51 seconds ago Running cassandra 0 6eb0236ebe6a9 f8813265c69b1 gcr.io/google-samples/cassandra@sha256:7a3d20afa0a46ed073a5c587b4f37e21fa860e83c60b9c42fec1e1e739d64007 About a minute ago Running cassandra 0 11d14bbb589f4 1923fb2f47f80 gcr.io/google-samples/cassandra@sha256:7a3d20afa0a46ed073a5c587b4f37e21fa860e83c60b9c42fec1e1e739d64007 2 minutes ago Running cassandra 0 32238e1ec1f97 e3fb939149cad 6e38f40d628db 14 minutes ago Running storage-provisioner 0 4de31d63869be 0efac7b06e6bd 296a6d5035e2d 14 minutes ago Running coredns 0 784a66bb6fa75 ee64f526cc358 a6ebd1c1ad981 14 minutes ago Running kube-proxy 0 00d9c2e5288e2 fbc1623393d29 ae24db9aa2cc0 15 minutes ago Running kube-controller-manager 0 67c61e8dbdc4c e4bfca006cb9c 106ff58d43082 15 minutes ago Running kube-apiserver 0 a4addf16b7dde ebbe76ab29ab7 0369cf4303ffd 15 minutes ago Running etcd 0 363ba9cb5c9ea 1a5de026d8cfd f917b8c8f55b7 15 minutes ago Running kube-scheduler 0 1ab0a0d9c30f6 ==> coredns [0efac7b06e6b] <== .:53 [INFO] plugin/reload: Running configuration MD5 = fdf6a6d628bad4e1b40979090ddbccba CoreDNS-1.8.0 linux/amd64, go1.15.3, 054c9ae ==> describe nodes <== Name: minikube Roles: control-plane,master Labels: beta.kubernetes.io/arch=amd64 beta.kubernetes.io/os=linux kubernetes.io/arch=amd64 kubernetes.io/hostname=minikube kubernetes.io/os=linux minikube.k8s.io/commit=a03fbcf166e6f74ef224d4a63be4277d017bb62e minikube.k8s.io/name=minikube minikube.k8s.io/updated_at=2021_08_19T18_34_35_0700 minikube.k8s.io/version=v1.22.0 node-role.kubernetes.io/control-plane= node-role.kubernetes.io/master= node.kubernetes.io/exclude-from-external-load-balancers= Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock node.alpha.kubernetes.io/ttl: 0 volumes.kubernetes.io/controller-managed-attach-detach: true CreationTimestamp: Thu, 19 Aug 2021 15:34:32 +0000 Taints: Unschedulable: false Lease: HolderIdentity: minikube AcquireTime: RenewTime: Thu, 19 Aug 2021 15:49:46 +0000 Conditions: Type Status LastHeartbeatTime LastTransitionTime Reason Message ---- ------ ----------------- ------------------ ------ ------- MemoryPressure False Thu, 19 Aug 2021 15:47:42 +0000 Thu, 19 Aug 2021 15:34:28 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available DiskPressure False Thu, 19 Aug 2021 15:47:42 +0000 Thu, 19 Aug 2021 15:34:28 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure PIDPressure False Thu, 19 Aug 2021 15:47:42 +0000 Thu, 19 Aug 2021 15:34:28 +0000 KubeletHasSufficientPID kubelet has sufficient PID available Ready True Thu, 19 Aug 2021 15:47:42 +0000 Thu, 19 Aug 2021 15:34:46 +0000 KubeletReady kubelet is posting ready status Addresses: InternalIP: 192.168.99.101 Hostname: minikube Capacity: cpu: 3 ephemeral-storage: 17784752Ki hugepages-2Mi: 0 memory: 4033220Ki pods: 110 Allocatable: cpu: 3 ephemeral-storage: 17784752Ki hugepages-2Mi: 0 memory: 4033220Ki pods: 110 System Info: Machine ID: 48fac4bca20f42b69baa6fa4c3b7d9d8 System UUID: 3a4820c9-fe6a-8f42-ba48-e3f81db2be7c Boot ID: f3712302-7d65-4008-ba0c-4ee19c931f47 Kernel Version: 4.19.182 OS Image: Buildroot 2020.02.12 Operating System: linux Architecture: amd64 Container Runtime Version: docker://20.10.6 Kubelet Version: v1.21.2 Kube-Proxy Version: v1.21.2 PodCIDR: 10.244.0.0/24 PodCIDRs: 10.244.0.0/24 Non-terminated Pods: (10 in total) Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age --------- ---- ------------ ---------- --------------- ------------- --- default cassandra-0 500m (16%!)(MISSING) 500m (16%!)(MISSING) 1Gi (25%!)(MISSING) 1Gi (25%!)(MISSING) 3m8s default cassandra-1 500m (16%!)(MISSING) 500m (16%!)(MISSING) 1Gi (25%!)(MISSING) 1Gi (25%!)(MISSING) 2m2s default cassandra-2 500m (16%!)(MISSING) 500m (16%!)(MISSING) 1Gi (25%!)(MISSING) 1Gi (25%!)(MISSING) 56s kube-system coredns-558bd4d5db-xrk2l 100m (3%!)(MISSING) 0 (0%!)(MISSING) 70Mi (1%!)(MISSING) 170Mi (4%!)(MISSING) 14m kube-system etcd-minikube 100m (3%!)(MISSING) 0 (0%!)(MISSING) 100Mi (2%!)(MISSING) 0 (0%!)(MISSING) 15m kube-system kube-apiserver-minikube 250m (8%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 15m kube-system kube-controller-manager-minikube 200m (6%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 15m kube-system kube-proxy-tfq2x 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 14m kube-system kube-scheduler-minikube 100m (3%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 15m kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 15m Allocated resources: (Total limits may be over 100 percent, i.e., overcommitted.) Resource Requests Limits -------- -------- ------ cpu 2250m (75%!)(MISSING) 1500m (50%!)(MISSING) memory 3242Mi (82%!)(MISSING) 3242Mi (82%!)(MISSING) ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING) hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING) Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal NodeHasSufficientMemory 15m (x5 over 15m) kubelet Node minikube status is now: NodeHasSufficientMemory Normal NodeHasNoDiskPressure 15m (x5 over 15m) kubelet Node minikube status is now: NodeHasNoDiskPressure Normal NodeHasSufficientPID 15m (x4 over 15m) kubelet Node minikube status is now: NodeHasSufficientPID Normal Starting 15m kubelet Starting kubelet. Normal NodeHasSufficientMemory 15m kubelet Node minikube status is now: NodeHasSufficientMemory Normal NodeHasNoDiskPressure 15m kubelet Node minikube status is now: NodeHasNoDiskPressure Normal NodeHasSufficientPID 15m kubelet Node minikube status is now: NodeHasSufficientPID Normal NodeNotReady 15m kubelet Node minikube status is now: NodeNotReady Normal NodeAllocatableEnforced 15m kubelet Updated Node Allocatable limit across pods Normal NodeReady 15m kubelet Node minikube status is now: NodeReady Normal Starting 14m kube-proxy Starting kube-proxy. ==> dmesg <== [Aug19 15:32] You have booted with nomodeset. This means your GPU drivers are DISABLED [ +0.000000] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly [ +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it [ +0.192897] #2 [ +0.022463] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ +3.708124] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2 [ +10.597154] systemd-fstab-generator[1381]: Ignoring "noauto" for root device [ +0.032572] systemd[1]: system-getty.slice: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling. [ +0.000002] systemd[1]: (This warning is only shown for the first unit using IP firewalling.) [ +0.342116] vboxguest: loading out-of-tree module taints kernel. [ +0.013913] vgdrvHeartbeatInit: Setting up heartbeat to trigger every 2000 milliseconds [ +0.000260] vboxguest: misc device minor 58, IRQ 20, I/O port d020, MMIO at 00000000f0000000 (size 0x400000) [ +0.287350] SELinux: unrecognized netlink message: protocol=0 nlmsg_type=106 sclass=netlink_route_socket pid=2071 comm=systemd-network [ +0.034699] VBoxService 5.2.42 r137960 (verbosity: 0) linux.amd64 (May 13 2020 21:45:13) release log 00:00:00.000935 main Log opened 2021-08-19T15:33:01.513123000Z [ +0.000089] 00:00:00.001081 main OS Product: Linux [ +0.000047] 00:00:00.001138 main OS Release: 4.19.182 [ +0.000074] 00:00:00.001184 main OS Version: #1 SMP Fri Jul 2 00:45:17 UTC 2021 [ +0.000078] 00:00:00.001272 main Executable: /usr/sbin/VBoxService 00:00:00.001273 main Process ID: 2153 00:00:00.001274 main Package type: LINUX_64BITS_GENERIC [ +0.000046] 00:00:00.001337 main 5.2.42 r137960 started. Verbose level = 0 [ +0.982348] NFSD: the nfsdcld client tracking upcall will be removed in 3.10. Please transition to using nfsdcltrack. [Aug19 15:33] systemd-fstab-generator[2485]: Ignoring "noauto" for root device [ +0.134353] systemd-fstab-generator[2498]: Ignoring "noauto" for root device [ +34.206327] hrtimer: interrupt took 5727096 ns [Aug19 15:34] systemd-fstab-generator[2698]: Ignoring "noauto" for root device [ +1.609498] kauditd_printk_skb: 62 callbacks suppressed [ +0.523960] systemd-fstab-generator[2870]: Ignoring "noauto" for root device [ +0.116437] systemd-fstab-generator[2883]: Ignoring "noauto" for root device [ +0.139777] systemd-fstab-generator[2896]: Ignoring "noauto" for root device [ +5.890918] systemd-fstab-generator[3194]: Ignoring "noauto" for root device [ +5.943671] kauditd_printk_skb: 107 callbacks suppressed [ +10.337644] systemd-fstab-generator[4577]: Ignoring "noauto" for root device [ +15.007957] kauditd_printk_skb: 38 callbacks suppressed [ +8.003706] NFSD: Unable to end grace period: -110 [Aug19 15:46] kauditd_printk_skb: 59 callbacks suppressed ==> etcd [ebbe76ab29ab] <== 2021-08-19 15:40:32.029208 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:40:42.029453 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:40:52.029350 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:41:02.028744 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:41:12.028396 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:41:22.027659 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:41:32.029016 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:41:42.028596 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:41:52.028588 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:42:02.029829 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:42:12.028762 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:42:22.028275 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:42:32.027996 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:42:42.029166 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:42:52.029077 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:43:02.028890 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:43:12.027969 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:43:22.028526 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:43:32.028208 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:43:42.028077 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:43:52.029896 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:44:02.028233 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:44:12.028520 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:44:22.028370 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:44:27.645040 I | mvcc: store.index: compact 665 2021-08-19 15:44:27.646308 I | mvcc: finished scheduled compaction at 665 (took 753.081µs) 2021-08-19 15:44:32.027956 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:44:42.029085 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:44:52.028150 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:45:02.027730 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:45:12.027846 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:45:22.028581 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:45:32.029765 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:45:42.028993 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:45:52.028050 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:46:02.027911 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:46:12.028414 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:46:22.028189 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:46:32.028677 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:46:42.028821 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:46:52.031369 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:47:02.064222 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:47:12.028731 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:47:22.028615 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:47:32.028619 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:47:42.028022 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:47:52.027472 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:48:02.028596 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:48:12.028495 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:48:22.029029 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:48:32.027879 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:48:42.027872 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:48:52.028747 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:49:02.028175 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:49:12.028851 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:49:22.028041 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:49:27.655342 I | mvcc: store.index: compact 875 2021-08-19 15:49:27.682556 I | mvcc: finished scheduled compaction at 875 (took 17.415669ms) 2021-08-19 15:49:32.029961 I | etcdserver/api/etcdhttp: /health OK (status code 200) 2021-08-19 15:49:42.028444 I | etcdserver/api/etcdhttp: /health OK (status code 200) ==> kernel <== 15:49:46 up 17 min, 0 users, load average: 2.00, 1.32, 0.76 Linux minikube 4.19.182 #1 SMP Fri Jul 2 00:45:17 UTC 2021 x86_64 GNU/Linux PRETTY_NAME="Buildroot 2020.02.12" ==> kube-apiserver [e4bfca006cb9] <== I0819 15:37:44.734109 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:38:19.435437 1 client.go:360] parsed scheme: "passthrough" I0819 15:38:19.435568 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:38:19.435597 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:38:52.665210 1 client.go:360] parsed scheme: "passthrough" I0819 15:38:52.665285 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:38:52.665298 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:39:29.033076 1 client.go:360] parsed scheme: "passthrough" I0819 15:39:29.033220 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:39:29.033231 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:39:59.616714 1 client.go:360] parsed scheme: "passthrough" I0819 15:39:59.616761 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:39:59.616771 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:40:35.029959 1 client.go:360] parsed scheme: "passthrough" I0819 15:40:35.030020 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:40:35.030030 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:41:09.804394 1 client.go:360] parsed scheme: "passthrough" I0819 15:41:09.804568 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:41:09.804682 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:41:49.560090 1 client.go:360] parsed scheme: "passthrough" I0819 15:41:49.560158 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:41:49.560169 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:42:34.319941 1 client.go:360] parsed scheme: "passthrough" I0819 15:42:34.319980 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:42:34.319988 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:43:12.001423 1 client.go:360] parsed scheme: "passthrough" I0819 15:43:12.001478 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:43:12.001487 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:43:49.347070 1 client.go:360] parsed scheme: "passthrough" I0819 15:43:49.347124 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:43:49.347133 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:44:31.968939 1 client.go:360] parsed scheme: "passthrough" I0819 15:44:31.969017 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:44:31.969027 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:45:12.551586 1 client.go:360] parsed scheme: "passthrough" I0819 15:45:12.551677 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:45:12.551687 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:45:57.524930 1 client.go:360] parsed scheme: "passthrough" I0819 15:45:57.524991 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:45:57.525001 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:46:28.323897 1 client.go:360] parsed scheme: "passthrough" I0819 15:46:28.324016 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:46:28.324025 1 clientconn.go:948] ClientConn switching balancer to "pick_first" W0819 15:46:31.892943 1 watcher.go:220] watch chan error: etcdserver: mvcc: required revision has been compacted I0819 15:46:38.588247 1 controller.go:611] quota admission added evaluator for: statefulsets.apps I0819 15:47:03.174821 1 client.go:360] parsed scheme: "passthrough" I0819 15:47:03.174855 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:47:03.174864 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:47:38.933593 1 client.go:360] parsed scheme: "passthrough" I0819 15:47:38.933643 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:47:38.933652 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:48:21.224533 1 client.go:360] parsed scheme: "passthrough" I0819 15:48:21.224889 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:48:21.224948 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:48:59.459113 1 client.go:360] parsed scheme: "passthrough" I0819 15:48:59.467285 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:48:59.467329 1 clientconn.go:948] ClientConn switching balancer to "pick_first" I0819 15:49:36.570124 1 client.go:360] parsed scheme: "passthrough" I0819 15:49:36.570872 1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://127.0.0.1:2379 0 }] } I0819 15:49:36.570912 1 clientconn.go:948] ClientConn switching balancer to "pick_first" ==> kube-controller-manager [fbc1623393d2] <== I0819 15:34:48.812496 1 shared_informer.go:240] Waiting for caches to sync for garbage collector I0819 15:34:48.817013 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-legacy-unknown I0819 15:34:48.817063 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-serving I0819 15:34:48.817084 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-client I0819 15:34:48.817539 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kube-apiserver-client I0819 15:34:48.819097 1 shared_informer.go:247] Caches are synced for crt configmap I0819 15:34:48.819525 1 shared_informer.go:247] Caches are synced for TTL I0819 15:34:48.820726 1 shared_informer.go:247] Caches are synced for cronjob I0819 15:34:48.828269 1 shared_informer.go:247] Caches are synced for service account I0819 15:34:48.842427 1 shared_informer.go:247] Caches are synced for node I0819 15:34:48.842458 1 range_allocator.go:172] Starting range CIDR allocator I0819 15:34:48.842597 1 shared_informer.go:240] Waiting for caches to sync for cidrallocator I0819 15:34:48.842840 1 shared_informer.go:247] Caches are synced for cidrallocator I0819 15:34:48.852481 1 shared_informer.go:247] Caches are synced for expand I0819 15:34:48.853680 1 shared_informer.go:247] Caches are synced for certificate-csrapproving I0819 15:34:48.854817 1 range_allocator.go:373] Set node minikube PodCIDR to [10.244.0.0/24] I0819 15:34:48.855052 1 shared_informer.go:247] Caches are synced for namespace I0819 15:34:48.868659 1 shared_informer.go:247] Caches are synced for PV protection I0819 15:34:48.871646 1 shared_informer.go:247] Caches are synced for bootstrap_signer I0819 15:34:48.973948 1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator I0819 15:34:49.002551 1 shared_informer.go:247] Caches are synced for GC I0819 15:34:49.013777 1 shared_informer.go:247] Caches are synced for HPA I0819 15:34:49.016292 1 shared_informer.go:247] Caches are synced for ReplicaSet I0819 15:34:49.019493 1 shared_informer.go:247] Caches are synced for persistent volume I0819 15:34:49.028859 1 shared_informer.go:247] Caches are synced for endpoint_slice I0819 15:34:49.031069 1 shared_informer.go:247] Caches are synced for resource quota I0819 15:34:49.042452 1 shared_informer.go:247] Caches are synced for daemon sets I0819 15:34:49.065188 1 shared_informer.go:247] Caches are synced for endpoint I0819 15:34:49.065508 1 shared_informer.go:247] Caches are synced for disruption I0819 15:34:49.065520 1 disruption.go:371] Sending events to api server. I0819 15:34:49.065615 1 shared_informer.go:247] Caches are synced for ReplicationController I0819 15:34:49.065780 1 shared_informer.go:247] Caches are synced for taint I0819 15:34:49.065850 1 node_lifecycle_controller.go:1398] Initializing eviction metric for zone: W0819 15:34:49.066180 1 node_lifecycle_controller.go:1013] Missing timestamp for Node minikube. Assuming now as a timestamp. I0819 15:34:49.066342 1 taint_manager.go:187] "Starting NoExecuteTaintManager" I0819 15:34:49.065807 1 shared_informer.go:247] Caches are synced for job I0819 15:34:49.067051 1 event.go:291] "Event occurred" object="minikube" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node minikube event: Registered Node minikube in Controller" I0819 15:34:49.067118 1 shared_informer.go:247] Caches are synced for stateful set I0819 15:34:49.067169 1 shared_informer.go:247] Caches are synced for deployment I0819 15:34:49.067311 1 node_lifecycle_controller.go:1214] Controller detected that zone is now in state Normal. I0819 15:34:49.067543 1 shared_informer.go:247] Caches are synced for ephemeral I0819 15:34:49.072608 1 shared_informer.go:247] Caches are synced for PVC protection I0819 15:34:49.075947 1 shared_informer.go:247] Caches are synced for resource quota I0819 15:34:49.117425 1 shared_informer.go:247] Caches are synced for attach detach I0819 15:34:49.525346 1 shared_informer.go:247] Caches are synced for garbage collector I0819 15:34:49.525382 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage I0819 15:34:49.612748 1 shared_informer.go:247] Caches are synced for garbage collector I0819 15:34:49.679982 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-tfq2x" I0819 15:34:49.776576 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-558bd4d5db to 1" I0819 15:34:49.874437 1 event.go:291] "Event occurred" object="kube-system/coredns-558bd4d5db" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-558bd4d5db-xrk2l" I0819 15:46:38.628106 1 event.go:291] "Event occurred" object="default/cassandra" kind="StatefulSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success" I0819 15:46:38.635329 1 event.go:291] "Event occurred" object="default/cassandra" kind="StatefulSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="create Pod cassandra-0 in StatefulSet cassandra successful" I0819 15:46:38.648083 1 event.go:291] "Event occurred" object="default/cassandra-data-cassandra-0" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"k8s.io/minikube-hostpath\" or manually created by system administrator" I0819 15:47:44.849272 1 event.go:291] "Event occurred" object="default/cassandra" kind="StatefulSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success" I0819 15:47:44.855016 1 event.go:291] "Event occurred" object="default/cassandra" kind="StatefulSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="create Pod cassandra-1 in StatefulSet cassandra successful" I0819 15:47:44.858489 1 event.go:291] "Event occurred" object="default/cassandra-data-cassandra-1" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"k8s.io/minikube-hostpath\" or manually created by system administrator" I0819 15:48:50.272152 1 event.go:291] "Event occurred" object="default/cassandra" kind="StatefulSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success" I0819 15:48:50.286831 1 event.go:291] "Event occurred" object="default/cassandra-data-cassandra-2" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"k8s.io/minikube-hostpath\" or manually created by system administrator" I0819 15:48:50.286984 1 event.go:291] "Event occurred" object="default/cassandra" kind="StatefulSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="create Pod cassandra-2 in StatefulSet cassandra successful" I0819 15:48:50.289746 1 event.go:291] "Event occurred" object="default/cassandra-data-cassandra-2" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"k8s.io/minikube-hostpath\" or manually created by system administrator" ==> kube-proxy [ee64f526cc35] <== I0819 15:34:50.717700 1 node.go:172] Successfully retrieved node IP: 192.168.99.101 I0819 15:34:50.718036 1 server_others.go:140] Detected node IP 192.168.99.101 W0819 15:34:50.718230 1 server_others.go:598] Unknown proxy mode "", assuming iptables proxy W0819 15:34:50.751192 1 server_others.go:197] No iptables support for IPv6: exit status 3 I0819 15:34:50.751220 1 server_others.go:208] kube-proxy running in single-stack IPv4 mode I0819 15:34:50.751234 1 server_others.go:212] Using iptables Proxier. I0819 15:34:50.751471 1 server.go:643] Version: v1.21.2 I0819 15:34:50.752215 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400 I0819 15:34:50.752342 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600 I0819 15:34:50.752521 1 config.go:315] Starting service config controller I0819 15:34:50.752530 1 shared_informer.go:240] Waiting for caches to sync for service config I0819 15:34:50.753186 1 config.go:224] Starting endpoint slice config controller I0819 15:34:50.753194 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config W0819 15:34:50.756177 1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice W0819 15:34:50.757616 1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice I0819 15:34:50.853658 1 shared_informer.go:247] Caches are synced for endpoint slice config I0819 15:34:50.853847 1 shared_informer.go:247] Caches are synced for service config W0819 15:40:32.761320 1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice W0819 15:46:07.764155 1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice ==> kube-scheduler [1a5de026d8cf] <== I0819 15:34:28.134673 1 serving.go:347] Generated self-signed cert in-memory W0819 15:34:32.222947 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA' W0819 15:34:32.222976 1 authentication.go:337] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system" W0819 15:34:32.222984 1 authentication.go:338] Continuing without authentication configuration. This may treat all requests as anonymous. W0819 15:34:32.222989 1 authentication.go:339] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false I0819 15:34:32.277445 1 secure_serving.go:197] Serving securely on 127.0.0.1:10259 I0819 15:34:32.278236 1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0819 15:34:32.280312 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file E0819 15:34:32.283517 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope I0819 15:34:32.283863 1 tlsconfig.go:240] Starting DynamicServingCertificateController E0819 15:34:32.284311 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope E0819 15:34:32.284989 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope E0819 15:34:32.285442 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope E0819 15:34:32.285472 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope E0819 15:34:32.285581 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope E0819 15:34:32.285622 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope E0819 15:34:32.285732 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope E0819 15:34:32.285767 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope E0819 15:34:32.286357 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope E0819 15:34:32.286396 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope E0819 15:34:32.286497 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope E0819 15:34:32.289327 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope E0819 15:34:32.291721 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system" E0819 15:34:33.337795 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope E0819 15:34:33.352563 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope E0819 15:34:33.371951 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope E0819 15:34:33.460113 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope E0819 15:34:33.461152 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope E0819 15:34:33.467582 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope E0819 15:34:33.492219 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope E0819 15:34:33.542940 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope E0819 15:34:33.660537 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system" I0819 15:34:36.680724 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file ==> kubelet <== -- Logs begin at Thu 2021-08-19 15:32:55 UTC, end at Thu 2021-08-19 15:49:47 UTC. -- Aug 19 15:34:37 minikube kubelet[4586]: I0819 15:34:37.233380 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/533a59bbe1f287c135099b24dd8b3b1c-kubeconfig\") pod \"kube-controller-manager-minikube\" (UID: \"533a59bbe1f287c135099b24dd8b3b1c\") " Aug 19 15:34:37 minikube kubelet[4586]: I0819 15:34:37.233444 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-certs\" (UniqueName: \"kubernetes.io/host-path/b21ca998b2ca7d7b6bdfb6f12b94a450-etcd-certs\") pod \"etcd-minikube\" (UID: \"b21ca998b2ca7d7b6bdfb6f12b94a450\") " Aug 19 15:34:37 minikube kubelet[4586]: I0819 15:34:37.233646 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/7a6f1b84dc30cbb23fdf07af416c543f-usr-share-ca-certificates\") pod \"kube-apiserver-minikube\" (UID: \"7a6f1b84dc30cbb23fdf07af416c543f\") " Aug 19 15:34:37 minikube kubelet[4586]: I0819 15:34:37.233803 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/533a59bbe1f287c135099b24dd8b3b1c-flexvolume-dir\") pod \"kube-controller-manager-minikube\" (UID: \"533a59bbe1f287c135099b24dd8b3b1c\") " Aug 19 15:34:37 minikube kubelet[4586]: I0819 15:34:37.233953 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/533a59bbe1f287c135099b24dd8b3b1c-usr-share-ca-certificates\") pod \"kube-controller-manager-minikube\" (UID: \"533a59bbe1f287c135099b24dd8b3b1c\") " Aug 19 15:34:37 minikube kubelet[4586]: I0819 15:34:37.234025 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/a2acd1bccd50fd7790183537181f658e-kubeconfig\") pod \"kube-scheduler-minikube\" (UID: \"a2acd1bccd50fd7790183537181f658e\") " Aug 19 15:34:37 minikube kubelet[4586]: I0819 15:34:37.234080 4586 reconciler.go:157] "Reconciler: start to sync state" Aug 19 15:34:48 minikube kubelet[4586]: I0819 15:34:48.917673 4586 kuberuntime_manager.go:1044] "Updating runtime config through cri with podcidr" CIDR="10.244.0.0/24" Aug 19 15:34:48 minikube kubelet[4586]: I0819 15:34:48.919646 4586 docker_service.go:359] "Docker cri received runtime config" runtimeConfig="&RuntimeConfig{NetworkConfig:&NetworkConfig{PodCidr:10.244.0.0/24,},}" Aug 19 15:34:48 minikube kubelet[4586]: I0819 15:34:48.919787 4586 kubelet_network.go:76] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.244.0.0/24" Aug 19 15:34:49 minikube kubelet[4586]: I0819 15:34:49.683406 4586 topology_manager.go:187] "Topology Admit Handler" Aug 19 15:34:49 minikube kubelet[4586]: I0819 15:34:49.845548 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a83fd984-984a-4eac-9b77-4dabe98547ad-lib-modules\") pod \"kube-proxy-tfq2x\" (UID: \"a83fd984-984a-4eac-9b77-4dabe98547ad\") " Aug 19 15:34:49 minikube kubelet[4586]: I0819 15:34:49.845700 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/a83fd984-984a-4eac-9b77-4dabe98547ad-kube-proxy\") pod \"kube-proxy-tfq2x\" (UID: \"a83fd984-984a-4eac-9b77-4dabe98547ad\") " Aug 19 15:34:49 minikube kubelet[4586]: I0819 15:34:49.845731 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t27td\" (UniqueName: \"kubernetes.io/projected/a83fd984-984a-4eac-9b77-4dabe98547ad-kube-api-access-t27td\") pod \"kube-proxy-tfq2x\" (UID: \"a83fd984-984a-4eac-9b77-4dabe98547ad\") " Aug 19 15:34:49 minikube kubelet[4586]: I0819 15:34:49.845815 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/a83fd984-984a-4eac-9b77-4dabe98547ad-xtables-lock\") pod \"kube-proxy-tfq2x\" (UID: \"a83fd984-984a-4eac-9b77-4dabe98547ad\") " Aug 19 15:34:49 minikube kubelet[4586]: I0819 15:34:49.882787 4586 topology_manager.go:187] "Topology Admit Handler" Aug 19 15:34:49 minikube kubelet[4586]: W0819 15:34:49.941957 4586 container.go:586] Failed to update stats for container "/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ab75ef_35b8_4859_a5b3_96493933d7f8.slice": /sys/fs/cgroup/cpuset/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ab75ef_35b8_4859_a5b3_96493933d7f8.slice/cpuset.cpus found to be empty, continuing to push stats Aug 19 15:34:50 minikube kubelet[4586]: I0819 15:34:50.047971 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7wvh\" (UniqueName: \"kubernetes.io/projected/87ab75ef-35b8-4859-a5b3-96493933d7f8-kube-api-access-q7wvh\") pod \"coredns-558bd4d5db-xrk2l\" (UID: \"87ab75ef-35b8-4859-a5b3-96493933d7f8\") " Aug 19 15:34:50 minikube kubelet[4586]: I0819 15:34:50.048036 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87ab75ef-35b8-4859-a5b3-96493933d7f8-config-volume\") pod \"coredns-558bd4d5db-xrk2l\" (UID: \"87ab75ef-35b8-4859-a5b3-96493933d7f8\") " Aug 19 15:34:50 minikube kubelet[4586]: I0819 15:34:50.986962 4586 pod_container_deletor.go:79] "Container not found in pod's containers" containerID="784a66bb6fa759db988a928a6826ddac53c66596acd81c046087193386eef583" Aug 19 15:34:50 minikube kubelet[4586]: I0819 15:34:50.988889 4586 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for kube-system/coredns-558bd4d5db-xrk2l through plugin: invalid network status for" Aug 19 15:34:51 minikube kubelet[4586]: I0819 15:34:51.507640 4586 topology_manager.go:187] "Topology Admit Handler" Aug 19 15:34:51 minikube kubelet[4586]: I0819 15:34:51.670307 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt5ds\" (UniqueName: \"kubernetes.io/projected/f57511d6-0000-447a-b9db-39f369626334-kube-api-access-vt5ds\") pod \"storage-provisioner\" (UID: \"f57511d6-0000-447a-b9db-39f369626334\") " Aug 19 15:34:51 minikube kubelet[4586]: I0819 15:34:51.670673 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/f57511d6-0000-447a-b9db-39f369626334-tmp\") pod \"storage-provisioner\" (UID: \"f57511d6-0000-447a-b9db-39f369626334\") " Aug 19 15:34:52 minikube kubelet[4586]: I0819 15:34:52.319280 4586 pod_container_deletor.go:79] "Container not found in pod's containers" containerID="4de31d63869be2c243216a55903137ec1b796eafd165f6a8ffe8b9ff27ecdf9c" Aug 19 15:34:52 minikube kubelet[4586]: I0819 15:34:52.329106 4586 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for kube-system/coredns-558bd4d5db-xrk2l through plugin: invalid network status for" Aug 19 15:34:56 minikube kubelet[4586]: E0819 15:34:56.864906 4586 cadvisor_stats_provider.go:415] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ab75ef_35b8_4859_a5b3_96493933d7f8.slice\": RecentStats: unable to find data in memory cache]" Aug 19 15:46:40 minikube kubelet[4586]: I0819 15:46:40.060163 4586 topology_manager.go:187] "Topology Admit Handler" Aug 19 15:46:40 minikube kubelet[4586]: I0819 15:46:40.172287 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-fce00086-ec97-4e0a-a25a-39930586298e\" (UniqueName: \"kubernetes.io/host-path/88e291e9-1328-4b77-8933-404b08bc067b-pvc-fce00086-ec97-4e0a-a25a-39930586298e\") pod \"cassandra-0\" (UID: \"88e291e9-1328-4b77-8933-404b08bc067b\") " Aug 19 15:46:40 minikube kubelet[4586]: I0819 15:46:40.172378 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csv4l\" (UniqueName: \"kubernetes.io/projected/88e291e9-1328-4b77-8933-404b08bc067b-kube-api-access-csv4l\") pod \"cassandra-0\" (UID: \"88e291e9-1328-4b77-8933-404b08bc067b\") " Aug 19 15:46:41 minikube kubelet[4586]: I0819 15:46:41.122743 4586 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/cassandra-0 through plugin: invalid network status for" Aug 19 15:46:41 minikube kubelet[4586]: I0819 15:46:41.123645 4586 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/cassandra-0 through plugin: invalid network status for" Aug 19 15:46:41 minikube kubelet[4586]: I0819 15:46:41.124157 4586 pod_container_deletor.go:79] "Container not found in pod's containers" containerID="32238e1ec1f97e25a9c87275b1edef24ed913db3643b62b5e2ad7510a315f250" Aug 19 15:46:42 minikube kubelet[4586]: I0819 15:46:42.132514 4586 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/cassandra-0 through plugin: invalid network status for" Aug 19 15:46:50 minikube kubelet[4586]: E0819 15:46:50.712294 4586 cadvisor_stats_provider.go:151] "Unable to fetch pod etc hosts stats" err="failed to get stats failed command 'du' ($ nice -n 19 du -x -s -B 1) on path /var/lib/kubelet/pods/88e291e9-1328-4b77-8933-404b08bc067b/etc-hosts with error exit status 1" pod="default/cassandra-0" Aug 19 15:47:01 minikube kubelet[4586]: E0819 15:47:01.687461 4586 cadvisor_stats_provider.go:151] "Unable to fetch pod etc hosts stats" err="failed to get stats failed command 'du' ($ nice -n 19 du -x -s -B 1) on path /var/lib/kubelet/pods/88e291e9-1328-4b77-8933-404b08bc067b/etc-hosts with error exit status 1" pod="default/cassandra-0" Aug 19 15:47:11 minikube kubelet[4586]: E0819 15:47:11.749995 4586 cadvisor_stats_provider.go:151] "Unable to fetch pod etc hosts stats" err="failed to get stats failed command 'du' ($ nice -n 19 du -x -s -B 1) on path /var/lib/kubelet/pods/88e291e9-1328-4b77-8933-404b08bc067b/etc-hosts with error exit status 1" pod="default/cassandra-0" Aug 19 15:47:13 minikube kubelet[4586]: I0819 15:47:13.447059 4586 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/cassandra-0 through plugin: invalid network status for" Aug 19 15:47:35 minikube kubelet[4586]: E0819 15:47:35.066304 4586 remote_runtime.go:394] "ExecSync cmd from runtime service failed" err="rpc error: code = DeadlineExceeded desc = context deadline exceeded" containerID="1923fb2f47f8085d8a568401ff74dc6f70d518fe2790ddce5686f6c64422ec5d" cmd=[/bin/bash -c /ready-probe.sh] Aug 19 15:47:46 minikube kubelet[4586]: I0819 15:47:46.219719 4586 topology_manager.go:187] "Topology Admit Handler" Aug 19 15:47:46 minikube kubelet[4586]: I0819 15:47:46.313446 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wls5w\" (UniqueName: \"kubernetes.io/projected/25cdbb7c-4d75-4ee2-bea8-cf7803a12aa2-kube-api-access-wls5w\") pod \"cassandra-1\" (UID: \"25cdbb7c-4d75-4ee2-bea8-cf7803a12aa2\") " Aug 19 15:47:46 minikube kubelet[4586]: I0819 15:47:46.313744 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-8c844658-fb51-4ed5-a3b5-b8ad81e02348\" (UniqueName: \"kubernetes.io/host-path/25cdbb7c-4d75-4ee2-bea8-cf7803a12aa2-pvc-8c844658-fb51-4ed5-a3b5-b8ad81e02348\") pod \"cassandra-1\" (UID: \"25cdbb7c-4d75-4ee2-bea8-cf7803a12aa2\") " Aug 19 15:47:47 minikube kubelet[4586]: I0819 15:47:47.300577 4586 pod_container_deletor.go:79] "Container not found in pod's containers" containerID="11d14bbb589f41b79297f445b5f72b92d9db63c3558a13092558894f050425c5" Aug 19 15:47:47 minikube kubelet[4586]: I0819 15:47:47.305156 4586 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/cassandra-1 through plugin: invalid network status for" Aug 19 15:47:48 minikube kubelet[4586]: I0819 15:47:48.319847 4586 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/cassandra-1 through plugin: invalid network status for" Aug 19 15:47:49 minikube kubelet[4586]: I0819 15:47:49.341252 4586 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/cassandra-1 through plugin: invalid network status for" Aug 19 15:48:11 minikube kubelet[4586]: E0819 15:48:11.226214 4586 remote_runtime.go:394] "ExecSync cmd from runtime service failed" err="rpc error: code = DeadlineExceeded desc = context deadline exceeded" containerID="f8813265c69b1ed4804bf8d718f4abb692dcd0cc68aacfea4ff2686214092540" cmd=[/bin/bash -c /ready-probe.sh] Aug 19 15:48:45 minikube kubelet[4586]: E0819 15:48:45.065717 4586 remote_runtime.go:394] "ExecSync cmd from runtime service failed" err="rpc error: code = DeadlineExceeded desc = context deadline exceeded" containerID="1923fb2f47f8085d8a568401ff74dc6f70d518fe2790ddce5686f6c64422ec5d" cmd=[/bin/bash -c /ready-probe.sh] Aug 19 15:48:52 minikube kubelet[4586]: I0819 15:48:52.273879 4586 topology_manager.go:187] "Topology Admit Handler" Aug 19 15:48:52 minikube kubelet[4586]: I0819 15:48:52.409133 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7rb9\" (UniqueName: \"kubernetes.io/projected/ae46bbf9-b5f1-46ee-95e5-cc8f15c0c1a7-kube-api-access-r7rb9\") pod \"cassandra-2\" (UID: \"ae46bbf9-b5f1-46ee-95e5-cc8f15c0c1a7\") " Aug 19 15:48:52 minikube kubelet[4586]: I0819 15:48:52.409242 4586 reconciler.go:224] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-16dc98e8-b79a-415f-96e2-fe6234cd3357\" (UniqueName: \"kubernetes.io/host-path/ae46bbf9-b5f1-46ee-95e5-cc8f15c0c1a7-pvc-16dc98e8-b79a-415f-96e2-fe6234cd3357\") pod \"cassandra-2\" (UID: \"ae46bbf9-b5f1-46ee-95e5-cc8f15c0c1a7\") " Aug 19 15:48:53 minikube kubelet[4586]: I0819 15:48:53.327598 4586 pod_container_deletor.go:79] "Container not found in pod's containers" containerID="6eb0236ebe6a93a9e85dd3754158f95bd91b0aac2188e1aae0b21aaa759002f3" Aug 19 15:48:53 minikube kubelet[4586]: I0819 15:48:53.330106 4586 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/cassandra-2 through plugin: invalid network status for" Aug 19 15:48:54 minikube kubelet[4586]: I0819 15:48:54.353422 4586 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/cassandra-2 through plugin: invalid network status for" Aug 19 15:48:55 minikube kubelet[4586]: I0819 15:48:55.504046 4586 docker_sandbox.go:401] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/cassandra-2 through plugin: invalid network status for" Aug 19 15:49:17 minikube kubelet[4586]: E0819 15:49:17.283011 4586 remote_runtime.go:394] "ExecSync cmd from runtime service failed" err="rpc error: code = DeadlineExceeded desc = context deadline exceeded" containerID="b508819d52cf610de162921f10dc5d672459dc8ca520e80757833ce0c1740f09" cmd=[/bin/bash -c /ready-probe.sh] Aug 19 15:49:21 minikube kubelet[4586]: E0819 15:49:21.223714 4586 remote_runtime.go:394] "ExecSync cmd from runtime service failed" err="rpc error: code = DeadlineExceeded desc = context deadline exceeded" containerID="f8813265c69b1ed4804bf8d718f4abb692dcd0cc68aacfea4ff2686214092540" cmd=[/bin/bash -c /ready-probe.sh] Aug 19 15:49:25 minikube kubelet[4586]: E0819 15:49:25.069147 4586 remote_runtime.go:394] "ExecSync cmd from runtime service failed" err="rpc error: code = DeadlineExceeded desc = context deadline exceeded" containerID="1923fb2f47f8085d8a568401ff74dc6f70d518fe2790ddce5686f6c64422ec5d" cmd=[/bin/bash -c /ready-probe.sh] Aug 19 15:49:27 minikube kubelet[4586]: E0819 15:49:27.278379 4586 remote_runtime.go:394] "ExecSync cmd from runtime service failed" err="rpc error: code = DeadlineExceeded desc = context deadline exceeded" containerID="b508819d52cf610de162921f10dc5d672459dc8ca520e80757833ce0c1740f09" cmd=[/bin/bash -c /ready-probe.sh] Aug 19 15:49:31 minikube kubelet[4586]: E0819 15:49:31.226626 4586 remote_runtime.go:394] "ExecSync cmd from runtime service failed" err="rpc error: code = DeadlineExceeded desc = context deadline exceeded" containerID="f8813265c69b1ed4804bf8d718f4abb692dcd0cc68aacfea4ff2686214092540" cmd=[/bin/bash -c /ready-probe.sh] ==> storage-provisioner [e3fb939149ca] <== I0819 15:34:52.643886 1 storage_provisioner.go:116] Initializing the minikube storage provisioner... I0819 15:34:52.655036 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service! I0819 15:34:52.655223 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath... I0819 15:34:52.665090 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath I0819 15:34:52.666850 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"42c7297a-522e-4e22-8916-620ea352e6e2", APIVersion:"v1", ResourceVersion:"471", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' minikube_17bf182f-6f1d-41e4-a023-7591457c2a21 became leader I0819 15:34:52.667137 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_minikube_17bf182f-6f1d-41e4-a023-7591457c2a21! I0819 15:34:52.769322 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_minikube_17bf182f-6f1d-41e4-a023-7591457c2a21! I0819 15:46:38.666350 1 controller.go:1332] provision "default/cassandra-data-cassandra-0" class "fast": started I0819 15:46:38.666512 1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{fast 35cb045c-8aa4-4b3b-9c77-5bf904fb56cd 972 0 2021-08-19 15:46:38 +0000 UTC map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{},"name":"fast"},"parameters":{"type":"pd-ssd"},"provisioner":"k8s.io/minikube-hostpath"} ] [] [] [{kubectl-client-side-apply Update storage.k8s.io/v1 2021-08-19 15:46:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:parameters":{".":{},"f:type":{}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{type: pd-ssd,},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-fce00086-ec97-4e0a-a25a-39930586298e &PersistentVolumeClaim{ObjectMeta:{cassandra-data-cassandra-0 default fce00086-ec97-4e0a-a25a-39930586298e 979 0 2021-08-19 15:46:38 +0000 UTC map[app:cassandra] map[volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection] [{kube-controller-manager Update v1 2021-08-19 15:46:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volume.beta.kubernetes.io/storage-provisioner":{}},"f:labels":{".":{},"f:app":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:storageClassName":{},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*fast,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/cassandra-data-cassandra-0 I0819 15:46:38.667120 1 controller.go:1439] provision "default/cassandra-data-cassandra-0" class "fast": volume "pvc-fce00086-ec97-4e0a-a25a-39930586298e" provisioned I0819 15:46:38.667253 1 controller.go:1456] provision "default/cassandra-data-cassandra-0" class "fast": succeeded I0819 15:46:38.667324 1 volume_store.go:212] Trying to save persistentvolume "pvc-fce00086-ec97-4e0a-a25a-39930586298e" I0819 15:46:38.667129 1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"cassandra-data-cassandra-0", UID:"fce00086-ec97-4e0a-a25a-39930586298e", APIVersion:"v1", ResourceVersion:"979", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/cassandra-data-cassandra-0" I0819 15:46:38.693226 1 volume_store.go:219] persistentvolume "pvc-fce00086-ec97-4e0a-a25a-39930586298e" saved I0819 15:46:38.694780 1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"cassandra-data-cassandra-0", UID:"fce00086-ec97-4e0a-a25a-39930586298e", APIVersion:"v1", ResourceVersion:"979", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-fce00086-ec97-4e0a-a25a-39930586298e I0819 15:47:44.855597 1 controller.go:1332] provision "default/cassandra-data-cassandra-1" class "fast": started I0819 15:47:44.855657 1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{fast 35cb045c-8aa4-4b3b-9c77-5bf904fb56cd 972 0 2021-08-19 15:46:38 +0000 UTC map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{},"name":"fast"},"parameters":{"type":"pd-ssd"},"provisioner":"k8s.io/minikube-hostpath"} ] [] [] [{kubectl-client-side-apply Update storage.k8s.io/v1 2021-08-19 15:46:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:parameters":{".":{},"f:type":{}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{type: pd-ssd,},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-8c844658-fb51-4ed5-a3b5-b8ad81e02348 &PersistentVolumeClaim{ObjectMeta:{cassandra-data-cassandra-1 default 8c844658-fb51-4ed5-a3b5-b8ad81e02348 1052 0 2021-08-19 15:47:44 +0000 UTC map[app:cassandra] map[volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection] [{kube-controller-manager Update v1 2021-08-19 15:47:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volume.beta.kubernetes.io/storage-provisioner":{}},"f:labels":{".":{},"f:app":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:storageClassName":{},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*fast,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/cassandra-data-cassandra-1 I0819 15:47:44.856435 1 controller.go:1439] provision "default/cassandra-data-cassandra-1" class "fast": volume "pvc-8c844658-fb51-4ed5-a3b5-b8ad81e02348" provisioned I0819 15:47:44.856462 1 controller.go:1456] provision "default/cassandra-data-cassandra-1" class "fast": succeeded I0819 15:47:44.856467 1 volume_store.go:212] Trying to save persistentvolume "pvc-8c844658-fb51-4ed5-a3b5-b8ad81e02348" I0819 15:47:44.856217 1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"cassandra-data-cassandra-1", UID:"8c844658-fb51-4ed5-a3b5-b8ad81e02348", APIVersion:"v1", ResourceVersion:"1052", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/cassandra-data-cassandra-1" I0819 15:47:44.875762 1 volume_store.go:219] persistentvolume "pvc-8c844658-fb51-4ed5-a3b5-b8ad81e02348" saved I0819 15:47:44.877778 1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"cassandra-data-cassandra-1", UID:"8c844658-fb51-4ed5-a3b5-b8ad81e02348", APIVersion:"v1", ResourceVersion:"1052", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-8c844658-fb51-4ed5-a3b5-b8ad81e02348 I0819 15:48:50.283854 1 controller.go:1332] provision "default/cassandra-data-cassandra-2" class "fast": started I0819 15:48:50.283897 1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{fast 35cb045c-8aa4-4b3b-9c77-5bf904fb56cd 972 0 2021-08-19 15:46:38 +0000 UTC map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{},"name":"fast"},"parameters":{"type":"pd-ssd"},"provisioner":"k8s.io/minikube-hostpath"} ] [] [] [{kubectl-client-side-apply Update storage.k8s.io/v1 2021-08-19 15:46:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:parameters":{".":{},"f:type":{}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{type: pd-ssd,},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-16dc98e8-b79a-415f-96e2-fe6234cd3357 &PersistentVolumeClaim{ObjectMeta:{cassandra-data-cassandra-2 default 16dc98e8-b79a-415f-96e2-fe6234cd3357 1130 0 2021-08-19 15:48:50 +0000 UTC map[app:cassandra] map[volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection] [{kube-controller-manager Update v1 2021-08-19 15:48:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volume.beta.kubernetes.io/storage-provisioner":{}},"f:labels":{".":{},"f:app":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:storageClassName":{},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{1073741824 0} {} 1Gi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*fast,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/cassandra-data-cassandra-2 I0819 15:48:50.284378 1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"cassandra-data-cassandra-2", UID:"16dc98e8-b79a-415f-96e2-fe6234cd3357", APIVersion:"v1", ResourceVersion:"1130", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/cassandra-data-cassandra-2" I0819 15:48:50.284560 1 controller.go:1439] provision "default/cassandra-data-cassandra-2" class "fast": volume "pvc-16dc98e8-b79a-415f-96e2-fe6234cd3357" provisioned I0819 15:48:50.284574 1 controller.go:1456] provision "default/cassandra-data-cassandra-2" class "fast": succeeded I0819 15:48:50.284578 1 volume_store.go:212] Trying to save persistentvolume "pvc-16dc98e8-b79a-415f-96e2-fe6234cd3357" I0819 15:48:50.328200 1 volume_store.go:219] persistentvolume "pvc-16dc98e8-b79a-415f-96e2-fe6234cd3357" saved I0819 15:48:50.328625 1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"cassandra-data-cassandra-2", UID:"16dc98e8-b79a-415f-96e2-fe6234cd3357", APIVersion:"v1", ResourceVersion:"1130", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-16dc98e8-b79a-415f-96e2-fe6234cd3357

Full output of failed command:

kubectl describe pod cassandra-0    3091  18:51:18  Name: cassandra-0 Namespace: default Priority: 0 Node: minikube/192.168.99.101 Start Time: Thu, 19 Aug 2021 18:46:40 +0300 Labels: app=cassandra controller-revision-hash=cassandra-95df4dff4 statefulset.kubernetes.io/pod-name=cassandra-0 Annotations: Status: Running IP: 172.17.0.3 IPs: IP: 172.17.0.3 Controlled By: StatefulSet/cassandra Containers: cassandra: Container ID: docker://1923fb2f47f8085d8a568401ff74dc6f70d518fe2790ddce5686f6c64422ec5d Image: gcr.io/google-samples/cassandra:v13 Image ID: docker-pullable://gcr.io/google-samples/cassandra@sha256:7a3d20afa0a46ed073a5c587b4f37e21fa860e83c60b9c42fec1e1e739d64007 Ports: 7000/TCP, 7001/TCP, 7199/TCP, 9042/TCP Host Ports: 0/TCP, 0/TCP, 0/TCP, 0/TCP State: Running Started: Thu, 19 Aug 2021 18:47:12 +0300 Ready: True Restart Count: 0 Limits: cpu: 500m memory: 1Gi Requests: cpu: 500m memory: 1Gi Readiness: exec [/bin/bash -c /ready-probe.sh] delay=15s timeout=5s period=10s #success=1 #failure=3 Environment: MAX_HEAP_SIZE: 512M HEAP_NEWSIZE: 100M CASSANDRA_SEEDS: cassandra-0.cassandra.default.svc.cluster.local CASSANDRA_CLUSTER_NAME: K8Demo CASSANDRA_DC: DC1-K8Demo CASSANDRA_RACK: Rack1-K8Demo POD_IP: (v1:status.podIP) Mounts: /cassandra_data from cassandra-data (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-csv4l (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: cassandra-data: Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) ClaimName: cassandra-data-cassandra-0 ReadOnly: false kube-api-access-csv4l: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: DownwardAPI: true QoS Class: Guaranteed Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Warning FailedScheduling 4m46s default-scheduler 0/1 nodes are available: 1 pod has unbound immediate PersistentVolumeClaims. Normal Scheduled 4m44s default-scheduler Successfully assigned default/cassandra-0 to minikube Normal Pulling 4m43s kubelet Pulling image "gcr.io/google-samples/cassandra:v13" Normal Pulled 4m12s kubelet Successfully pulled image "gcr.io/google-samples/cassandra:v13" in 30.913218546s Normal Created 4m12s kubelet Created container cassandra Normal Started 4m12s kubelet Started container cassandra Warning Unhealthy 119s (x3 over 3m49s) kubelet Readiness probe failed:
afbjorklund commented 3 years ago

Looks like it specifies a storageClassName: fast, but only default is supplied by the minikube hostpath provisioner ?

EDIT, never mind - there was a custom class

kind: StorageClass
apiVersion: storage.k8s.io/v1
metadata:
  name: fast
provisioner: k8s.io/minikube-hostpath
parameters:
  type: pd-ssd
medyagh commented 3 years ago

@dtln820

do u mind sharing the output of

kubectl get pods -l="app=cassandra"

and also the kubectl logs for the pod ?

I noticed you are using virtualbox driver, I am curious do you have the same problem with any other driver? like Docker or Hyperkit?

spowelljr commented 3 years ago

Hi @dtln820, we haven't heard back from you, do you still have this issue? There isn't enough information in this issue to make it actionable, and a long enough duration has passed, so this issue is likely difficult to replicate.

I will close this issue for now but feel free to reopen when you feel ready to provide more information.

dtln820 commented 3 years ago

Sorry, I lost access to the machine on which I was encountering the problem. I wasn't able to replicate the issue on other machines.