search

kubernetes / minikube

Run Kubernetes locally
https://minikube.sigs.k8s.io/
Apache License 2.0
29.33k stars 4.88k forks source link

minikube v1.33.0 + Cilium is broken on Mac (CrashLoopBackOff) #18857

Closed ofirc closed 5 months ago

ofirc commented 5 months ago

What Happened?

On my MacBook Air M2 (Sonoma 14.1.2 (23B92)), mininkube doesn't work with Cilium as CNI plugin.

Minikube version:

$ minikube version
minikube version: v1.33.0
commit: 86fc9d54fca63f295d8737c8eacdbb7987e89c67
$

The Cilium DaemonSet Pod and CoreDNS enter an infinite CrashLoopBackOff loop:

Events:
  Type     Reason               Age                   From               Message
  ----     ------               ----                  ----               -------
  Normal   Scheduled            23m                   default-scheduler  Successfully assigned kube-system/cilium-b6m22 to minikube
  Normal   Pulling              23m                   kubelet            Pulling image "quay.io/cilium/cilium:v1.15.1@sha256:351d6685dc6f6ffbcd5451043167cfa8842c6decf80d8c8e426a417c73fb56d4"
  Normal   Pulled               23m                   kubelet            Successfully pulled image "quay.io/cilium/cilium:v1.15.1@sha256:351d6685dc6f6ffbcd5451043167cfa8842c6decf80d8c8e426a417c73fb56d4" in 17.914s (17.914s including waiting). Image size: 555410445 bytes.
  Normal   Created              23m                   kubelet            Created container mount-cgroup
  Normal   Started              23m                   kubelet            Started container mount-cgroup
  Normal   Pulling              23m                   kubelet            Pulling image "quay.io/cilium/cilium:v1.12.3@sha256:30de50c4dc0a1e1077e9e7917a54d5cab253058b3f779822aec00f5c817ca826"
  Normal   Pulled               23m                   kubelet            Successfully pulled image "quay.io/cilium/cilium:v1.12.3@sha256:30de50c4dc0a1e1077e9e7917a54d5cab253058b3f779822aec00f5c817ca826" in 12.603s (20.23s including waiting). Image size: 430545865 bytes.
  Normal   Created              23m                   kubelet            Created container clean-cilium-state
  Normal   Started              23m                   kubelet            Started container clean-cilium-state
  Normal   Killing              23m (x2 over 23m)     kubelet            FailedPostStartHook
  Normal   Pulled               22m (x3 over 23m)     kubelet            Container image "quay.io/cilium/cilium:v1.15.1@sha256:351d6685dc6f6ffbcd5451043167cfa8842c6decf80d8c8e426a417c73fb56d4" already present on machine
  Normal   Created              22m (x3 over 23m)     kubelet            Created container cilium-agent
  Normal   Started              22m (x3 over 23m)     kubelet            Started container cilium-agent
  Warning  FailedPostStartHook  22m (x3 over 23m)     kubelet            PostStartHook failed
  Warning  BackOff              3m53s (x98 over 23m)  kubelet            Back-off restarting failed container cilium-agent in pod cilium-b6m22_kube-system(b675dfc2-5dbd-4733-9b47-f99bf7828aa0)

The logs don't show anything useful:

$ kubectl logs cilium-b6m22 -n kube-system
Defaulted container "cilium-agent" out of: cilium-agent, mount-cgroup (init), clean-cilium-state (init)
$

The kubectl describe pod cilium-b6m22 -n kube-system reveal the symptom - PostStartHook failed.

This is how the Pods status look like:

$ kubectl get pod -n kube-system
NAME                               READY   STATUS             RESTARTS      AGE
cilium-b6m22                       0/1     CrashLoopBackOff   7 (79s ago)   12m
cilium-operator-86f4c5579c-dx799   1/1     Running            0             12m
coredns-7db6d8ff4d-q2wgd           0/1     CrashLoopBackOff   9 (29s ago)   12m
etcd-minikube                      1/1     Running            0             12m
kube-apiserver-minikube            1/1     Running            0             12m
kube-controller-manager-minikube   1/1     Running            0             12m
kube-proxy-xmhgn                   1/1     Running            0             12m
kube-scheduler-minikube            1/1     Running            0             12m
storage-provisioner                1/1     Running            1 (12m ago)   12m
$

To reproduce:

brew update
brew upgrade
brew install minikube
minikube start --cni=cilium

This seems like a regression as it used to work without any problems on this machine.

It also reproduces on my other MacBook Pro 16' M2.

Attach the log file

==> Audit <== --------- -------------- ---------- ----------- --------- --------------------- --------------------- Command Args Profile User Version Start Time End Time
start --cni=cilium minikube ofircohen v1.33.0 11 May 24 16:55 IDT 11 May 24 16:56 IDT
--------- -------------- ---------- ----------- --------- --------------------- ---------------------

==> Last Start <== Log file created at: 2024/05/11 16:55:01 Running on machine: Ofirs-MacBook-Air Binary: Built with gc go1.22.2 for darwin/arm64 Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg I0511 16:55:01.631231 98749 out.go:291] Setting OutFile to fd 1 ... I0511 16:55:01.631710 98749 out.go:343] isatty.IsTerminal(1) = true I0511 16:55:01.631712 98749 out.go:304] Setting ErrFile to fd 2... I0511 16:55:01.631714 98749 out.go:343] isatty.IsTerminal(2) = true I0511 16:55:01.631861 98749 root.go:338] Updating PATH: /Users/ofircohen/.minikube/bin W0511 16:55:01.631969 98749 root.go:314] Error reading config file at /Users/ofircohen/.minikube/config/config.json: open /Users/ofircohen/.minikube/config/config.json: no such file or directory I0511 16:55:01.632698 98749 out.go:298] Setting JSON to false I0511 16:55:01.650178 98749 start.go:129] hostinfo: {"hostname":"Ofirs-MacBook-Air.local","uptime":13356969,"bootTime":1702078732,"procs":594,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.2","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"c8b5fb5b-b925-566d-b723-1c23ead5117c"} W0511 16:55:01.650234 98749 start.go:137] gopshost.Virtualization returned error: not implemented yet I0511 16:55:01.661248 98749 out.go:177] 😄 minikube v1.33.0 on Darwin 14.1.2 (arm64) W0511 16:55:01.674706 98749 preload.go:294] Failed to list preload files: open /Users/ofircohen/.minikube/cache/preloaded-tarball: no such file or directory I0511 16:55:01.674857 98749 notify.go:220] Checking for updates... I0511 16:55:01.675171 98749 driver.go:392] Setting default libvirt URI to qemu:///system I0511 16:55:01.675201 98749 global.go:112] Querying for installed drivers using PATH=/Users/ofircohen/.minikube/bin:/opt/homebrew/bin:/opt/homebrew/sbin:/usr/local/bin:/System/Cryptexes/App/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/local/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/appleinternal/bin:/usr/local/go/bin I0511 16:55:01.675713 98749 global.go:133] qemu2 default: true priority: 7, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "qemu-system-aarch64": executable file not found in $PATH Reason: Fix:Install qemu-system Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/qemu/ Version:} I0511 16:55:01.675774 98749 global.go:133] virtualbox default: true priority: 6, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:unable to find VBoxManage in $PATH Reason: Fix:Install VirtualBox Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/virtualbox/ Version:} I0511 16:55:01.675829 98749 global.go:133] vmware default: false priority: 5, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "vmrun": executable file not found in $PATH Reason: Fix:Install vmrun Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/vmware/ Version:} I0511 16:55:01.772138 98749 docker.go:122] docker version: linux-26.0.0:Docker Desktop 4.29.0 (145265) I0511 16:55:01.772399 98749 cli_runner.go:164] Run: docker system info --format "{{json .}}" I0511 16:55:02.058000 98749 info.go:266] docker info: {ID:b35012e7-6720-4de9-95f2-2935200ad1d1 Containers:10 ContainersRunning:0 ContainersPaused:0 ContainersStopped:10 Images:14 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:95 SystemTime:2024-05-11 13:55:02.044439013 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:23 KernelVersion:6.6.22-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:8222072832 GenericResources: DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=unix:///Users/ofircohen/Library/Containers/com.docker.docker/Data/docker-cli.sock] ExperimentalBuild:false ServerVersion:26.0.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/ofircohen/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.1-desktop.1] map[Name:compose Path:/Users/ofircohen/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1-desktop.1] map[Name:debug Path:/Users/ofircohen/.docker/cli-plugins/docker-debug SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.27] map[Name:dev Path:/Users/ofircohen/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:/Users/ofircohen/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.23] map[Name:feedback Path:/Users/ofircohen/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:/Users/ofircohen/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.1.0] map[Name:sbom Path:/Users/ofircohen/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:/Users/ofircohen/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.6.3]] Warnings:}} I0511 16:55:02.058093 98749 global.go:133] docker default: true priority: 9, state: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: Version:} I0511 16:55:02.058210 98749 global.go:133] podman default: true priority: 3, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "podman": executable file not found in $PATH Reason: Fix:Install Podman Doc:https://minikube.sigs.k8s.io/docs/drivers/podman/ Version:} I0511 16:55:02.058224 98749 global.go:133] ssh default: false priority: 4, state: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: Version:} I0511 16:55:02.058525 98749 global.go:133] hyperkit default: true priority: 8, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "hyperkit": executable file not found in $PATH Reason: Fix:Run 'brew install hyperkit' Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/hyperkit/ Version:} I0511 16:55:02.058569 98749 global.go:133] parallels default: true priority: 7, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "prlctl": executable file not found in $PATH Reason: Fix:Install Parallels Desktop for Mac Doc:https://minikube.sigs.k8s.io/docs/drivers/parallels/ Version:} I0511 16:55:02.058581 98749 driver.go:314] not recommending "ssh" due to default: false I0511 16:55:02.058590 98749 driver.go:349] Picked: docker I0511 16:55:02.058593 98749 driver.go:350] Alternatives: [ssh] I0511 16:55:02.058594 98749 driver.go:351] Rejects: [qemu2 virtualbox vmware podman hyperkit parallels] I0511 16:55:02.063128 98749 out.go:177] ✨ Automatically selected the docker driver I0511 16:55:02.071368 98749 start.go:297] selected driver: docker I0511 16:55:02.071370 98749 start.go:901] validating driver "docker" against I0511 16:55:02.071376 98749 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: Version:} I0511 16:55:02.071684 98749 cli_runner.go:164] Run: docker system info --format "{{json .}}" I0511 16:55:02.148986 98749 info.go:266] docker info: {ID:b35012e7-6720-4de9-95f2-2935200ad1d1 Containers:10 ContainersRunning:0 ContainersPaused:0 ContainersStopped:10 Images:14 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:95 SystemTime:2024-05-11 13:55:02.135646263 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:23 KernelVersion:6.6.22-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:8222072832 GenericResources: DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=unix:///Users/ofircohen/Library/Containers/com.docker.docker/Data/docker-cli.sock] ExperimentalBuild:false ServerVersion:26.0.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/ofircohen/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.1-desktop.1] map[Name:compose Path:/Users/ofircohen/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1-desktop.1] map[Name:debug Path:/Users/ofircohen/.docker/cli-plugins/docker-debug SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.27] map[Name:dev Path:/Users/ofircohen/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:/Users/ofircohen/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.23] map[Name:feedback Path:/Users/ofircohen/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:/Users/ofircohen/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.1.0] map[Name:sbom Path:/Users/ofircohen/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:/Users/ofircohen/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.6.3]] Warnings:}} I0511 16:55:02.149104 98749 start_flags.go:310] no existing cluster config was found, will generate one from the flags I0511 16:55:02.149188 98749 start_flags.go:393] Using suggested 4000MB memory alloc based on sys=16384MB, container=7841MB I0511 16:55:02.149778 98749 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true] I0511 16:55:02.154361 98749 out.go:177] 📌 Using Docker Desktop driver with root privileges I0511 16:55:02.158263 98749 cni.go:84] Creating CNI manager for "cilium" I0511 16:55:02.158267 98749 start_flags.go:319] Found "Cilium" CNI - setting NetworkPlugin=cni I0511 16:55:02.158504 98749 start.go:340] cluster config: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} I0511 16:55:02.162139 98749 out.go:177] 👍 Starting "minikube" primary control-plane node in "minikube" cluster I0511 16:55:02.170311 98749 cache.go:121] Beginning downloading kic base image for docker with docker I0511 16:55:02.174296 98749 out.go:177] 🚜 Pulling base image v0.0.43 ... I0511 16:55:02.182364 98749 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime docker I0511 16:55:02.182379 98749 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 in local docker daemon I0511 16:55:02.226121 98749 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 to local cache I0511 16:55:02.226319 98749 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 in local cache directory I0511 16:55:02.226425 98749 image.go:118] Writing gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 to local cache I0511 16:55:02.342987 98749 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.30.0/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4 I0511 16:55:02.343002 98749 cache.go:56] Caching tarball of preloaded images I0511 16:55:02.345701 98749 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime docker I0511 16:55:02.351060 98749 out.go:177] 💾 Downloading Kubernetes v1.30.0 preload ... I0511 16:55:02.359014 98749 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4 ... I0511 16:55:02.599202 98749 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.30.0/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4?checksum=md5:677034533668c42fec962cc52f9b3c42 -> /Users/ofircohen/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4 I0511 16:55:29.461266 98749 preload.go:248] saving checksum for preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4 ... I0511 16:55:29.461430 98749 preload.go:255] verifying checksum of /Users/ofircohen/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4 ... I0511 16:55:30.051953 98749 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on docker I0511 16:55:30.054001 98749 profile.go:143] Saving config to /Users/ofircohen/.minikube/profiles/minikube/config.json ... I0511 16:55:30.055425 98749 lock.go:35] WriteFile acquiring /Users/ofircohen/.minikube/profiles/minikube/config.json: {Name:mk6e349d582ba5a26886ffe6b9463f994887af5d Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0511 16:55:38.538964 98749 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 as a tarball I0511 16:55:38.538987 98749 cache.go:162] Loading gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 from local cache I0511 16:55:47.970644 98749 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 from cached tarball I0511 16:55:47.970770 98749 cache.go:194] Successfully downloaded all kic artifacts I0511 16:55:47.983362 98749 start.go:360] acquireMachinesLock for minikube: {Name:mkfc5d3164d093f043553b55467a8e775ae5153f Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0511 16:55:47.990075 98749 start.go:364] duration metric: took 5.055291ms to acquireMachinesLock for "minikube" I0511 16:55:47.990546 98749 start.go:93] Provisioning new machine with config: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true} I0511 16:55:47.993326 98749 start.go:125] createHost starting for "" (driver="docker") I0511 16:55:48.246378 98749 out.go:204] 🔥 Creating docker container (CPUs=2, Memory=4000MB) ... I0511 16:55:48.278746 98749 start.go:159] libmachine.API.Create for "minikube" (driver="docker") I0511 16:55:48.283727 98749 client.go:168] LocalClient.Create starting I0511 16:55:48.297873 98749 main.go:141] libmachine: Creating CA: /Users/ofircohen/.minikube/certs/ca.pem I0511 16:55:48.550963 98749 main.go:141] libmachine: Creating client certificate: /Users/ofircohen/.minikube/certs/cert.pem I0511 16:55:48.673567 98749 cli_runner.go:164] Run: docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" W0511 16:55:48.717468 98749 cli_runner.go:211] docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1 I0511 16:55:48.717550 98749 network_create.go:281] running [docker network inspect minikube] to gather additional debugging logs... I0511 16:55:48.717562 98749 cli_runner.go:164] Run: docker network inspect minikube W0511 16:55:48.755720 98749 cli_runner.go:211] docker network inspect minikube returned with exit code 1 I0511 16:55:48.755762 98749 network_create.go:284] error running [docker network inspect minikube]: docker network inspect minikube: exit status 1 stdout: []

stderr: Error response from daemon: network minikube not found I0511 16:55:48.755775 98749 network_create.go:286] output of [docker network inspect minikube]: -- stdout -- []

-- /stdout -- stderr Error response from daemon: network minikube not found

/stderr I0511 16:55:48.756098 98749 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" I0511 16:55:48.796049 98749 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x14016ba8270} I0511 16:55:48.796397 98749 network_create.go:124] attempt to create docker network minikube 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 65535 ... I0511 16:55:48.796694 98749 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=minikube minikube I0511 16:55:48.885290 98749 network_create.go:108] docker network minikube 192.168.49.0/24 created I0511 16:55:48.890561 98749 kic.go:121] calculated static IP "192.168.49.2" for the "minikube" container I0511 16:55:48.895953 98749 cli_runner.go:164] Run: docker ps -a --format {{.Names}} I0511 16:55:48.937230 98749 cli_runner.go:164] Run: docker volume create minikube --label name.minikube.sigs.k8s.io=minikube --label created_by.minikube.sigs.k8s.io=true I0511 16:55:48.981526 98749 oci.go:103] Successfully created a docker volume minikube I0511 16:55:48.981612 98749 cli_runner.go:164] Run: docker run --rm --name minikube-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=minikube --entrypoint /usr/bin/test -v minikube:/var gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 -d /var/lib I0511 16:55:49.741363 98749 oci.go:107] Successfully prepared a docker volume minikube I0511 16:55:49.747926 98749 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime docker I0511 16:55:49.758598 98749 kic.go:194] Starting extracting preloaded images to volume ... I0511 16:55:49.763643 98749 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/ofircohen/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v minikube:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 -I lz4 -xf /preloaded.tar -C /extractDir I0511 16:55:53.335200 98749 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/ofircohen/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v minikube:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 -I lz4 -xf /preloaded.tar -C /extractDir: (3.571360916s) I0511 16:55:53.335306 98749 kic.go:203] duration metric: took 3.5766885s to extract preloaded images to volume ... I0511 16:55:53.335522 98749 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'" I0511 16:55:53.923417 98749 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname minikube --name minikube --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=minikube --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=minikube --network minikube --ip 192.168.49.2 --volume minikube:/var --security-opt apparmor=unconfined --memory=4000mb --memory-swap=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 I0511 16:55:54.559333 98749 cli_runner.go:164] Run: docker container inspect minikube --format={{.State.Running}} I0511 16:55:54.609398 98749 cli_runner.go:164] Run: docker container inspect minikube --format={{.State.Status}} I0511 16:55:54.649289 98749 cli_runner.go:164] Run: docker exec minikube stat /var/lib/dpkg/alternatives/iptables I0511 16:55:54.716272 98749 oci.go:144] the created container "minikube" has a running status. I0511 16:55:54.716315 98749 kic.go:225] Creating ssh key for kic: /Users/ofircohen/.minikube/machines/minikube/id_rsa... I0511 16:55:54.897063 98749 kic_runner.go:191] docker (temp): /Users/ofircohen/.minikube/machines/minikube/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes) I0511 16:55:54.973609 98749 cli_runner.go:164] Run: docker container inspect minikube --format={{.State.Status}} I0511 16:55:55.025494 98749 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys I0511 16:55:55.025519 98749 kic_runner.go:114] Args: [docker exec --privileged minikube chown docker:docker /home/docker/.ssh/authorized_keys] I0511 16:55:55.103460 98749 cli_runner.go:164] Run: docker container inspect minikube --format={{.State.Status}} I0511 16:55:55.148186 98749 machine.go:94] provisionDockerMachine start ... I0511 16:55:55.149092 98749 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0511 16:55:55.191386 98749 main.go:141] libmachine: Using SSH client type: native I0511 16:55:55.191993 98749 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x102963280] 0x102965ae0 [] 0s} 127.0.0.1 51346 } I0511 16:55:55.191999 98749 main.go:141] libmachine: About to run SSH command: hostname I0511 16:55:55.319090 98749 main.go:141] libmachine: SSH cmd err, output: : minikube

I0511 16:55:55.319553 98749 ubuntu.go:169] provisioning hostname "minikube" I0511 16:55:55.320033 98749 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0511 16:55:55.362621 98749 main.go:141] libmachine: Using SSH client type: native I0511 16:55:55.362790 98749 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x102963280] 0x102965ae0 [] 0s} 127.0.0.1 51346 } I0511 16:55:55.362795 98749 main.go:141] libmachine: About to run SSH command: sudo hostname minikube && echo "minikube" | sudo tee /etc/hostname I0511 16:55:55.495109 98749 main.go:141] libmachine: SSH cmd err, output: : minikube

I0511 16:55:55.495429 98749 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0511 16:55:55.548342 98749 main.go:141] libmachine: Using SSH client type: native I0511 16:55:55.548560 98749 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x102963280] 0x102965ae0 [] 0s} 127.0.0.1 51346 } I0511 16:55:55.548568 98749 main.go:141] libmachine: About to run SSH command:

    if ! grep -xq '.*\sminikube' /etc/hosts; then
        if grep -xq '127.0.1.1\s.*' /etc/hosts; then
            sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 minikube/g' /etc/hosts;
        else 
            echo '127.0.1.1 minikube' | sudo tee -a /etc/hosts; 
        fi
    fi

I0511 16:55:55.680494 98749 main.go:141] libmachine: SSH cmd err, output: : I0511 16:55:55.680516 98749 ubuntu.go:175] set auth options {CertDir:/Users/ofircohen/.minikube CaCertPath:/Users/ofircohen/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/ofircohen/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/ofircohen/.minikube/machines/server.pem ServerKeyPath:/Users/ofircohen/.minikube/machines/server-key.pem ClientKeyPath:/Users/ofircohen/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/ofircohen/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/ofircohen/.minikube} I0511 16:55:55.680552 98749 ubuntu.go:177] setting up certificates I0511 16:55:55.680952 98749 provision.go:84] configureAuth start I0511 16:55:55.681248 98749 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" minikube I0511 16:55:55.728737 98749 provision.go:143] copyHostCerts I0511 16:55:55.729150 98749 exec_runner.go:151] cp: /Users/ofircohen/.minikube/certs/ca.pem --> /Users/ofircohen/.minikube/ca.pem (1086 bytes) I0511 16:55:55.729351 98749 exec_runner.go:151] cp: /Users/ofircohen/.minikube/certs/cert.pem --> /Users/ofircohen/.minikube/cert.pem (1131 bytes) I0511 16:55:55.729604 98749 exec_runner.go:151] cp: /Users/ofircohen/.minikube/certs/key.pem --> /Users/ofircohen/.minikube/key.pem (1679 bytes) I0511 16:55:55.729928 98749 provision.go:117] generating server cert: /Users/ofircohen/.minikube/machines/server.pem ca-key=/Users/ofircohen/.minikube/certs/ca.pem private-key=/Users/ofircohen/.minikube/certs/ca-key.pem org=ofircohen.minikube san=[127.0.0.1 192.168.49.2 localhost minikube] I0511 16:55:55.767575 98749 provision.go:177] copyRemoteCerts I0511 16:55:55.768316 98749 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker I0511 16:55:55.768364 98749 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0511 16:55:55.808435 98749 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51346 SSHKeyPath:/Users/ofircohen/.minikube/machines/minikube/id_rsa Username:docker} I0511 16:55:55.896118 98749 ssh_runner.go:362] scp /Users/ofircohen/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1086 bytes) I0511 16:55:55.912423 98749 ssh_runner.go:362] scp /Users/ofircohen/.minikube/machines/server.pem --> /etc/docker/server.pem (1188 bytes) I0511 16:55:55.932639 98749 ssh_runner.go:362] scp /Users/ofircohen/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes) I0511 16:55:55.950592 98749 provision.go:87] duration metric: took 269.623958ms to configureAuth I0511 16:55:55.950613 98749 ubuntu.go:193] setting minikube options for container-runtime I0511 16:55:55.954251 98749 config.go:182] Loaded profile config "minikube": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.30.0 I0511 16:55:55.954476 98749 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0511 16:55:56.017676 98749 main.go:141] libmachine: Using SSH client type: native I0511 16:55:56.017884 98749 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x102963280] 0x102965ae0 [] 0s} 127.0.0.1 51346 } I0511 16:55:56.017893 98749 main.go:141] libmachine: About to run SSH command: df --output=fstype / | tail -n 1 I0511 16:55:56.142251 98749 main.go:141] libmachine: SSH cmd err, output: : overlay

I0511 16:55:56.142262 98749 ubuntu.go:71] root file system type: overlay I0511 16:55:56.142719 98749 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ... I0511 16:55:56.142830 98749 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0511 16:55:56.194548 98749 main.go:141] libmachine: Using SSH client type: native I0511 16:55:56.195532 98749 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x102963280] 0x102965ae0 [] 0s} 127.0.0.1 51346 } I0511 16:55:56.195564 98749 main.go:141] libmachine: About to run SSH command: sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com BindsTo=containerd.service After=network-online.target firewalld.service containerd.service Wants=network-online.target Requires=docker.socket StartLimitBurst=3 StartLimitIntervalSec=60

[Service] Type=notify Restart=on-failure

Operating System

Mac OS X Sonoma 14.1.2 (23B92)

Driver

Docker

ofirc commented 5 months ago

I can confirm it is a regression and it works in v1.32.0 from Nov 8, 2023: https://github.com/kubernetes/minikube/releases

➜  Downloads kubectl get pod -n kube-system
NAME                               READY   STATUS    RESTARTS        AGE
cilium-c75mg                       1/1     Running   0               4m59s
cilium-operator-7d98fd79fc-fz669   1/1     Running   0               4m58s
coredns-5dd5756b68-jlptm           1/1     Running   2 (4m31s ago)   4m58s
etcd-minikube                      1/1     Running   0               5m11s
kube-apiserver-minikube            1/1     Running   0               5m11s
kube-controller-manager-minikube   1/1     Running   0               5m11s
kube-proxy-t4vt9                   1/1     Running   0               4m59s
kube-scheduler-minikube            1/1     Running   0               5m12s
storage-provisioner                1/1     Running   0               5m10s
➜  Downloads
spowelljr commented 5 months ago

Resolved by https://github.com/kubernetes/minikube/pull/18846

spowelljr commented 5 months ago

Fix is included in latest release of minikube: https://github.com/kubernetes/minikube/releases/tag/v1.33.1