search

kubernetes / minikube

Run Kubernetes locally
https://minikube.sigs.k8s.io/
Apache License 2.0
29.56k stars 4.89k forks source link

Cannot start minikube anymore #19745

Open nikita-fuchs opened 1 month ago

nikita-fuchs commented 1 month ago

What Happened?

First of all, sorry for the german in the logs, the application does this automatically?

I tried running Minikube a second time after I somehow managed to fix this issue once already, I do not remember though how I did it:

minikube start --driver qemu --network socket_vmnet
😄  minikube v1.34.0 auf Darwin 14.6.1 (arm64)
✨  Verwende den Treiber qemu2 basierend auf der Benutzer-Konfiguration
👍  Starte "minikube" primary control-plane Node im "minikube" Cluster
🔥  Erstelle qemu2 VM (CPUs=2, Speicher=6000MB, Disk=20000MB ...- OUTPUT:
ERROR: Failed to connect to "/opt/homebrew/var/run/socket_vmnet": Connection refused

🔥  "minikube" in qemu2 wird gelöscht...
🤦  StartHost fehlgeschlagen, aber es wird noch einmal versucht: creating host: create: creating: Failed to connect to "/opt/homebrew/var/run/socket_vmnet": Connection refused: exit status 1
🔥  Erstelle qemu2 VM (CPUs=2, Speicher=6000MB, Disk=20000MB ...- OUTPUT:
ERROR: Failed to connect to "/opt/homebrew/var/run/socket_vmnet": Connection refused

😿  Start von qemu2 VM fehlgeschlagen. Das Ausführen von "minikube delete" könnte des Beheben: creating host: create: creating: Failed to connect to "/opt/homebrew/var/run/socket_vmnet": Connection refused: exit status 1

❌  Terminiere aufgrund von GUEST_PROVISION: error provisioning guest: Failed to start host: creating host: create: creating: Failed to connect to "/opt/homebrew/var/run/socket_vmnet": Connection refused: exit status 1

After restarting the socket_vmnet service and running delete --all, it was stuck starting forever:

minikube start --driver qemu --network socket_vmnet
😄  minikube v1.34.0 auf Darwin 14.6.1 (arm64)
✨  Verwende den Treiber qemu2 basierend auf dem existierenden Profil
👍  Starte "minikube" primary control-plane Node im "minikube" Cluster
🔄  Starte existierenden qemu2 VM für "minikube" ...

and after mercy-killing it and trying again, it is stuck in this state ('Aktualisiere' means something like "Refreshing/Updating" in german):

minikube start --driver qemu --network socket_vmnet
😄  minikube v1.34.0 auf Darwin 14.6.1 (arm64)
✨  Verwende den Treiber qemu2 basierend auf dem existierenden Profil
👍  Starte "minikube" primary control-plane Node im "minikube" Cluster
🏃  Aktualisiere den laufenden qemu2 "minikube" VM ...

Attach the log file

First comes the log.txt, next comes running the last command from above with --alsologtostderr

==> Audit <==
|-----------|--------------------------------|----------|--------------|---------|----------------------|----------------------|
|  Command  |              Args              | Profile  |     User     | Version |      Start Time      |       End Time       |
|-----------|--------------------------------|----------|--------------|---------|----------------------|----------------------|
| start     | --driver=virtualbox            | minikube | XXXXX | v1.33.1 | 12 Sep 24 14:30 CEST |                      |
| start     | --driver=virtualbox            | minikube | XXXXX | v1.33.1 | 12 Sep 24 14:30 CEST |                      |
| start     | --driver=qemu                  | minikube | XXXXX | v1.33.1 | 12 Sep 24 14:32 CEST |                      |
| start     | --driver=qemu                  | minikube | XXXXX | v1.33.1 | 12 Sep 24 14:35 CEST |                      |
| start     | --driver=qemu                  | minikube | XXXXX | v1.33.1 | 12 Sep 24 14:43 CEST |                      |
| start     | --driver=qemu                  | minikube | XXXXX | v1.33.1 | 12 Sep 24 14:45 CEST |                      |
|           | --network=socket_vmnet         |          |              |         |                      |                      |
| start     | --driver=qemu                  | minikube | XXXXX | v1.33.1 | 12 Sep 24 14:46 CEST |                      |
|           | --network=socket_vmnet         |          |              |         |                      |                      |
| start     | --driver=qemu                  | minikube | XXXXX | v1.33.1 | 12 Sep 24 14:49 CEST |                      |
|           | --network=socket_vmnet         |          |              |         |                      |                      |
| start     | --driver=qemu                  | minikube | XXXXX | v1.33.1 | 12 Sep 24 14:50 CEST |                      |
| start     | --driver=qemu                  | minikube | XXXXX | v1.33.1 | 12 Sep 24 14:51 CEST |                      |
|           | --network=standalone           |          |              |         |                      |                      |
| start     | --driver=qemu                  | minikube | XXXXX | v1.33.1 | 12 Sep 24 14:51 CEST |                      |
|           | --network=standard             |          |              |         |                      |                      |
| start     | --driver=qemu                  | minikube | XXXXX | v1.33.1 | 12 Sep 24 14:53 CEST |                      |
| start     | --driver=qemu                  | minikube | XXXXX | v1.33.1 | 12 Sep 24 14:59 CEST |                      |
| start     | --driver=virtualbox            | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:07 CEST |                      |
| delete    |                                | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:07 CEST | 12 Sep 24 15:07 CEST |
| start     | --driver=virtualbox            | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:07 CEST |                      |
| start     | --driver=virtualbox            | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:08 CEST |                      |
| delete    |                                | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:11 CEST | 12 Sep 24 15:11 CEST |
| start     | --driver=qemu                  | minikube | root         | v1.33.1 | 12 Sep 24 15:11 CEST |                      |
| start     | --driver=qemu                  | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:12 CEST |                      |
| start     | --driver=qemu                  | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:12 CEST | 12 Sep 24 15:13 CEST |
| dashboard |                                | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:19 CEST |                      |
| service   | hello-minikube --url           | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:22 CEST | 12 Sep 24 15:22 CEST |
| service   | hello-node                     | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:31 CEST | 12 Sep 24 15:31 CEST |
| service   | hello-node                     | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:34 CEST | 12 Sep 24 15:34 CEST |
| addons    | list                           | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:55 CEST | 12 Sep 24 15:55 CEST |
| addons    | enable metrics-server          | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:56 CEST | 12 Sep 24 15:56 CEST |
| delete    | deployment hello-node          | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:58 CEST |                      |
| delete    | deployment hello-minikube      | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:58 CEST |                      |
| delete    | deployment hello-minikube      | minikube | XXXXX | v1.33.1 | 12 Sep 24 15:58 CEST |                      |
| stop      |                                | minikube | XXXXX | v1.33.1 | 12 Sep 24 16:34 CEST | 12 Sep 24 16:34 CEST |
| start     |                                | minikube | XXXXX | v1.33.1 | 13 Sep 24 10:46 CEST | 13 Sep 24 10:48 CEST |
| ip        |                                | minikube | XXXXX | v1.33.1 | 17 Sep 24 11:58 CEST | 17 Sep 24 11:58 CEST |
| ip        |                                | minikube | XXXXX | v1.33.1 | 17 Sep 24 12:09 CEST | 17 Sep 24 12:09 CEST |
| service   | myapp-service --url            | minikube | XXXXX | v1.33.1 | 17 Sep 24 12:36 CEST | 17 Sep 24 12:36 CEST |
| start     |                                | minikube | XXXXX | v1.33.1 | 03 Oct 24 10:16 CEST |                      |
| start     | --driver qemu --network        | minikube | XXXXX | v1.33.1 | 03 Oct 24 10:17 CEST |                      |
|           | socket_vmnet                   |          |              |         |                      |                      |
|-----------|--------------------------------|----------|--------------|---------|----------------------|----------------------|

==> Letzter Start <==
Log file created at: 2024/10/03 10:17:22
Running on machine: MacBook-Pro-3
Binary: Built with gc go1.22.3 for darwin/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1003 10:17:22.482171   87315 out.go:291] Setting OutFile to fd 1 ...
I1003 10:17:22.482307   87315 out.go:343] isatty.IsTerminal(1) = true
I1003 10:17:22.482309   87315 out.go:304] Setting ErrFile to fd 2...
I1003 10:17:22.482312   87315 out.go:343] isatty.IsTerminal(2) = true
I1003 10:17:22.482468   87315 root.go:338] Updating PATH: /Users/XXXXX/.minikube/bin
I1003 10:17:22.482820   87315 out.go:298] Setting JSON to false
I1003 10:17:22.506754   87315 start.go:129] hostinfo: {"hostname":"MacBook-Pro-3.local","uptime":311028,"bootTime":1727632414,"procs":932,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.6.1","kernelVersion":"23.6.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"c3acd77e-814e-5c60-9a92-06efbfb56a95"}
W1003 10:17:22.506865   87315 start.go:137] gopshost.Virtualization returned error: not implemented yet
I1003 10:17:22.513365   87315 out.go:177] 😄  minikube v1.33.1 auf Darwin 14.6.1 (arm64)
I1003 10:17:22.522779   87315 notify.go:220] Checking for updates...
I1003 10:17:22.523059   87315 config.go:182] Loaded profile config "minikube": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.30.0
I1003 10:17:22.523309   87315 driver.go:392] Setting default libvirt URI to qemu:///system
I1003 10:17:22.527382   87315 out.go:177] ✨  Verwende den Treiber qemu2 basierend auf dem existierenden Profil
I1003 10:17:22.535453   87315 start.go:297] selected driver: qemu2
I1003 10:17:22.535459   87315 start.go:901] validating driver "qemu2" against &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.33.1-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.44@sha256:eb04641328b06c5c4a14f4348470e1046bbcf9c2cbc551486e343d3a49db557e Memory:6000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.3 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/homebrew/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/opt/homebrew/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1003 10:17:22.535504   87315 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1003 10:17:22.535647   87315 cni.go:84] Creating CNI manager for ""
I1003 10:17:22.535653   87315 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I1003 10:17:22.535680   87315 start.go:340] cluster config:
{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.33.1-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.44@sha256:eb04641328b06c5c4a14f4348470e1046bbcf9c2cbc551486e343d3a49db557e Memory:6000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.105.3 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/homebrew/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/opt/homebrew/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1003 10:17:22.540429   87315 iso.go:125] acquiring lock: {Name:mk1dff309fb4919163eb322ddd13cc30974d3734 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1003 10:17:22.548319   87315 out.go:177] 👍  Starte "minikube" primary control-plane Node im "minikube" Cluster
I1003 10:17:22.552245   87315 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime docker
I1003 10:17:22.552267   87315 preload.go:147] Found local preload: /Users/XXXXX/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4
I1003 10:17:22.552285   87315 cache.go:56] Caching tarball of preloaded images
I1003 10:17:22.552365   87315 preload.go:173] Found /Users/XXXXX/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I1003 10:17:22.552370   87315 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on docker
I1003 10:17:22.552442   87315 profile.go:143] Saving config to /Users/XXXXX/.minikube/profiles/minikube/config.json ...
I1003 10:17:22.552842   87315 start.go:360] acquireMachinesLock for minikube: {Name:mka3ece94ea185f75e472ae3c632d22a86decabe Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1003 10:17:22.552871   87315 start.go:364] duration metric: took 23.917µs to acquireMachinesLock for "minikube"
I1003 10:17:22.552878   87315 start.go:96] Skipping create...Using existing machine configuration
I1003 10:17:22.552885   87315 fix.go:54] fixHost starting:
I1003 10:17:22.552993   87315 fix.go:112] recreateIfNeeded on minikube: state=Stopped err=<nil>
W1003 10:17:22.552999   87315 fix.go:138] unexpected machine state, will restart: <nil>
I1003 10:17:22.557417   87315 out.go:177] 🔄  Starte existierenden qemu2 VM für "minikube" ...
I1003 10:17:22.565362   87315 main.go:141] libmachine: executing: /opt/homebrew/opt/socket_vmnet/bin/socket_vmnet_client /opt/homebrew/var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 6000 -smp 2 -boot d -cdrom /Users/XXXXX/.minikube/machines/minikube/boot2docker.iso -qmp unix:/Users/XXXXX/.minikube/machines/minikube/monitor,server,nowait -pidfile /Users/XXXXX/.minikube/machines/minikube/qemu.pid -device virtio-net-pci,netdev=net0,mac=e6:e7:dc:29:50:99 -netdev socket,id=net0,fd=3 -daemonize /Users/XXXXX/.minikube/machines/minikube/disk.qcow2
I1003 10:17:22.567974   87315 main.go:141] libmachine: STDOUT:
I1003 10:17:22.567995   87315 main.go:141] libmachine: STDERR: Failed to connect to "/opt/homebrew/var/run/socket_vmnet": Connection refused

I1003 10:17:22.568030   87315 fix.go:56] duration metric: took 15.146042ms for fixHost
I1003 10:17:22.568034   87315 start.go:83] releasing machines lock for "minikube", held for 15.160375ms
W1003 10:17:22.568041   87315 start.go:713] error starting host: driver start: Failed to connect to "/opt/homebrew/var/run/socket_vmnet": Connection refused: exit status 1
W1003 10:17:22.568088   87315 out.go:239] 🤦  StartHost fehlgeschlagen, aber es wird noch einmal versucht: driver start: Failed to connect to "/opt/homebrew/var/run/socket_vmnet": Connection refused: exit status 1
I1003 10:17:22.568093   87315 start.go:728] Will try again in 5 seconds ...
I1003 10:17:27.569378   87315 start.go:360] acquireMachinesLock for minikube: {Name:mka3ece94ea185f75e472ae3c632d22a86decabe Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1003 10:17:27.569613   87315 start.go:364] duration metric: took 172.667µs to acquireMachinesLock for "minikube"
I1003 10:17:27.569661   87315 start.go:96] Skipping create...Using existing machine configuration
I1003 10:17:27.569671   87315 fix.go:54] fixHost starting:
I1003 10:17:27.570128   87315 fix.go:112] recreateIfNeeded on minikube: state=Stopped err=<nil>
W1003 10:17:27.570144   87315 fix.go:138] unexpected machine state, will restart: <nil>
I1003 10:17:27.575252   87315 out.go:177] 🔄  Starte existierenden qemu2 VM für "minikube" ...
I1003 10:17:27.585730   87315 main.go:141] libmachine: executing: /opt/homebrew/opt/socket_vmnet/bin/socket_vmnet_client /opt/homebrew/var/run/socket_vmnet qemu-system-aarch64 -M virt -cpu host -drive file=/opt/homebrew/opt/qemu/share/qemu/edk2-aarch64-code.fd,readonly=on,format=raw,if=pflash -display none -accel hvf -m 6000 -smp 2 -boot d -cdrom /Users/XXXXX/.minikube/machines/minikube/boot2docker.iso -qmp unix:/Users/XXXXX/.minikube/machines/minikube/monitor,server,nowait -pidfile /Users/XXXXX/.minikube/machines/minikube/qemu.pid -device virtio-net-pci,netdev=net0,mac=e6:e7:dc:29:50:99 -netdev socket,id=net0,fd=3 -daemonize /Users/XXXXX/.minikube/machines/minikube/disk.qcow2
I1003 10:17:27.590755   87315 main.go:141] libmachine: STDOUT:
I1003 10:17:27.590777   87315 main.go:141] libmachine: STDERR: Failed to connect to "/opt/homebrew/var/run/socket_vmnet": Connection refused

I1003 10:17:27.590818   87315 fix.go:56] duration metric: took 21.149375ms for fixHost
I1003 10:17:27.590826   87315 start.go:83] releasing machines lock for "minikube", held for 21.189875ms
W1003 10:17:27.590915   87315 out.go:239] 😿  Start von qemu2 VM fehlgeschlagen. Das Ausführen von "minikube delete" könnte des Beheben: driver start: Failed to connect to "/opt/homebrew/var/run/socket_vmnet": Connection refused: exit status 1
I1003 10:17:27.599157   87315 out.go:177]
W1003 10:17:27.603360   87315 out.go:239] ❌  Terminiere aufgrund von GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: Failed to connect to "/opt/homebrew/var/run/socket_vmnet": Connection refused: exit status 1
W1003 10:17:27.603383   87315 out.go:239]
W1003 10:17:27.605267   87315 out.go:239] ╭───────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                           │
│    😿  Bitte lassen Sie es uns wissen, falls der obige Hinweis nicht weiterhilft:                         │
│    👉  https://github.com/kubernetes/minikube/issues/new/choose                                           │
│                                                                                                           │
│    Bitte führen Sie `minikube logs --file=logs.txt` aus und fügen Sie logs.txt an das GitHub Issue an.    │
│                                                                                                           │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I1003 10:17:27.615159   87315 out.go:177]
minikube start --driver qemu --network socket_vmnet --alsologtostderr
I1003 11:10:05.640747   47940 out.go:345] Setting OutFile to fd 1 ...
I1003 11:10:05.640883   47940 out.go:397] isatty.IsTerminal(1) = true
I1003 11:10:05.640886   47940 out.go:358] Setting ErrFile to fd 2...
I1003 11:10:05.640890   47940 out.go:397] isatty.IsTerminal(2) = true
I1003 11:10:05.641054   47940 root.go:338] Updating PATH: /Users/XXXXX/.minikube/bin
I1003 11:10:05.641424   47940 out.go:352] Setting JSON to false
I1003 11:10:05.666412   47940 start.go:129] hostinfo: {"hostname":"MacBook-Pro-3.local","uptime":314191,"bootTime":1727632414,"procs":924,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.6.1","kernelVersion":"23.6.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"c3acd77e-814e-5c60-9a92-06efbfb56a95"}
W1003 11:10:05.666513   47940 start.go:137] gopshost.Virtualization returned error: not implemented yet
I1003 11:10:05.672386   47940 out.go:177] 😄  minikube v1.34.0 auf Darwin 14.6.1 (arm64)
😄  minikube v1.34.0 auf Darwin 14.6.1 (arm64)
I1003 11:10:05.683167   47940 notify.go:220] Checking for updates...
I1003 11:10:05.683538   47940 config.go:182] Loaded profile config "minikube": Driver=qemu2, ContainerRuntime=docker, KubernetesVersion=v1.31.0
I1003 11:10:05.683944   47940 driver.go:394] Setting default libvirt URI to qemu:///system
I1003 11:10:05.689092   47940 out.go:177] ✨  Verwende den Treiber qemu2 basierend auf dem existierenden Profil
✨  Verwende den Treiber qemu2 basierend auf dem existierenden Profil
I1003 11:10:05.694256   47940 start.go:297] selected driver: qemu2
I1003 11:10:05.694262   47940 start.go:901] validating driver "qemu2" against &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:6000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/homebrew/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/opt/homebrew/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1003 11:10:05.694364   47940 start.go:912] status for qemu2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I1003 11:10:05.694522   47940 cni.go:84] Creating CNI manager for ""
I1003 11:10:05.694548   47940 cni.go:158] "qemu2" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I1003 11:10:05.694567   47940 start.go:340] cluster config:
{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.34.0-arm64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.45@sha256:81df288595202a317b1a4dc2506ca2e4ed5f22373c19a441b88cfbf4b9867c85 Memory:6000 CPUs:2 DiskSize:20000 Driver:qemu2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network:socket_vmnet Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/homebrew/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/opt/homebrew/var/run/socket_vmnet StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I1003 11:10:05.699904   47940 iso.go:125] acquiring lock: {Name:mk66d2213086997042840a6673c29db47be11845 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1003 11:10:05.708124   47940 out.go:177] 👍  Starte "minikube" primary control-plane Node im "minikube" Cluster
👍  Starte "minikube" primary control-plane Node im "minikube" Cluster
I1003 11:10:05.712169   47940 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime docker
I1003 11:10:05.712191   47940 preload.go:146] Found local preload: /Users/XXXXX/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4
I1003 11:10:05.712200   47940 cache.go:56] Caching tarball of preloaded images
I1003 11:10:05.712277   47940 preload.go:172] Found /Users/XXXXX/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I1003 11:10:05.712284   47940 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on docker
I1003 11:10:05.712354   47940 profile.go:143] Saving config to /Users/XXXXX/.minikube/profiles/minikube/config.json ...
I1003 11:10:05.712882   47940 start.go:360] acquireMachinesLock for minikube: {Name:mka3ece94ea185f75e472ae3c632d22a86decabe Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I1003 11:10:05.712924   47940 start.go:364] duration metric: took 30.125µs to acquireMachinesLock for "minikube"
I1003 11:10:05.712933   47940 start.go:96] Skipping create...Using existing machine configuration
I1003 11:10:05.712937   47940 fix.go:54] fixHost starting:
I1003 11:10:05.713520   47940 fix.go:112] recreateIfNeeded on minikube: state=Running err=<nil>
W1003 11:10:05.713526   47940 fix.go:138] unexpected machine state, will restart: <nil>
I1003 11:10:05.718289   47940 out.go:177] 🏃  Aktualisiere den laufenden qemu2 "minikube" VM ...
🏃  Aktualisiere den laufenden qemu2 "minikube" VM ...
I1003 11:10:05.727071   47940 machine.go:93] provisionDockerMachine start ...
I1003 11:10:05.727182   47940 main.go:141] libmachine: Using SSH client type: native
I1003 11:10:05.727331   47940 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x1045014b0] 0x104503cf0 <nil>  [] 0s}  22 <nil> <nil>}
I1003 11:10:05.727337   47940 main.go:141] libmachine: About to run SSH command:
hostname
I1003 11:10:05.727521   47940 main.go:141] libmachine: Error dialing TCP: dial tcp :22: connect: connection refused
I1003 11:10:08.729053   47940 main.go:141] libmachine: Error dialing TCP: dial tcp :22: connect: connection refused
I1003 11:10:11.730894   47940 main.go:141] libmachine: Error dialing TCP: dial tcp :22: connect: connection refused
I1003 11:10:14.732403   47940 main.go:141] libmachine: Error dialing TCP: dial tcp :22: connect: connection refused
I1003 11:10:17.733881   47940 main.go:141] libmachine: Error dialing TCP: dial tcp :22: connect: connection refused

Operating System

macOS (Default)

Driver

QEMU

nikita-fuchs commented 1 month ago

I ran minikube delete --all one more time, and minikube start --driver qemu --network socket_vmnet --alsologtostderr again, and now it works. It might have been a firewall issue but I am not sure. This time I was asked something new and permitted ALL connections, whereas before I permitted just the one which was requested. Could somebody shine some light on this? Is this really just a firewall issue or would that be too easy?

spowelljr commented 1 month ago

It could very possibly be a firewall issue, we have logic that tries to detect if the firewall is blocking it, seems like it didn't pick it up on your machine though.

        if firewall.IsBootpdBlocked(cc) {
                if err := firewall.UnblockBootpd(); err != nil {
                        klog.Warningf("failed unblocking bootpd from firewall: %v", err)
                }
        }
nikita-fuchs commented 1 month ago

I am running the widely used LittleSnitch Firewall, maybe you can try to reproduce and handle that case? Feel free to close though.

mattt commented 2 days ago

@nikita-fuchs I got the same error message as you running minikube start --driver qemu --network socket_vmnet on my M4 MacBook running macOS 15.1.1. I used Homebrew to install and run socket_vmnet.

What fixed it for me was to start the service with sudo:

$ brew tap homebrew/services
$ brew install socket_vmnet
$ sudo brew services start socket_vmnet
Warning: Taking root:admin ownership of some socket_vmnet paths:
  /opt/homebrew/Cellar/socket_vmnet/1.1.7/bin
  /opt/homebrew/Cellar/socket_vmnet/1.1.7/bin/socket_vmnet
  /opt/homebrew/opt/socket_vmnet
  /opt/homebrew/opt/socket_vmnet/bin

I'm not sure if this is the right fix, but it resolved the error I was seeing. This could be related to https://github.com/Homebrew/homebrew-core/issues/125702.