Fedora 32, kvm: COMMAND_FAILED: 'python-nftables' failed

slinkydeveloper commented 4 years ago

Steps to reproduce the issue:

Just run minikube start --vm-driver=kvm2 without any previous minikube data (no ~/.minikube dir)

Fedora 32, kernel 5.7.8-200.fc32.x86_64

Full output of failed command:

W0720 10:52:12.825632   17987 root.go:246] Error reading config file at /home/slinkydeveloper/.minikube/config/config.json: open /home/slinkydeveloper/.minikube/config/config.json: no such file or directory
I0720 10:52:12.826004   17987 out.go:170] Setting JSON to false
I0720 10:52:12.840057   17987 start.go:101] hostinfo: {"hostname":"localhost.localdomain","uptime":9167,"bootTime":1595225965,"procs":372,"os":"linux","platform":"fedora","platformFamily":"fedora","platformVersion":"32","kernelVersion":"5.7.8-200.fc32.x86_64","virtualizationSystem":"kvm","virtualizationRole":"host","hostid":"339db0ca-59f8-4ccd-9174-6bc13fec0ada"}
I0720 10:52:12.841860   17987 start.go:111] virtualization: kvm host
😄  minikube v1.12.1 on Fedora 32
I0720 10:52:12.842113   17987 notify.go:125] Checking for updates...
I0720 10:52:12.842149   17987 driver.go:257] Setting default libvirt URI to qemu:///system
✨  Using the kvm2 driver based on user configuration
I0720 10:52:12.908049   17987 start.go:217] selected driver: kvm2
I0720 10:52:12.908058   17987 start.go:621] validating driver "kvm2" against <nil>
I0720 10:52:12.908078   17987 start.go:632] status for kvm2: {Installed:true Healthy:true NeedsImprovement:false Error:<nil> Fix: Doc:}
I0720 10:52:12.908122   17987 install.go:49] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0720 10:52:12.908423   17987 install.go:115] Validating docker-machine-driver-kvm2, PATH=hidden
W0720 10:52:12.908493   17987 install.go:59] docker-machine-driver-kvm2: exec: "docker-machine-driver-kvm2": executable file not found in $PATH
💾  Downloading driver docker-machine-driver-kvm2:
I0720 10:52:12.908608   17987 download.go:78] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.12.1/docker-machine-driver-kvm2?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.12.1/docker-machine-driver-kvm2.sha256 -> /home/slinkydeveloper/.minikube/bin/docker-machine-driver-kvm2
    > docker-machine-driver-kvm2.sha256: 65 B / 65 B [-------] 100.00% ? p/s 0s
    > docker-machine-driver-kvm2: 13.80 MiB / 13.80 MiB  100.00% 2.47 MiB p/s 6
I0720 10:52:22.691658   17987 start_flags.go:223] no existing cluster config was found, will generate one from the flags 
I0720 10:52:22.691735   17987 start_flags.go:237] Using suggested 6000MB memory alloc based on sys=31859MB, container=0MB
I0720 10:52:22.691806   17987 start_flags.go:594] Wait components to verify : map[apiserver:true system_pods:true]
I0720 10:52:22.691823   17987 cni.go:74] Creating CNI manager for ""
I0720 10:52:22.691829   17987 cni.go:117] CNI unnecessary in this configuration, recommending no CNI
I0720 10:52:22.691832   17987 start_flags.go:340] config:
{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.18.3 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true]}
I0720 10:52:22.691890   17987 iso.go:118] acquiring lock: {Name:mkdfc12b30a3c2ab8d56de425744103e88d4fc7b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
💿  Downloading VM boot image ...
I0720 10:52:22.692007   17987 download.go:78] Downloading: https://storage.googleapis.com/minikube/iso/minikube-v1.12.0.iso?checksum=file:https://storage.googleapis.com/minikube/iso/minikube-v1.12.0.iso.sha256 -> /home/slinkydeveloper/.minikube/cache/iso/minikube-v1.12.0.iso
    > minikube-v1.12.0.iso.sha256: 65 B / 65 B [-------------] 100.00% ? p/s 0s
    > minikube-v1.12.0.iso: 173.57 MiB / 173.57 MiB  100.00% 2.41 MiB p/s 1m12s
👍  Starting control plane node minikube in cluster minikube
I0720 10:53:37.179236   17987 preload.go:95] Checking if preload exists for k8s version v1.18.3 and runtime docker
I0720 10:53:37.386107   17987 preload.go:120] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v4-v1.18.3-docker-overlay2-amd64.tar.lz4
I0720 10:53:37.386201   17987 cache.go:51] Caching tarball of preloaded images
I0720 10:53:37.386282   17987 preload.go:95] Checking if preload exists for k8s version v1.18.3 and runtime docker
I0720 10:53:37.590949   17987 preload.go:120] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v4-v1.18.3-docker-overlay2-amd64.tar.lz4
💾  Downloading Kubernetes v1.18.3 preload ...
I0720 10:53:37.591432   17987 download.go:78] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v4-v1.18.3-docker-overlay2-amd64.tar.lz4 -> /home/slinkydeveloper/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v4-v1.18.3-docker-overlay2-amd64.tar.lz4
    > preloaded-images-k8s-v4-v1.18.3-docker-overlay2-amd64.tar.lz4: 526.27 MiB
I0720 10:57:24.132920   17987 preload.go:158] saving checksum for preloaded-images-k8s-v4-v1.18.3-docker-overlay2-amd64.tar.lz4 ...
I0720 10:57:24.389432   17987 preload.go:175] verifying checksumm of /home/slinkydeveloper/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v4-v1.18.3-docker-overlay2-amd64.tar.lz4 ...
I0720 10:57:25.326813   17987 cache.go:54] Finished verifying existence of preloaded tar for  v1.18.3 on docker
I0720 10:57:25.327021   17987 profile.go:150] Saving config to /home/slinkydeveloper/.minikube/profiles/minikube/config.json ...
I0720 10:57:25.327104   17987 lock.go:35] WriteFile acquiring /home/slinkydeveloper/.minikube/profiles/minikube/config.json: {Name:mk6ffb5a797a5b01f7aac5573c4b8c8535ec5150 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0720 10:57:25.327234   17987 cache.go:178] Successfully downloaded all kic artifacts
I0720 10:57:25.327249   17987 start.go:241] acquiring machines lock for minikube: {Name:mk0a9c7eb352eb1c53d02d9deee8d33f25d3bf80 Clock:{} Delay:500ms Timeout:15m0s Cancel:<nil>}
I0720 10:57:25.327303   17987 start.go:245] acquired machines lock for "minikube" in 46.6µs
I0720 10:57:25.327318   17987 start.go:85] Provisioning new machine with config: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.12.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.18.3 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.3 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true]} &{Name: IP: Port:8443 KubernetesVersion:v1.18.3 ControlPlane:true Worker:true}
I0720 10:57:25.327347   17987 start.go:122] createHost starting for "" (driver="kvm2")
🔥  Creating kvm2 VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
I0720 10:57:25.327459   17987 main.go:115] libmachine: Found binary path at /home/slinkydeveloper/.minikube/bin/docker-machine-driver-kvm2
I0720 10:57:25.327486   17987 main.go:115] libmachine: Launching plugin server for driver kvm2
I0720 10:57:25.340282   17987 main.go:115] libmachine: Plugin server listening at address 127.0.0.1:35741
I0720 10:57:25.340606   17987 main.go:115] libmachine: () Calling .GetVersion
I0720 10:57:25.340957   17987 main.go:115] libmachine: Using API Version  1
I0720 10:57:25.340969   17987 main.go:115] libmachine: () Calling .SetConfigRaw
I0720 10:57:25.341200   17987 main.go:115] libmachine: () Calling .GetMachineName
I0720 10:57:25.341276   17987 main.go:115] libmachine: (minikube) Calling .GetMachineName
I0720 10:57:25.341344   17987 main.go:115] libmachine: (minikube) Calling .DriverName
I0720 10:57:25.341400   17987 start.go:158] libmachine.API.Create for "minikube" (driver="kvm2")
I0720 10:57:25.341421   17987 client.go:161] LocalClient.Create starting
I0720 10:57:25.341449   17987 main.go:115] libmachine: Creating CA: /home/slinkydeveloper/.minikube/certs/ca.pem
I0720 10:57:25.450091   17987 main.go:115] libmachine: Creating client certificate: /home/slinkydeveloper/.minikube/certs/cert.pem
I0720 10:57:25.523154   17987 main.go:115] libmachine: Running pre-create checks...
I0720 10:57:25.523168   17987 main.go:115] libmachine: (minikube) Calling .PreCreateCheck
I0720 10:57:25.523416   17987 main.go:115] libmachine: (minikube) Calling .GetConfigRaw
I0720 10:57:25.523655   17987 main.go:115] libmachine: Creating machine...
I0720 10:57:25.523663   17987 main.go:115] libmachine: (minikube) Calling .Create
I0720 10:57:25.523752   17987 main.go:115] libmachine: (minikube) Creating KVM machine...
I0720 10:57:25.639286   17987 main.go:115] libmachine: (minikube) Setting up store path in /home/slinkydeveloper/.minikube/machines/minikube ...
I0720 10:57:25.639345   17987 main.go:115] libmachine: (minikube) Building disk image from file:///home/slinkydeveloper/.minikube/cache/iso/minikube-v1.12.0.iso
I0720 10:57:25.639476   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:25.639341   18194 common.go:99] Making disk image using store path: /home/slinkydeveloper/.minikube
I0720 10:57:25.639532   17987 main.go:115] libmachine: (minikube) Downloading /home/slinkydeveloper/.minikube/cache/boot2docker.iso from file:///home/slinkydeveloper/.minikube/cache/iso/minikube-v1.12.0.iso...
I0720 10:57:25.889917   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:25.889824   18194 common.go:106] Creating ssh key: /home/slinkydeveloper/.minikube/machines/minikube/id_rsa...
I0720 10:57:26.168088   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:26.168006   18194 common.go:112] Creating raw disk image: /home/slinkydeveloper/.minikube/machines/minikube/minikube.rawdisk...
I0720 10:57:26.168111   17987 main.go:115] libmachine: (minikube) DBG | Writing magic tar header
I0720 10:57:26.168120   17987 main.go:115] libmachine: (minikube) DBG | Writing SSH key tar header
I0720 10:57:26.168133   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:26.168082   18194 common.go:126] Fixing permissions on /home/slinkydeveloper/.minikube/machines/minikube ...
I0720 10:57:26.168144   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper/.minikube/machines/minikube
I0720 10:57:26.168156   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper/.minikube/machines/minikube (perms=drwx------)
I0720 10:57:26.168167   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper/.minikube/machines (perms=drwxr-xr-x)
I0720 10:57:26.168173   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper/.minikube (perms=drwxr-xr-x)
I0720 10:57:26.168179   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper/.minikube/machines
I0720 10:57:26.168187   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper (perms=drwx--x--x)
I0720 10:57:26.168202   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper/.minikube
I0720 10:57:26.168209   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper
I0720 10:57:26.168216   17987 main.go:115] libmachine: (minikube) Creating domain...
I0720 10:57:26.168224   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home
I0720 10:57:26.168230   17987 main.go:115] libmachine: (minikube) DBG | Skipping /home - not owner
I0720 10:57:26.217587   17987 main.go:115] libmachine: (minikube) Creating network...
I0720 10:57:26.226986   17987 main.go:115] libmachine: (minikube) Ensuring networks are active...
I0720 10:57:26.236445   17987 main.go:115] libmachine: (minikube) Ensuring network default is active
I0720 10:57:26.332491   17987 main.go:115] libmachine: (minikube) KVM machine creation complete!
I0720 10:57:26.332775   17987 client.go:164] LocalClient.Create took 991.338739ms
I0720 10:57:28.333108   17987 start.go:125] duration metric: createHost completed in 3.005737661s
I0720 10:57:28.333249   17987 start.go:76] releasing machines lock for "minikube", held for 3.005927833s
I0720 10:57:28.334797   17987 main.go:115] libmachine: Found binary path at /home/slinkydeveloper/.minikube/bin/docker-machine-driver-kvm2
I0720 10:57:28.334943   17987 main.go:115] libmachine: Launching plugin server for driver kvm2
I0720 10:57:28.380812   17987 main.go:115] libmachine: Plugin server listening at address 127.0.0.1:39517
I0720 10:57:28.381289   17987 main.go:115] libmachine: () Calling .GetVersion
I0720 10:57:28.381695   17987 main.go:115] libmachine: Using API Version  1
I0720 10:57:28.381713   17987 main.go:115] libmachine: () Calling .SetConfigRaw
I0720 10:57:28.381960   17987 main.go:115] libmachine: () Calling .GetMachineName
I0720 10:57:28.382391   17987 main.go:115] libmachine: Found binary path at /home/slinkydeveloper/.minikube/bin/docker-machine-driver-kvm2
I0720 10:57:28.382429   17987 main.go:115] libmachine: Launching plugin server for driver kvm2
I0720 10:57:28.398746   17987 main.go:115] libmachine: Plugin server listening at address 127.0.0.1:42847
I0720 10:57:28.399081   17987 main.go:115] libmachine: () Calling .GetVersion
I0720 10:57:28.399400   17987 main.go:115] libmachine: Using API Version  1
I0720 10:57:28.399410   17987 main.go:115] libmachine: () Calling .SetConfigRaw
I0720 10:57:28.399654   17987 main.go:115] libmachine: () Calling .GetMachineName
I0720 10:57:28.399751   17987 main.go:115] libmachine: (minikube) Calling .GetState
I0720 10:57:28.407312   17987 main.go:115] libmachine: (minikube) Calling .DriverName
🔥  Deleting "minikube" in kvm2 ...
I0720 10:57:28.407483   17987 main.go:115] libmachine: (minikube) Calling .Remove
I0720 10:57:28.407568   17987 main.go:115] libmachine: (minikube) DBG | Removing machine...
I0720 10:57:28.413400   17987 main.go:115] libmachine: (minikube) DBG | Trying to delete the networks (if possible)
I0720 10:57:28.423105   17987 main.go:115] libmachine: (minikube) DBG | Checking if network minikube-net exists...
I0720 10:57:28.423225   17987 main.go:115] libmachine: (minikube) DBG | Network minikube-net exists
I0720 10:57:28.423243   17987 main.go:115] libmachine: (minikube) DBG | Trying to list all domains...
I0720 10:57:28.423252   17987 main.go:115] libmachine: (minikube) DBG | Listed all domains: total of 1 domains
I0720 10:57:28.423267   17987 main.go:115] libmachine: (minikube) DBG | Trying to get name of domain...
I0720 10:57:28.423275   17987 main.go:115] libmachine: (minikube) DBG | Got domain name: minikube
I0720 10:57:28.423280   17987 main.go:115] libmachine: (minikube) DBG | Skipping domain as it is us...
I0720 10:57:28.423291   17987 main.go:115] libmachine: (minikube) DBG | Trying to destroy network minikube-net...
I0720 10:57:28.423424   17987 main.go:115] libmachine: (minikube) Deleting of networks failed: network destroy: virError(Code=55, Domain=19, Message='Requested operation is not valid: network 'minikube-net' is not active')
I0720 10:57:28.423438   17987 main.go:115] libmachine: (minikube) DBG | Checking if the domain needs to be deleted
I0720 10:57:28.423486   17987 main.go:115] libmachine: (minikube) Domain minikube exists, removing...
I0720 10:57:28.423565   17987 main.go:115] libmachine: (minikube) Domain minikube already destroyed, skipping...
🤦  StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: ensuring active networks: starting network default: virError(Code=89, Domain=47, Message='error from service: changeZoneOfInterface: COMMAND_FAILED: 'python-nftables' failed: 
JSON blob:
{"nftables": [{"metainfo": {"json_schema_version": 1}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 67}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 547}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "tcp", "field": "dport"}}, "op": "==", "right": 53}}, {"match": {"left": {"ct": {"key": "state"}}')
I0720 10:57:33.441506   17987 start.go:241] acquiring machines lock for minikube: {Name:mk0a9c7eb352eb1c53d02d9deee8d33f25d3bf80 Clock:{} Delay:500ms Timeout:15m0s Cancel:<nil>}
I0720 10:57:33.442173   17987 start.go:245] acquired machines lock for "minikube" in 581.636µs
I0720 10:57:33.442273   17987 start.go:85] Provisioning new machine with config: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.12.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.18.3 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.3 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true]} &{Name: IP: Port:8443 KubernetesVersion:v1.18.3 ControlPlane:true Worker:true}
I0720 10:57:33.442445   17987 start.go:122] createHost starting for "" (driver="kvm2")
🔥  Creating kvm2 VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
I0720 10:57:33.443027   17987 main.go:115] libmachine: Found binary path at /home/slinkydeveloper/.minikube/bin/docker-machine-driver-kvm2
I0720 10:57:33.443122   17987 main.go:115] libmachine: Launching plugin server for driver kvm2
I0720 10:57:33.483391   17987 main.go:115] libmachine: Plugin server listening at address 127.0.0.1:45711
I0720 10:57:33.483833   17987 main.go:115] libmachine: () Calling .GetVersion
I0720 10:57:33.484275   17987 main.go:115] libmachine: Using API Version  1
I0720 10:57:33.484297   17987 main.go:115] libmachine: () Calling .SetConfigRaw
I0720 10:57:33.484581   17987 main.go:115] libmachine: () Calling .GetMachineName
I0720 10:57:33.484742   17987 main.go:115] libmachine: (minikube) Calling .GetMachineName
I0720 10:57:33.484849   17987 main.go:115] libmachine: (minikube) Calling .DriverName
I0720 10:57:33.484975   17987 start.go:158] libmachine.API.Create for "minikube" (driver="kvm2")
I0720 10:57:33.485007   17987 client.go:161] LocalClient.Create starting
I0720 10:57:33.485036   17987 main.go:115] libmachine: Reading certificate data from /home/slinkydeveloper/.minikube/certs/ca.pem
I0720 10:57:33.485076   17987 main.go:115] libmachine: Decoding PEM data...
I0720 10:57:33.485096   17987 main.go:115] libmachine: Parsing certificate...
I0720 10:57:33.485237   17987 main.go:115] libmachine: Reading certificate data from /home/slinkydeveloper/.minikube/certs/cert.pem
I0720 10:57:33.485264   17987 main.go:115] libmachine: Decoding PEM data...
I0720 10:57:33.485281   17987 main.go:115] libmachine: Parsing certificate...
I0720 10:57:33.485338   17987 main.go:115] libmachine: Running pre-create checks...
I0720 10:57:33.485348   17987 main.go:115] libmachine: (minikube) Calling .PreCreateCheck
I0720 10:57:33.485485   17987 main.go:115] libmachine: (minikube) Calling .GetConfigRaw
I0720 10:57:33.485833   17987 main.go:115] libmachine: Creating machine...
I0720 10:57:33.485848   17987 main.go:115] libmachine: (minikube) Calling .Create
I0720 10:57:33.485957   17987 main.go:115] libmachine: (minikube) Creating KVM machine...
I0720 10:57:33.497519   17987 main.go:115] libmachine: (minikube) Setting up store path in /home/slinkydeveloper/.minikube/machines/minikube ...
I0720 10:57:33.497539   17987 main.go:115] libmachine: (minikube) Building disk image from file:///home/slinkydeveloper/.minikube/cache/iso/minikube-v1.12.0.iso
I0720 10:57:33.497660   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:33.497497   18305 common.go:99] Making disk image using store path: /home/slinkydeveloper/.minikube
I0720 10:57:33.497691   17987 main.go:115] libmachine: (minikube) Downloading /home/slinkydeveloper/.minikube/cache/boot2docker.iso from file:///home/slinkydeveloper/.minikube/cache/iso/minikube-v1.12.0.iso...
I0720 10:57:33.589988   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:33.589901   18305 common.go:106] Creating ssh key: /home/slinkydeveloper/.minikube/machines/minikube/id_rsa...
I0720 10:57:33.686855   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:33.686778   18305 common.go:112] Creating raw disk image: /home/slinkydeveloper/.minikube/machines/minikube/minikube.rawdisk...
I0720 10:57:33.686870   17987 main.go:115] libmachine: (minikube) DBG | Writing magic tar header
I0720 10:57:33.686889   17987 main.go:115] libmachine: (minikube) DBG | Writing SSH key tar header
I0720 10:57:33.686906   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:33.686856   18305 common.go:126] Fixing permissions on /home/slinkydeveloper/.minikube/machines/minikube ...
I0720 10:57:33.686921   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper/.minikube/machines/minikube
I0720 10:57:33.686930   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper/.minikube/machines
I0720 10:57:33.686941   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper/.minikube
I0720 10:57:33.686956   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper
I0720 10:57:33.686967   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper/.minikube/machines/minikube (perms=drwx------)
I0720 10:57:33.686973   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home
I0720 10:57:33.686978   17987 main.go:115] libmachine: (minikube) DBG | Skipping /home - not owner
I0720 10:57:33.686986   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper/.minikube/machines (perms=drwxr-xr-x)
I0720 10:57:33.686995   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper/.minikube (perms=drwxr-xr-x)
I0720 10:57:33.687001   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper (perms=drwx--x--x)
I0720 10:57:33.687005   17987 main.go:115] libmachine: (minikube) Creating domain...
I0720 10:57:33.775916   17987 main.go:115] libmachine: (minikube) Creating network...
I0720 10:57:33.807476   17987 main.go:115] libmachine: (minikube) Ensuring networks are active...
I0720 10:57:33.835439   17987 main.go:115] libmachine: (minikube) Ensuring network default is active
I0720 10:57:33.924588   17987 main.go:115] libmachine: (minikube) KVM machine creation complete!
I0720 10:57:33.924644   17987 client.go:164] LocalClient.Create took 439.626277ms
I0720 10:57:35.925004   17987 start.go:125] duration metric: createHost completed in 2.482500085s
I0720 10:57:35.925097   17987 start.go:76] releasing machines lock for "minikube", held for 2.482876102s
😿  Failed to start kvm2 VM. "minikube start" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: ensuring active networks: starting network default: virError(Code=89, Domain=47, Message='error from service: changeZoneOfInterface: COMMAND_FAILED: 'python-nftables' failed: 
JSON blob:
{"nftables": [{"metainfo": {"json_schema_version": 1}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 67}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 547}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "tcp", "field": "dport"}}, "op": "==", "right": 53}}, {"match": {"left": {"ct": {"key": "state"}}')
I0720 10:57:35.925687   17987 exit.go:58] WithError(error provisioning host)=Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: ensuring active networks: starting network default: virError(Code=89, Domain=47, Message='error from service: changeZoneOfInterface: COMMAND_FAILED: 'python-nftables' failed: 
JSON blob:
{"nftables": [{"metainfo": {"json_schema_version": 1}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 67}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 547}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "tcp", "field": "dport"}}, "op": "==", "right": 53}}, {"match": {"left": {"ct": {"key": "state"}}') called from:
goroutine 1 [running]:
runtime/debug.Stack(0x1eb8320, 0xc000713800, 0x1eb6e80)
    /usr/local/go/src/runtime/debug/stack.go:24 +0x9d
k8s.io/minikube/pkg/minikube/exit.WithError(0x1ba8136, 0x17, 0x1eb8320, 0xc000713800)
    /app/pkg/minikube/exit/exit.go:58 +0x34
k8s.io/minikube/cmd/minikube/cmd.runStart(0x2cb86a0, 0xc0001112e0, 0x0, 0x2)
    /app/cmd/minikube/cmd/start.go:171 +0xbe7
github.com/spf13/cobra.(*Command).execute(0x2cb86a0, 0xc0001112c0, 0x2, 0x2, 0x2cb86a0, 0xc0001112c0)
    /go/pkg/mod/github.com/spf13/cobra@v1.0.0/command.go:846 +0x29d
github.com/spf13/cobra.(*Command).ExecuteC(0x2cb76e0, 0x0, 0x1, 0xc0003e5080)
    /go/pkg/mod/github.com/spf13/cobra@v1.0.0/command.go:950 +0x349
github.com/spf13/cobra.(*Command).Execute(...)
    /go/pkg/mod/github.com/spf13/cobra@v1.0.0/command.go:887
k8s.io/minikube/cmd/minikube/cmd.Execute()
    /app/cmd/minikube/cmd/root.go:106 +0x72c
main.main()
    /app/cmd/minikube/main.go:71 +0x11f
W0720 10:57:35.927403   17987 out.go:232] error provisioning host: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: ensuring active networks: starting network default: virError(Code=89, Domain=47, Message='error from service: changeZoneOfInterface: COMMAND_FAILED: 'python-nftables' failed: 
JSON blob:
{"nftables": [{"metainfo": {"json_schema_version": 1}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 67}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 547}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "tcp", "field": "dport"}}, "op": "==", "right": 53}}, {"match": {"left": {"ct": {"key": "state"}}')

💣  error provisioning host: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: ensuring active networks: starting network default: virError(Code=89, Domain=47, Message='error from service: changeZoneOfInterface: COMMAND_FAILED: 'python-nftables' failed: 
JSON blob:
{"nftables": [{"metainfo": {"json_schema_version": 1}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 67}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 547}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "tcp", "field": "dport"}}, "op": "==", "right": 53}}, {"match": {"left": {"ct": {"key": "state"}}')

😿  minikube is exiting due to an error. If the above message is not useful, open an issue:
👉  https://github.com/kubernetes/minikube/issues/new/choose

medyagh commented 4 years ago

Thank you for sharing your experience! If you don't mind, could you please provide:

@slinkydeveloper do you happen to be using VPN or a firewall that limits your network connectivit ? and what version of qemu or libvirt are you using ? (sometimes upgrading the kvm libs fixes kvm issues)

and additionally I am curious is there a reason you are not using the docker driver which is our most preferred driver?

/triage needs-information /triage support

slinkydeveloper commented 4 years ago

do you happen to be using VPN or a firewall that limits your network connectivit ?

Nope, I just have the default network configuration of fedora 32 and no vpn running

Name : libvirt Version : 6.1.0 Rilascio : 4.fc32 Architecture : x86_64 Size : 0.0
Sorgente : libvirt-6.1.0-4.fc32.src.rpm

Name : qemu Epoca : 2 Version : 4.2.1 Rilascio : 1.fc32 Architecture : x86_64 Size : 12 k Sorgente : qemu-4.2.1-1.fc32.src.rpm

medyagh commented 4 years ago

@slinkydeveloper does switching to docker driver help you solve this problem ?

you could try with latest verison of miniikube minikube delete minikube start --driver=docker

for more information on the docker driver checkout: https://minikube.sigs.k8s.io/docs/drivers/docker/

/triage needs-information /triage support

slinkydeveloper commented 4 years ago

I'm trying to install it, but for some reason i get Can not load RPM file: ./minikube-latest.x86-64.rpm. when using dnf...

medyagh commented 4 years ago

@slinkydeveloper do you still have this issue ? btw I recommend using our docker driver on linux

szarnyasg commented 4 years ago

Just an observer here -- I've subscribed to this issue because I had following error on Fedora 32 due to a clash between moby and libvirt:

COMMAND_FAILED: 'python-nftables' failed: 
JSON blob:
{"nftables": [{"metainfo": {"json_schema_version": 1}}, ...

Since subscribing to this issue, I've resolved it as suggested on the Red Hat Bugzilla and, i.e. by removing the incorrect /etc/firewalld/zones/trusted.xml file:

sudo mv /etc/firewalld/zones/trusted.xml /etc/firewalld/zones/trusted.xml.bkp
sudo systemctl restart firewalld
sudo systemctl restart libvirtd

slinkydeveloper commented 4 years ago

Thanks @szarnyasg, it's the same issue as described here https://github.com/code-ready/crc/issues/1444

tstromberg commented 4 years ago

@szarnyasg - thanks for the workaround!

tstromberg commented 3 years ago

There is probably nothing we can do about this - so I'm going to leave this.

fejta-bot commented 3 years ago

Issues go stale after 90d of inactivity. Mark the issue as fresh with /remove-lifecycle stale. Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-contributor-experience at kubernetes/community. /lifecycle stale

fejta-bot commented 3 years ago

Stale issues rot after 30d of inactivity. Mark the issue as fresh with /remove-lifecycle rotten. Rotten issues close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

Send feedback to sig-contributor-experience at kubernetes/community. /lifecycle rotten

medyagh commented 3 years ago

anyone like to add this as a work arround to either minikube Solution messages or our website I would accept a PR btw @slinkydeveloper seems like our website for RPM URL was missing -

could u try with https://storage.googleapis.com/minikube/releases/latest/minikube-latest.x86_64.rpm

kubernetes / minikube

Fedora 32, kvm: COMMAND_FAILED: 'python-nftables' failed #8772