kubernetes / minikube

Run Kubernetes locally
https://minikube.sigs.k8s.io/
Apache License 2.0
29.23k stars 4.87k forks source link

Add solution message if Docker is rootless #10652

Closed hakangung closed 3 years ago

hakangung commented 3 years ago

Steps to reproduce the issue:

1.docker system prune --volumes

  1. systemctl --user restart docker 3.minikube delete
  2. minikube start --driver=docker

Full output of failed command: I0228 21:16:45.860078 56169 out.go:229] Setting OutFile to fd 1 ... I0228 21:16:45.860629 56169 out.go:281] isatty.IsTerminal(1) = true I0228 21:16:45.860652 56169 out.go:242] Setting ErrFile to fd 2... I0228 21:16:45.860662 56169 out.go:281] isatty.IsTerminal(2) = true I0228 21:16:45.860827 56169 root.go:291] Updating PATH: /home/guengoer_hakan/.minikube/bin I0228 21:16:45.861363 56169 out.go:236] Setting JSON to false I0228 21:16:45.862532 56169 start.go:106] hostinfo: {"hostname":"instance-2","uptime":2938,"bootTime":1614544067,"procs":98,"os":"linux","platform":"centos","platformFamily":"rhel","platformVersion":"8.3.2011","kernelVersion":"4.18.0-240.10.1.el8_3.x86_64","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"guest","hostId":"754f5452-23f5-2039-6a81-e07e237544e4"} I0228 21:16:45.862648 56169 start.go:116] virtualization: guest I0228 21:16:45.866336 56169 out.go:119] ๐Ÿ˜„ minikube v1.17.1 on Centos 8.3.2011 (amd64) ๐Ÿ˜„ minikube v1.17.1 on Centos 8.3.2011 (amd64) I0228 21:16:45.866543 56169 driver.go:315] Setting default libvirt URI to qemu:///system I0228 21:16:45.867217 56169 notify.go:126] Checking for updates... I0228 21:16:45.938726 56169 docker.go:115] docker version: linux-20.10.3 I0228 21:16:45.938829 56169 cli_runner.go:111] Run: docker system info --format "{{json .}}" ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:fuse-overlayfs DriverStatus:[] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:23 OomKillDisable:true NGoroutines:39 SystemTime:2021-02-28 21:16:45.966520192 +0000 UTC LoggingDriver:json-file CgroupDriver:none NEventsListener:0 KernelVersion:4.18.0-240.10.1.el8_3.x86_64 OperatingSystem:CentOS Linux 8 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:3917074432 GenericResources: DockerRootDir:/home/guengoer_hakan/.local/share/docker HTTPProxy: HTTPSProxy: NoProxy: Name:instance-2 Labels:[] ExperimentalBuild:false ServerVersion:20.10.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=rootless] ProductLicense:Community Engine Warnings:[WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode. WARNING: bridge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:}} I0228 21:16:45.978338 56169 docker.go:145] overlay module found I0228 21:16:45.980683 56169 out.go:119] โœจ Using the docker driver based on user configuration โœจ Using the docker driver based on user configuration I0228 21:16:45.980727 56169 start.go:279] selected driver: docker I0228 21:16:45.980739 56169 start.go:702] validating driver "docker" against I0228 21:16:45.980773 56169 start.go:713] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc:} I0228 21:16:46.016561 56169 info.go:253] docker info: {ID:AWIP:MF6E:QS3V:P5EI:ILNT:WXIE:NGOG:IUG4:KIWY:YFFR:3LKH:BH2F Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:fuse-overlayfs DriverStatus:[] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:23 OomKillDisable:true NGoroutines:39 SystemTime:2021-02-28 21:16:46.007036281 +0000 UTC LoggingDriver:json-file CgroupDriver:none NEventsListener:0 KernelVersion:4.18.0-240.10.1.el8_3.x86_64 OperatingSystem:CentOS Linux 8 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:3917074432 GenericResources: DockerRootDir:/home/guengoer_hakan/.local/share/docker HTTPProxy: HTTPSProxy: NoProxy: Name:instance-2 Labels:[] ExperimentalBuild:false ServerVersion:20.10.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=rootless] ProductLicense:Community Engine Warnings:[WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode. WARNING: bridge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:}} W0228 21:16:46.016764 56169 out.go:181] โ— docker is currently using the fuse-overlayfs storage driver, consider switching to overlay2 for better performance โ— docker is currently using the fuse-overlayfs storage driver, consider switching to overlay2 for better performance I0228 21:16:46.017166 56169 start_flags.go:249] no existing cluster config was found, will generate one from the flags I0228 21:16:46.017439 56169 start_flags.go:267] Using suggested 2200MB memory alloc based on sys=3735MB, container=3735MB I0228 21:16:46.017581 56169 start_flags.go:671] Wait components to verify : map[apiserver:true system_pods:true] I0228 21:16:46.017625 56169 cni.go:74] Creating CNI manager for "" I0228 21:16:46.017643 56169 cni.go:139] CNI unnecessary in this configuration, recommending no CNI I0228 21:16:46.017662 56169 start_flags.go:390] config: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] Network: MultiNodeRequested:false} I0228 21:16:46.022268 56169 out.go:119] ๐Ÿ‘ Starting control plane node minikube in cluster minikube ๐Ÿ‘ Starting control plane node minikube in cluster minikube I0228 21:16:46.050509 56169 image.go:92] Found gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e in local docker daemon, skipping pull I0228 21:16:46.050542 56169 cache.go:116] gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e exists in daemon, skipping pull I0228 21:16:46.050558 56169 preload.go:97] Checking if preload exists for k8s version v1.20.2 and runtime docker I0228 21:16:46.050893 56169 profile.go:148] Saving config to /home/guengoer_hakan/.minikube/profiles/minikube/config.json ... I0228 21:16:46.050950 56169 lock.go:36] WriteFile acquiring /home/guengoer_hakan/.minikube/profiles/minikube/config.json: {Name:mkc146efc5aed1b4d4291eceb3c9e9ddc4d600ec Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0228 21:16:46.051344 56169 cache.go:185] Successfully downloaded all kic artifacts I0228 21:16:46.051386 56169 start.go:313] acquiring machines lock for minikube: {Name:mk5bba78214f592a9db33daafb95c5a2882b4ea1 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0228 21:16:46.051487 56169 start.go:317] acquired machines lock for "minikube" in 79.694ยตs I0228 21:16:46.054620 56169 out.go:140] ๐Ÿ”ฅ Creating docker container (CPUs=2, Memory=2200MB) ... ๐Ÿ”ฅ Creating docker container (CPUs=2, Memory=2200MB) ...I0228 21:16:46.052060 56169 cache.go:93] acquiring lock: {Name:mk823d35d9ea8e3477db802cfc232a829124043b Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0228 21:16:46.054872 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4 exists I0228 21:16:46.054902 56169 cache.go:82] cache image "docker.io/kubernetesui/metrics-scraper:v1.0.4" -> "/home/guengoer_hakan/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4" took 2.845699ms I0228 21:16:46.054923 56169 cache.go:66] save to tar file docker.io/kubernetesui/metrics-scraper:v1.0.4 -> /home/guengoer_hakan/.minikube/cache/images/docker.io/kubernetesui/metrics-scraper_v1.0.4 succeeded I0228 21:16:46.052114 56169 cache.go:93] acquiring lock: {Name:mk1f37d5b8b459a292fa09b2a660292656c00133 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0228 21:16:46.054940 56169 start.go:160] libmachine.API.Create for "minikube" (driver="docker") I0228 21:16:46.054969 56169 client.go:168] LocalClient.Create starting I0228 21:16:46.055028 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.2 exists | I0228 21:16:46.055046 56169 cache.go:82] cache image "k8s.gcr.io/kube-proxy:v1.20.2" -> "/home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.20.2" took 2.934332ms I0228 21:16:46.052134 56169 cache.go:93] acquiring lock: {Name:mke9b2ca3a8302e586b140c8466bd0a989fb7c3b Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0228 21:16:46.055026 56169 main.go:119] libmachine: Reading certificate data from /home/guengoer_hakan/.minikube/certs/ca.pem I0228 21:16:46.055124 56169 main.go:119] libmachine: Decoding PEM data... I0228 21:16:46.055152 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.2 exists I0228 21:16:46.055153 56169 main.go:119] libmachine: Parsing certificate... I0228 21:16:46.055173 56169 cache.go:82] cache image "k8s.gcr.io/kube-scheduler:v1.20.2" -> "/home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.2" took 3.038988ms I0228 21:16:46.055186 56169 cache.go:66] save to tar file k8s.gcr.io/kube-scheduler:v1.20.2 -> /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.20.2 succeeded I0228 21:16:46.052202 56169 cache.go:93] acquiring lock: {Name:mk4fd0daf2bbaa7a40ba4dea49fbaf4f1a784be6 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0228 21:16:46.055313 56169 main.go:119] libmachine: Reading certificate data from /home/guengoer_hakan/.minikube/certs/cert.pem I0228 21:16:46.055345 56169 main.go:119] libmachine: Decoding PEM data... I0228 21:16:46.055365 56169 main.go:119] libmachine: Parsing certificate... I0228 21:16:46.055404 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 exists I0228 21:16:46.055423 56169 cache.go:82] cache image "k8s.gcr.io/coredns:1.7.0" -> "/home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0" took 3.221005ms I0228 21:16:46.055436 56169 cache.go:66] save to tar file k8s.gcr.io/coredns:1.7.0 -> /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/coredns_1.7.0 succeeded I0228 21:16:46.052216 56169 cache.go:93] acquiring lock: {Name:mk0432620acf066901ccf0dd12ec4fbf679910e0 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0228 21:16:46.055546 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 exists I0228 21:16:46.055700 56169 cache.go:82] cache image "k8s.gcr.io/etcd:3.4.13-0" -> "/home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0" took 3.480519ms I0228 21:16:46.055719 56169 cache.go:66] save to tar file k8s.gcr.io/etcd:3.4.13-0 -> /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/etcd_3.4.13-0 succeeded I0228 21:16:46.052231 56169 cache.go:93] acquiring lock: {Name:mk2717a8a0580cadfccbaa4b0cbdddb5213cadc7 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0228 21:16:46.055825 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/pause_3.2 exists I0228 21:16:46.055844 56169 cache.go:82] cache image "k8s.gcr.io/pause:3.2" -> "/home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/pause_3.2" took 3.613475ms I0228 21:16:46.055855 56169 cache.go:66] save to tar file k8s.gcr.io/pause:3.2 -> /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/pause_3.2 succeeded I0228 21:16:46.052250 56169 cache.go:93] acquiring lock: {Name:mke93ea495f8d026ece79d034bcabf11a9c71473 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0228 21:16:46.055950 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v4 exists I0228 21:16:46.055953 56169 cli_runner.go:111] Run: docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}},{{$first := true}} "ContainerIPs": [{{range $k,$v := .Containers }}{{if $first}}{{$first = false}}{{else}}, {{end}}"{{$v.IPv4Address}}"{{end}}]}" I0228 21:16:46.055968 56169 cache.go:82] cache image "gcr.io/k8s-minikube/storage-provisioner:v4" -> "/home/guengoer_hakan/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v4" took 3.719082ms I0228 21:16:46.055981 56169 cache.go:66] save to tar file gcr.io/k8s-minikube/storage-provisioner:v4 -> /home/guengoer_hakan/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v4 succeeded I0228 21:16:46.052274 56169 cache.go:93] acquiring lock: {Name:mkb1e1ddaa0c0a18e76d41fef6be014c3ded90d1 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0228 21:16:46.056096 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/docker.io/kubernetesui/dashboard_v2.1.0 exists I0228 21:16:46.056258 56169 cache.go:82] cache image "k8s.gcr.io/kube-apiserver:v1.20.2" -> "/home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.2" took 4.083477ms I0228 21:16:46.056274 56169 cache.go:66] save to tar file k8s.gcr.io/kube-apiserver:v1.20.2 -> /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.20.2 succeeded I0228 21:16:46.052149 56169 cache.go:93] acquiring lock: {Name:mkfed6515850fe8084214bc8585132f20e8cad1b Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0228 21:16:46.056366 56169 cache.go:101] /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.2 exists I0228 21:16:46.056381 56169 cache.go:82] cache image "k8s.gcr.io/kube-controller-manager:v1.20.2" -> "/home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.2" took 4.232224ms I0228 21:16:46.056392 56169 cache.go:66] save to tar file k8s.gcr.io/kube-controller-manager:v1.20.2 -> /home/guengoer_hakan/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.20.2 succeeded I0228 21:16:46.056403 56169 cache.go:73] Successfully saved all images to host disk. W0228 21:16:46.083785 56169 cli_runner.go:149] docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}},{{$first := true}} "ContainerIPs": [{{range $k,$v := .Containers }}{{if $first}}{{$first = false}}{{else}}, {{end}}"{{$v.IPv4Address}}"{{end}}]}" returned with exit code 1 I0228 21:16:46.083882 56169 network_create.go:249] running [docker network inspect minikube] to gather additional debugging logs... I0228 21:16:46.083905 56169 cli_runner.go:111] Run: docker network inspect minikube W0228 21:16:46.111375 56169 cli_runner.go:149] docker network inspect minikube returned with exit code 1 I0228 21:16:46.111428 56169 network_create.go:252] error running [docker network inspect minikube]: docker network inspect minikube: exit status 1 stdout: []

stderr: Error: No such network: minikube I0228 21:16:46.111450 56169 network_create.go:254] output of [docker network inspect minikube]: -- stdout -- []

/stderr I0228 21:16:46.111506 56169 cli_runner.go:111] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}},{{$first := true}} "ContainerIPs": [{{range $k,$v := .Containers }}{{if $first}}{{$first = false}}{{else}}, {{end}}"{{$v.IPv4Address}}"{{end}}]}" I0228 21:16:46.139215 56169 network_create.go:104] attempt to create network 192.168.49.0/24 with subnet: minikube and gateway 192.168.49.1 and MTU of 1500 ... I0228 21:16:46.139309 56169 cli_runner.go:111] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true minikube / I0228 21:16:46.241074 56169 kic.go:100] calculated static IP "192.168.49.2" for the "minikube" container I0228 21:16:46.241167 56169 cli_runner.go:111] Run: docker ps -a --format {{.Names}}

stderr: Error response from daemon: Container de7dfc0d9cf192ab3914a1ca9e74ac40bf8fe51222c8cdf52719a41776da002f is not running I0228 21:16:48.259804 56169 retry.go:31] will retry after 16.569904ms: iptables file doesn't exist, see #8179

-- /stdout -- I0228 21:17:14.306679 56169 cli_runner.go:111] Run: docker logs --timestamps --details minikube / I0228 21:17:14.339249 56169 errors.go:79] Postmortem logs ("docker logs --timestamps --details minikube"): -- stdout -- 2021-02-28T21:16:47.970278409Z + configure_proxy 2021-02-28T21:16:47.970316380Z + mkdir -p /etc/systemd/system.conf.d/ 2021-02-28T21:16:47.996489453Z + [[ ! -z '' ]] 2021-02-28T21:16:47.996528684Z + cat 2021-02-28T21:16:48.010332364Z + fix_kmsg 2021-02-28T21:16:48.010364667Z + [[ ! -e /dev/kmsg ]] 2021-02-28T21:16:48.010369608Z + [[ -e /dev/console ]] 2021-02-28T21:16:48.010373682Z + echo 'WARN: /dev/kmsg does not exist, symlinking /dev/console' 2021-02-28T21:16:48.010378505Z WARN: /dev/kmsg does not exist, symlinking /dev/console 2021-02-28T21:16:48.010382283Z + ln -s /dev/console /dev/kmsg 2021-02-28T21:16:48.015745973Z + fix_mount 2021-02-28T21:16:48.015777013Z + echo 'INFO: ensuring we can execute mount/umount even with userns-remap' 2021-02-28T21:16:48.015782373Z INFO: ensuring we can execute mount/umount even with userns-remap 2021-02-28T21:16:48.015786719Z ++ which mount 2021-02-28T21:16:48.019486738Z ++ which umount 2021-02-28T21:16:48.019519914Z + chown root:root /usr/bin/mount /usr/bin/umount 2021-02-28T21:16:48.025667960Z ++ which mount 2021-02-28T21:16:48.025727091Z ++ which umount 2021-02-28T21:16:48.031495240Z + chmod -s /usr/bin/mount /usr/bin/umount 2021-02-28T21:16:48.031534748Z +++ which mount 2021-02-28T21:16:48.031540134Z ++ stat -f -c %T /usr/bin/mount 2021-02-28T21:16:48.036392758Z + [[ fuseblk == \a\u\f\s ]] 2021-02-28T21:16:48.036431382Z + echo 'INFO: remounting /sys read-only' 2021-02-28T21:16:48.036436797Z INFO: remounting /sys read-only 2021-02-28T21:16:48.036440663Z + mount -o remount,ro /sys 2021-02-28T21:16:48.044803323Z mount: /sys: permission denied.

-- /stdout -- I0228 21:17:14.339378 56169 cli_runner.go:111] Run: docker system info --format "{{json .}}" I0228 21:17:14.378839 56169 info.go:253] docker info: {ID:AWIP:MF6E:QS3V:P5EI:ILNT:WXIE:NGOG:IUG4:KIWY:YFFR:3LKH:BH2F Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:1 Driver:fuse-overlayfs DriverStatus:[] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false 89a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=rootless] ProductLicense:Community Engine Warnings:[WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode. WARNING: bridge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:}} I0228 21:17:14.378940 56169 errors.go:86] postmortem docker info: {ID:AWIP:MF6E:QS3V:P5EI:ILNT:WXIE:NGOG:IUG4:KIWY:YFFR:3LKH:BH2F Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:1 Driver:fuse-overlayfs DriverStatus:[] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:26 OomKillDisable:true NGoroutines:40 SystemTime:2021-02-28 21:17:14.368487819 +0000 UTC LoggingDriver:json-file CgroupDriver:none NEventsListener:0 KernelVersion:4.18.0-240.10.1.el8_3.x86_64 OperatingSystem:CentOS Linux 8 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:3917074432 GenericResources: DockerRootDir:/home/guengoer_hakan/.local/share/docker HTTPProxy: HTTPSProxy: NoProxy: Name:instance-2 Labels:[] ExperimentalBuild:false ServerVersion:20.10.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=rootless] ProductLicense:Community Engine Warnings:[WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode. WARNING: bridge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:}} I0228 21:17:14.379043 56169 network_create.go:249] running [docker network inspect minikube] to gather additional debugging logs... I0228 21:17:14.379070 56169 cli_runner.go:111] Run: docker network inspect minikube I0228 21:17:14.410067 56169 network_create.go:254] output of [docker network inspect minikube]: -- stdout -- [ { "Name": "minikube", "Id": "9802cae1d86c9894dc48ca160258dee9d2119fd4e3b27086450b12ccc4ac905f", "Created": "2021-02-28T21:16:46.165876875Z", "Scope": "local", "Driver": "bridge", "EnableIPv6": false, "IPAM": { "Driver": "default", "Options": {}, "Config": [ { "Subnet": "192.168.49.0/24", "Gateway": "192.168.49.1" } ] }, "Internal": false, "Attachable": false, "Ingress": false, "ConfigFrom": { "Network": "" }, "ConfigOnly": false, "Containers": {}, "Options": { "--icc": "", "--ip-masq": "", "com.docker.network.driver.mtu": "1500" }, "Labels": { "created_by.minikube.sigs.k8s.io": "true" } } ]

-- /stdout -- I0228 21:17:14.410168 56169 cli_runner.go:111] Run: docker system info --format "{{json .}}"

stderr: Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil | I0228 21:17:16.679296 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube W0228 21:17:16.709291 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1 I0228 21:17:16.709395 56169 retry.go:31] will retry after 442.156754ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1 stdout:

stderr: Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil / I0228 21:17:17.152416 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube W0228 21:17:17.182974 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1 I0228 21:17:17.183084 56169 retry.go:31] will retry after 404.186092ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1 stdout:

stderr: Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil / I0228 21:17:17.588151 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube W0228 21:17:17.618350 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1 I0228 21:17:17.618465 56169 retry.go:31] will retry after 593.313927ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1 stdout:

stderr: Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil \ I0228 21:17:18.212546 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube W0228 21:17:18.242967 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1 I0228 21:17:18.243089 56169 retry.go:31] will retry after 1.089540387s: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1 stdout:

stderr: Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil

stderr: Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil

W0228 21:17:19.364019 56169 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1 stdout:

stderr: Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil I0228 21:17:19.364037 56169 start.go:129] duration metric: createHost completed in 33.312430859s I0228 21:17:19.364068 56169 start.go:80] releasing machines lock for "minikube", held for 33.312564462s W0228 21:17:19.364104 56169 start.go:377] error starting host: creating host: create: creating: create kic node: container name "minikube": log: 2021-02-28T21:16:48.036431382Z + echo 'INFO: remounting /sys read-only' 2021-02-28T21:16:48.036436797Z INFO: remounting /sys read-only 2021-02-28T21:16:48.036440663Z + mount -o remount,ro /sys 2021-02-28T21:16:48.044803323Z mount: /sys: permission denied.: container exited unexpectedly I0228 21:17:19.364769 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Status}} I0228 21:17:19.394688 56169 stop.go:39] StopHost: minikube W0228 21:17:19.395832 56169 register.go:127] "Stopping" was not found within the registered steps for "Initial Minikube Setup": [Initial Minikube Setup Selecting Driver Downloading Artifacts Starting Node Pulling Base Image Running on Localhost Local OS Release Creating Container Creating VM Running Remotely Preparing Kubernetes Generating certificates Booting control plane Configuring RBAC rules Configuring CNI Configuring Localhost Environment Verifying Kubernetes Enabling Addons Done] I0228 21:17:19.405165 56169 out.go:119] โœ‹ Stopping node "minikube" ...

โœ‹ Stopping node "minikube" ... I0228 21:17:19.405300 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Status}} I0228 21:17:19.437837 56169 stop.go:79] host is in state Stopped I0228 21:17:19.437908 56169 main.go:119] libmachine: Stopping "minikube"... I0228 21:17:19.437962 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Status}} I0228 21:17:19.468381 56169 stop.go:59] stop err: Machine "minikube" is already stopped. I0228 21:17:19.468437 56169 stop.go:62] host is already stopped W0228 21:17:20.468942 56169 register.go:127] "Stopping" was not found within the registered steps for "Initial Minikube Setup": [Initial Minikube Setup Selecting Driver Downloading Artifacts Starting Node Pulling Base Image Running on Localhost Local OS Release Creating Container Creating VM Running Remotely Preparing Kubernetes Generating certificates Booting control plane Configuring RBAC rules Configuring CNI Configuring Localhost Environment Verifying Kubernetes Enabling Addons Done] I0228 21:17:20.475308 56169 out.go:119] ๐Ÿ”ฅ Deleting "minikube" in docker ... ๐Ÿ”ฅ Deleting "minikube" in docker ... I0228 21:17:20.475420 56169 cli_runner.go:111] Run: docker container inspect -f {{.Id}} minikube I0228 21:17:20.504773 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Status}} I0228 21:17:20.534568 56169 cli_runner.go:111] Run: docker exec --privileged -t minikube /bin/bash -c "sudo init 0" W0228 21:17:20.565116 56169 cli_runner.go:149] docker exec --privileged -t minikube /bin/bash -c "sudo init 0" returned with exit code 1 I0228 21:17:20.565164 56169 oci.go:600] error shutdown minikube: docker exec --privileged -t minikube /bin/bash -c "sudo init 0": exit status 1 stdout:

stderr: Error response from daemon: Container de7dfc0d9cf192ab3914a1ca9e74ac40bf8fe51222c8cdf52719a41776da002f is not running I0228 21:17:21.565442 56169 cli_runner.go:111] Run: docker container inspect minikube --format={{.State.Status}} I0228 21:17:21.594788 56169 oci.go:608] container minikube status is Stopped I0228 21:17:21.594829 56169 oci.go:620] Successfully shutdown container minikube I0228 21:17:21.594882 56169 cli_runner.go:111] Run: docker rm -f -v minikube I0228 21:17:21.641806 56169 cli_runner.go:111] Run: docker container inspect -f {{.Id}} minikube W0228 21:17:21.670243 56169 cli_runner.go:149] docker container inspect -f {{.Id}} minikube returned with exit code 1 I0228 21:17:21.670334 56169 cli_runner.go:111] Run: docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}},{{$first := true}} "ContainerIPs": [{{range $k,$v := .Containers }}{{if $first}}{{$first = false}}{{else}}, {{end}}"{{$v.IPv4Address}}"{{end}}]}" I0228 21:17:21.703931 56169 cli_runner.go:111] Run: docker network rm minikube W0228 21:17:21.806767 56169 out.go:181] ๐Ÿคฆ StartHost failed, but will try again: creating host: create: creating: create kic node: container name "minikube": log: 2021-02-28T21:16:48.036431382Z + echo 'INFO: remounting /sys read-only' 2021-02-28T21:16:48.036436797Z INFO: remounting /sys read-only 2021-02-28T21:16:48.036440663Z + mount -o remount,ro /sys 2021-02-28T21:16:48.044803323Z mount: /sys: permission denied.: container exited unexpectedly ๐Ÿคฆ StartHost failed, but will try again: creating host: create: creating: create kic node: container name "minikube": log: 2021-02-28T21:16:48.036431382Z + echo 'INFO: remounting /sys read-only' 2021-02-28T21:16:48.036436797Z INFO: remounting /sys read-only 2021-02-28T21:16:48.036440663Z + mount -o remount,ro /sys 2021-02-28T21:16:48.044803323Z mount: /sys: permission denied.: container exited unexpectedly I0228 21:17:21.806814 56169 start.go:392] Will try again in 5 seconds ... I0228 21:17:26.807157 56169 start.go:313] acquiring machines lock for minikube: {Name:mk5bba78214f592a9db33daafb95c5a2882b4ea1 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0228 21:17:26.807365 56169 start.go:317] acquired machines lock for "minikube" in 157.453ยตs I0228 21:17:26.807387 56169 start.go:89] Provisioning new machine with config: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.17@sha256:1cd2e039ec9d418e6380b2fa0280503a72e5b282adea674ee67882f59f4f546e Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.2 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] Network: MultiNodeRequested:false} &{Name: IP: Port:8443 KubernetesVersion:v1.20.2 ControlPlane:true Worker:true} I0228 21:17:26.807450 56169 start.go:126] createHost starting for "" (driver="docker") I0228 21:17:26.810945 56169 out.go:140] ๐Ÿ”ฅ Creating docker container (CPUs=2, Memory=2200MB) ... ๐Ÿ”ฅ Creating docker container (CPUs=2, Memory=2200MB) ...I0228 21:17:26.811127 56169 start.go:160] libmachine.API.Create for "minikube" (driver="docker") I0228 21:17:26.811161 56169 client.go:168] LocalClient.Create starting I0228 21:17:26.811230 56169 main.go:119] libmachine: Reading certificate data from /home/guengoer_hakan/.minikube/certs/ca.pem I0228 21:17:26.811281 56169 main.go:119] libmachine: Decoding PEM data... I0228 21:17:26.811301 56169 main.go:119] libmachine: Parsing certificate... I0228 21:17:26.811431 56169 main.go:119] libmachine: Reading certificate data from /home/guengoer_hakan/.minikube/certs/cert.pem I0228 21:17:26.811463 56169 main.go:119] libmachine: Decoding PEM data... I0228 21:17:26.811484 56169 main.go:119] libmachine: Parsing certificate... I0228 21:17:26.811929 56169 cli_runner.go:111] Run: docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}},{{$first := true}} "ContainerIPs": [{{range $k,$v := .Containers }}{{if $first}}{{$first = false}}{{else}}, {{end}}"{{$v.IPv4Address}}"{{end}}]}" | W0228 21:17:26.841839 56169 cli_runner.go:149] docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}},{{$first := true}} "ContainerIPs": [{{range $k,$v := .Containers }}{{if $first}}{{$first = false}}{{else}}, {{end}}"{{$v.IPv4Address}}"{{end}}]}" returned with exit code 1 I0228 21:17:26.841928 56169 network_create.go:249] running [docker network inspect minikube] to gather additional debugging logs... I0228 21:17:26.841955 56169 cli_runner.go:111] Run: docker network inspect minikube W0228 21:17:26.870480 56169 cli_runner.go:149] docker network inspect minikube returned with exit code 1 I0228 21:17:26.870520 56169 network_create.go:252] error running [docker network inspect minikube]: docker network inspect minikube: exit status 1 stdout: []

stderr: Error: No such network: minikube I0228 21:17:26.870546 56169 network_create.go:254] output of [docker network inspect minikube]: -- stdout -- []

-- /stdout -- stderr Error: No such network: minikube

/stderr I0228 21:17:26.870610 56169 cli_runner.go:111] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}},{{$first := true}} "ContainerIPs": [{{range $k,$v := .Containers }}{{if $first}}{{$first = false}}{{else}}, {{end}}"{{$v.IPv4Address}}"{{end}}]}" I0228 21:17:26.899888 56169 network_create.go:104] attempt to create network 192.168.49.0/24 with subnet: minikube and gateway 192.168.49.1 and MTU of 1500 ... I0228 21:17:26.900047 56169 cli_runner.go:111] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true minikube / I0228 21:17:27.004617 56169 kic.go:100] calculated static IP "192.168.49.2" for the "minikube" container I0228 21:17:27.004750 56169 cli_runner.go:111] Run: docker ps -a --format {{.Names}}

-- /stdout -- I0228 21:17:57.669212 56169 cli_runner.go:111] Run: docker logs --timestamps --details minikube I0228 21:17:57.698097 56169 errors.go:79] Postmortem logs ("docker logs --timestamps --details minikube"): -- stdout -- 2021-02-28T21:17:28.377307611Z + configure_proxy 2021-02-28T21:17:28.377362360Z + mkdir -p /etc/systemd/system.conf.d/ 2021-02-28T21:17:28.394229808Z + [[ ! -z '' ]] 2021-02-28T21:17:28.394273162Z + cat 2021-02-28T21:17:28.400424616Z + fix_kmsg 2021-02-28T21:17:28.400458091Z + [[ ! -e /dev/kmsg ]] 2021-02-28T21:17:28.400463139Z + [[ -e /dev/console ]] 2021-02-28T21:17:28.400467375Z + echo 'WARN: /dev/kmsg does not exist, symlinking /dev/console' 2021-02-28T21:17:28.400471410Z WARN: /dev/kmsg does not exist, symlinking /dev/console 2021-02-28T21:17:28.400475394Z + ln -s /dev/console /dev/kmsg 2021-02-28T21:17:28.400480216Z + fix_mount 2021-02-28T21:17:28.400483897Z + echo 'INFO: ensuring we can execute mount/umount even with userns-remap' 2021-02-28T21:17:28.400487856Z INFO: ensuring we can execute mount/umount even with userns-remap 2021-02-28T21:17:28.400491371Z ++ which mount 2021-02-28T21:17:28.410252903Z ++ which umount 2021-02-28T21:17:28.410285050Z + chown root:root /usr/bin/mount /usr/bin/umount 2021-02-28T21:17:28.410696747Z ++ which mount 2021-02-28T21:17:28.414971981Z ++ which umount 2021-02-28T21:17:28.424116785Z + chmod -s /usr/bin/mount /usr/bin/umount 2021-02-28T21:17:28.424151785Z +++ which mount 2021-02-28T21:17:28.426501751Z ++ stat -f -c %T /usr/bin/mount 2021-02-28T21:17:28.433159638Z + [[ fuseblk == \a\u\f\s ]] 2021-02-28T21:17:28.433209023Z + echo 'INFO: remounting /sys read-only' 2021-02-28T21:17:28.433214134Z INFO: remounting /sys read-only 2021-02-28T21:17:28.433218084Z + mount -o remount,ro /sys 2021-02-28T21:17:28.446255648Z mount: /sys: permission denied.

-- /stdout -- I0228 21:17:57.698169 56169 cli_runner.go:111] Run: docker system info --format "{{json .}}" \ I0228 21:17:57.733799 56169 info.go:253] docker info: {ID:AWIP:MF6E:QS3V:P5EI:ILNT:WXIE:NGOG:IUG4:KIWY:YFFR:3LKH:BH2F Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:1 Driver:fuse-overlayfs DriverStatus:[] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:28 OomKillDisable:true NGoroutines:40 SystemTime:2021-02-28 21:17:57.723979946 +0000 UTC LoggingDriver:json-file CgroupDriver:none NEventsListener:0 KernelVersion:4.18.0-240.10.1.el8_3.x86_64 OperatingSystem:CentOS Linux 8 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:3917074432 GenericResources: DockerRootDir:/home/guengoer_hakan/.local/share/docker HTTPProxy: HTTPSProxy: NoProxy: Name:instance-2 Labels:[] ExperimentalBuild:false ServerVersion:20.10.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=rootless] ProductLicense:Community Engine Warnings:[WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode. WARNING: bridge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:}} I0228 21:17:57.733886 56169 errors.go:86] postmortem docker info: {ID:AWIP:MF6E:QS3V:P5EI:ILNT:WXIE:NGOG:IUG4:KIWY:YFFR:3LKH:BH2F Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:1 Driver:fuse-overlayfs DriverStatus:[] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:28 OomKillDisable:true NGoroutines:40 SystemTime:2021-02-28 21:17:57.723979946 +0000 UTC LoggingDriver:json-file CgroupDriver:none NEventsListener:0 KernelVersion:4.18.0-240.10.1.el8_3.x86_64 OperatingSystem:CentOS Linux 8 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:3917074432 GenericResources: DockerRootDir:/home/guengoer_hakan/.local/share/docker HTTPProxy: HTTPSProxy: NoProxy: Name:instance-2 Labels:[] ExperimentalBuild:false ServerVersion:20.10.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=rootless] ProductLicense:Community Engine Warnings:[WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode. WARNING: bridge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:}} I0228 21:17:57.733951 56169 network_create.go:249] running [docker network inspect minikube] to gather additional debugging logs... I0228 21:17:57.733967 56169 cli_runner.go:111] Run: docker network inspect minikube I0228 21:17:57.761843 56169 network_create.go:254] output of [docker network inspect minikube]: -- stdout -- [ { "Name": "minikube", "Id": "197e2de9a43f8a67e2c4f864743f1dd432acaaa29d716880a8c13eb5cc823bbe", "Created": "2021-02-28T21:17:26.926979098Z", "Scope": "local", "Driver": "bridge", "EnableIPv6": false, "IPAM": { "Driver": "default", "Options": {}, "Config": [ { "Subnet": "192.168.49.0/24", "Gateway": "192.168.49.1" } ] }, "Internal": false, "Attachable": false, "Ingress": false, "ConfigFrom": { "Network": "" }, "ConfigOnly": false, "Containers": {}, "Options": { "--icc": "", "--ip-masq": "", "com.docker.network.driver.mtu": "1500" }, "Labels": { "created_by.minikube.sigs.k8s.io": "true" } } ]

-- /stdout -- I0228 21:17:57.761967 56169 cli_runner.go:111] Run: docker system info --format "{{json .}}" I0228 21:17:57.797141 56169 info.go:253] docker info: {ID:AWIP:MF6E:QS3V:P5EI:ILNT:WXIE:NGOG:IUG4:KIWY:YFFR:3LKH:BH2F Containers:1 ContainersRunning:0 ContainersPaused:0 ContainersStopped:1 Images:1 Driver:fuse-overlayfs DriverStatus:[] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:28 OomKillDisable:true NGoroutines:40 SystemTime:2021-02-28 21:17:57.787785201 +0000 UTC LoggingDriver:json-file CgroupDriver:none NEventsListener:0 KernelVersion:4.18.0-240.10.1.el8_3.x86_64 OperatingSystem:CentOS Linux 8 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:3917074432 GenericResources: DockerRootDir:/home/guengoer_hakan/.local/share/docker HTTPProxy: HTTPSProxy: NoProxy: Name:instance-2 Labels:[] ExperimentalBuild:false ServerVersion:20.10.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:269548fa27e0089a8b8278fc4fc781d7f65a939b Expected:269548fa27e0089a8b8278fc4fc781d7f65a939b} RuncCommit:{ID:ff819c7e9184c13b7c2607fe6c30ae19403a7aff Expected:ff819c7e9184c13b7c2607fe6c30ae19403a7aff} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=rootless] ProductLicense:Community Engine Warnings:[WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode. WARNING: bridge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[] Warnings:}} I0228 21:17:57.797234 56169 client.go:171] LocalClient.Create took 30.986064229s \ I0228 21:17:59.797941 56169 ssh_runner.go:149] Run: sh -c "df -h /var | awk 'NR==2{print $5}'" I0228 21:17:59.798017 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube | W0228 21:17:59.826452 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1 I0228 21:17:59.826569 56169 retry.go:31] will retry after 200.38067ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1 stdout:

stderr: Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil

stderr: Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil \ I0228 21:18:00.934603 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube W0228 21:18:00.962752 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1 I0228 21:18:00.962878 56169 retry.go:31] will retry after 881.006265ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1 stdout:

stderr: Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil | I0228 21:18:01.844259 56169 cli_runner.go:111] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube W0228 21:18:01.874127 56169 cli_runner.go:149] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 1 W0228 21:18:01.874258 56169 start.go:257] error running df -h /var: NewSession: new client: new client: Error creating new ssh host

from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1 stdout:

stderr: Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil

W0228 21:18:01.874280 56169 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 1 stdout:

stderr: Template parsing error: template: :1:4: executing "" at <index (index .NetworkSettings.Ports "22/tcp") 0>: error calling index: index of untyped nil I0228 21:18:01.874298 56169 start.go:129] duration metric: createHost completed in 35.066838501s I0228 21:18:01.874306 56169 start.go:80] releasing machines lock for "minikube", held for 35.066931043s W0228 21:18:01.874475 56169 out.go:181] ๐Ÿ˜ฟ Failed to start docker container. Running "minikube delete" may fix it: creating host: create: creating: create kic node: container name "minikube": log: 2021-02-28T21:17:28.433209023Z + echo 'INFO: remounting /sys read-only' 2021-02-28T21:17:28.433214134Z INFO: remounting /sys read-only 2021-02-28T21:17:28.433218084Z + mount -o remount,ro /sys 2021-02-28T21:17:28.446255648Z mount: /sys: permission denied.: container exited unexpectedly

๐Ÿ˜ฟ Failed to start docker container. Running "minikube delete" may fix it: creating host: create: creating: create kic node: container name "minikube": log: 2021-02-28T21:17:28.433209023Z + echo 'INFO: remounting /sys read-only' 2021-02-28T21:17:28.433214134Z INFO: remounting /sys read-only 2021-02-28T21:17:28.433218084Z + mount -o remount,ro /sys 2021-02-28T21:17:28.446255648Z mount: /sys: permission denied.: container exited unexpectedly W0228 21:18:01.874520 56169 out.go:181]

W0228 21:18:01.874577 56169 out.go:181] ๐Ÿ’ข The minikube docker container exited unexpectedly. ๐Ÿ’ข The minikube docker container exited unexpectedly. I0228 21:18:01.878889 56169 out.go:119] ๐Ÿ’ก If you are still interested to make docker driver work. The following suggestions might help you get passed this issue: ๐Ÿ’ก If you are still interested to make docker driver work. The following suggestions might help you get passed this issue: I0228 21:18:01.881320 56169 out.go:119]

    I0228 21:18:01.883698   56169 out.go:119] - Prune unused docker images, volumes, networks and abandoned containers.

                            docker system prune --volumes

W0228 21:18:01.894403 56169 out.go:181] โŒ Exiting due to GUEST_PROVISION: Failed to start host: creating host: create: creating: create kic node: container name "minikube": log: 2021-02-28T21:17:28.433209023Z + echo 'INFO: remounting /sys read-only' 2021-02-28T21:17:28.433214134Z INFO: remounting /sys read-only 2021-02-28T21:17:28.433218084Z + mount -o remount,ro /sys 2021-02-28T21:17:28.446255648Z mount: /sys: permission denied.: container exited unexpectedly โŒ Exiting due to GUEST_PROVISION: Failed to start host: creating host: create: creating: create kic node: container name "minikube": log: 2021-02-28T21:17:28.433209023Z + echo 'INFO: remounting /sys read-only' 2021-02-28T21:17:28.433214134Z INFO: remounting /sys read-only 2021-02-28T21:17:28.433218084Z + mount -o remount,ro /sys 2021-02-28T21:17:28.446255648Z mount: /sys: permission denied.: container exited unexpectedly W0228 21:18:01.894443 56169 out.go:181]

W0228 21:18:01.894475 56169 out.go:181] ๐Ÿ˜ฟ If the above advice does not help, please let us know: ๐Ÿ˜ฟ If the above advice does not help, please let us know: W0228 21:18:01.894505 56169 out.go:181] ๐Ÿ‘‰ https://github.com/kubernetes/minikube/issues/new/choose ๐Ÿ‘‰ https://github.com/kubernetes/minikube/issues/new/choose I0228 21:18:01.898244 56169 out.go:119]

Full output of minikube start command used, if not already included:

Optional: Full output of minikube logs command:

afbjorklund commented 3 years ago

We need to have a better check against trying to run with rootless docker, which is not supported yet.

WARNING: Running in rootless-mode without cgroups. To enable cgroups in rootless-mode, you need to boot the system in cgroup v2 mode.

You will need to use the regular (rootful) Docker, if you want to use the current minikube docker driver.

See #9495

afbjorklund commented 3 years ago

Note for implementors, it is reflected in the Security Options of the docker info.

Example outputs:

 Security Options:
  apparmor
  seccomp
   Profile: default
 Security Options:
  seccomp
   Profile: default
  rootless
medyagh commented 3 years ago

we should add a solution message if Docker is Rootless that the support will come in the future and track this issue https://github.com/kubernetes/minikube/issues/10836

anyone picking this up as @afbjorklund noted here https://github.com/kubernetes/minikube/issues/10652#issuecomment-787683705

you will need to add a field to the docker info to detect Security Options rootless https://github.com/medyagh/minikube/blob/f95d43a2c78070ab10a4e7d134ff2d0952a5ca86/pkg/drivers/kic/oci/info.go#L70

daehyeok commented 3 years ago

/assign