search

kubernetes / minikube

Run Kubernetes locally
https://minikube.sigs.k8s.io/
Apache License 2.0
29.22k stars 4.87k forks source link

Minikube ssh driver fails while bringing up docker in the vm #15760

Closed thotz closed 6 months ago

thotz commented 1 year ago

What Happened?

Docker service was not able to come due to conflicting options in docker start command and /etc/docker/daemon.json

unable to configure the Docker daemon with file /etc/docker/daemon.json: the following directives are specified both as a flag and in the configuraion file: storage-driver: (from flag: overlay2, from file: overlay2)

Both values are populated by minikube driver only at least from the logs(manually modifying service file and etc/docker/daemon.json didn't work me, it replaced with back with original values)

content of /etc/docker/daemon.json

{
"exec-opts": ["native.cgroupdriver=cgroupfs"],
"log-driver": "json-file",
"log-opts": {
        "max-size": "100m"
},
"storage-driver": "overlay2"
}

in the logs it is scpied from a file named memory

And docker service file is tee with the following contents

sudo mkdir -p /etc/systemd/system/docker.service.d && printf %s "[Service]
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --storage-driver overlay2 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=ssh --insecure-registry 10.96.0.0/12 
Environment=
" |

Attach the log file

{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.37@sha256:8bf7a0e8a062bc5e2b71d28b35bfa9cc862d9220e234e86176b3785f685d8b15 Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:ssh HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress:192.168.122.185 SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.26.1 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.26.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jiffin:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:} I0131 19:42:30.510196 58488 out.go:177] 👍 Starting control plane node minikube in cluster minikube 👍 Starting control plane node minikube in cluster minikube I0131 19:42:30.511455 58488 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker I0131 19:42:30.511726 58488 profile.go:148] Saving config to /home/jiffin/.minikube/profiles/minikube/config.json ... I0131 19:42:30.511921 58488 cache.go:107] acquiring lock: {Name:mkbeee2be41f08e1a8b4e4939a16335e81a654b3 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0131 19:42:30.511886 58488 cache.go:107] acquiring lock: {Name:mk87a4ca5993999776463766b83240494eb25e5e Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0131 19:42:30.512085 58488 cache.go:107] acquiring lock: {Name:mk2b3bba817b5a3101976589546481eaffcd0934 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0131 19:42:30.512068 58488 cache.go:107] acquiring lock: {Name:mkaf0f2683ca2058276164d362cad5ec6e5b9bc1 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0131 19:42:30.511924 58488 cache.go:107] acquiring lock: {Name:mk5df14ca4e58bc2f4d4d8aef409cff239c1c883 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0131 19:42:30.512248 58488 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.6-0 I0131 19:42:30.512274 58488 cache.go:107] acquiring lock: {Name:mk1e218bde562a689e2b83f5c9b952f85a952468 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0131 19:42:30.512408 58488 cache.go:193] Successfully downloaded all kic artifacts I0131 19:42:30.512412 58488 cache.go:115] /home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.26.1 exists I0131 19:42:30.512400 58488 cache.go:115] /home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.26.1 exists I0131 19:42:30.512127 58488 cache.go:107] acquiring lock: {Name:mk72174a90eda9d29e1966e021a11e1ff5f3f314 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0131 19:42:30.512484 58488 start.go:364] acquiring machines lock for minikube: {Name:mk42cc385fa13cc7a953623c3d553a16600ae84a Clock:{} Delay:500ms Timeout:13m0s Cancel:} I0131 19:42:30.512497 58488 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.26.1" -> "/home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.26.1" took 437.488µs I0131 19:42:30.512581 58488 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.26.1 -> /home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.26.1 succeeded I0131 19:42:30.512421 58488 cache.go:115] /home/jiffin/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists I0131 19:42:30.512424 58488 cache.go:115] /home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.26.1 exists I0131 19:42:30.512684 58488 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.26.1" -> "/home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.26.1" took 787.922µs I0131 19:42:30.512673 58488 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jiffin/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 785.686µs I0131 19:42:30.512692 58488 start.go:368] acquired machines lock for "minikube" in 134.239µs I0131 19:42:30.512755 58488 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jiffin/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded I0131 19:42:30.512760 58488 cache.go:115] /home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.26.1 exists I0131 19:42:30.512797 58488 start.go:96] Skipping create...Using existing machine configuration I0131 19:42:30.512817 58488 fix.go:55] fixHost starting: I0131 19:42:30.512727 58488 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.26.1 -> /home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.26.1 succeeded I0131 19:42:30.512469 58488 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.26.1" -> "/home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.26.1" took 532.205µs I0131 19:42:30.512822 58488 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.26.1" -> "/home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.26.1" took 826.62µs I0131 19:42:30.512881 58488 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.26.1 -> /home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.26.1 succeeded I0131 19:42:30.512904 58488 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.26.1 -> /home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.26.1 succeeded I0131 19:42:30.512522 58488 cache.go:115] /home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 exists I0131 19:42:30.512956 58488 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9" took 827.671µs I0131 19:42:30.512997 58488 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 succeeded I0131 19:42:30.512064 58488 cache.go:107] acquiring lock: {Name:mk979959316d3d19ddf62412fcc8e9eef5f980ac Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0131 19:42:30.513119 58488 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.6-0: Got permission denied while trying to connect to the Docker daemon socket at unix:///var/run/docker.sock: Get "http://%2Fvar%2Frun%2Fdocker.sock/v1.24/images/registry.k8s.io/etcd:3.5.6-0/json": dial unix /var/run/docker.sock: connect: permission denied I0131 19:42:30.513245 58488 cache.go:115] /home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.9.3 exists I0131 19:42:30.513284 58488 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.9.3" -> "/home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.9.3" took 1.232453ms I0131 19:42:30.513330 58488 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.9.3 -> /home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.9.3 succeeded I0131 19:42:30.513919 58488 fix.go:103] recreateIfNeeded on minikube: state=Running err= W0131 19:42:30.513979 58488 fix.go:129] unexpected machine state, will restart: I0131 19:42:30.516356 58488 out.go:177] 🏃 Updating the running ssh "minikube" bare metal machine ... 🏃 Updating the running ssh "minikube" bare metal machine ... I0131 19:42:30.517539 58488 machine.go:88] provisioning docker machine ... I0131 19:42:30.517673 58488 main.go:141] libmachine: Waiting for SSH to be available... I0131 19:42:30.517724 58488 main.go:141] libmachine: Getting to WaitForSSH function... I0131 19:42:30.517842 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:30.517977 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:30.518058 58488 main.go:141] libmachine: About to run SSH command: exit 0 I0131 19:42:30.855047 58488 main.go:141] libmachine: SSH cmd err, output: : I0131 19:42:30.855078 58488 main.go:141] libmachine: Detecting the provisioner... I0131 19:42:30.855107 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:30.855130 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:30.855136 58488 main.go:141] libmachine: About to run SSH command: cat /etc/os-release I0131 19:42:31.174958 58488 main.go:141] libmachine: SSH cmd err, output: : NAME="Fedora Linux" VERSION="37 (Server Edition)" ID=fedora VERSION_ID=37 VERSION_CODENAME="" PLATFORM_ID="platform:f37" PRETTY_NAME="Fedora Linux 37 (Server Edition)" ANSI_COLOR="0;38;2;60;110;180" LOGO=fedora-logo-icon CPE_NAME="cpe:/o:fedoraproject:fedora:37" HOME_URL="https://fedoraproject.org/" DOCUMENTATION_URL="https://docs.fedoraproject.org/en-US/fedora/f37/system-administrators-guide/" SUPPORT_URL="https://ask.fedoraproject.org/" BUG_REPORT_URL="https://bugzilla.redhat.com/" REDHAT_BUGZILLA_PRODUCT="Fedora" REDHAT_BUGZILLA_PRODUCT_VERSION=37 REDHAT_SUPPORT_PRODUCT="Fedora" REDHAT_SUPPORT_PRODUCT_VERSION=37 SUPPORT_END=2023-11-14 VARIANT="Server Edition" VARIANT_ID=server

I0131 19:42:31.175034 58488 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found I0131 19:42:31.175050 58488 main.go:141] libmachine: Couldn't set key PLATFORM_ID, no corresponding struct field found I0131 19:42:31.175092 58488 main.go:141] libmachine: Couldn't set key LOGO, no corresponding struct field found I0131 19:42:31.175103 58488 main.go:141] libmachine: Couldn't set key CPE_NAME, no corresponding struct field found I0131 19:42:31.175117 58488 main.go:141] libmachine: Couldn't set key DOCUMENTATION_URL, no corresponding struct field found I0131 19:42:31.175134 58488 main.go:141] libmachine: Couldn't set key REDHAT_BUGZILLA_PRODUCT, no corresponding struct field found I0131 19:42:31.175147 58488 main.go:141] libmachine: Couldn't set key REDHAT_BUGZILLA_PRODUCT_VERSION, no corresponding struct field found I0131 19:42:31.175159 58488 main.go:141] libmachine: Couldn't set key REDHAT_SUPPORT_PRODUCT, no corresponding struct field found I0131 19:42:31.175170 58488 main.go:141] libmachine: Couldn't set key REDHAT_SUPPORT_PRODUCT_VERSION, no corresponding struct field found I0131 19:42:31.175180 58488 main.go:141] libmachine: Couldn't set key SUPPORT_END, no corresponding struct field found I0131 19:42:31.175196 58488 main.go:141] libmachine: found compatible host: fedora I0131 19:42:31.175207 58488 main.go:141] libmachine: No storagedriver specified, using overlay2

I0131 19:42:31.175251 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:31.175283 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:31.175295 58488 main.go:141] libmachine: About to run SSH command: sudo hostname minikube && echo "minikube" | sudo tee /etc/hostname I0131 19:42:31.534433 58488 main.go:141] libmachine: SSH cmd err, output: : minikube

I0131 19:42:31.534502 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:31.534536 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:31.534557 58488 main.go:141] libmachine: About to run SSH command: if grep -xq 127.0.1.1. /etc/hosts; then sudo sed -i 's/^127.0.1.1./127.0.1.1 minikube/g' /etc/hosts; else echo '127.0.1.1 minikube' | sudo tee -a /etc/hosts; fi I0131 19:42:31.889482 58488 main.go:141] libmachine: SSH cmd err, output: : I0131 19:42:31.889502 58488 main.go:141] libmachine: installing base package: name=curl I0131 19:42:31.889540 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:31.889567 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:31.889590 58488 main.go:141] libmachine: About to run SSH command: sudo -E yum install -y curl I0131 19:42:32.292782 58488 cache.go:162] opening: /home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.6-0 I0131 19:42:33.344399 58488 main.go:141] libmachine: SSH cmd err, output: : Last metadata expiration check: 2:01:04 ago on Tuesday 31 January 2023 05:41:28 PM. Package curl-7.85.0-5.fc37.x86_64 is already installed. Dependencies resolved. Nothing to do. Complete!

I0131 19:42:33.344478 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:33.344527 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:33.344576 58488 main.go:141] libmachine: About to run SSH command: sudo -E yum -y update -x docker-* I0131 19:42:34.937136 58488 main.go:141] libmachine: SSH cmd err, output: : Last metadata expiration check: 2:01:06 ago on Tuesday 31 January 2023 05:41:28 PM. Dependencies resolved. Nothing to do. Complete!

I0131 19:42:34.937201 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:34.937236 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:34.937245 58488 main.go:141] libmachine: About to run SSH command: if ! type docker; then curl -sSL https://get.docker.com | sh -; fi I0131 19:42:35.253677 58488 main.go:141] libmachine: SSH cmd err, output: : docker is /usr/bin/docker

I0131 19:42:35.253717 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:35.253739 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:35.253746 58488 main.go:141] libmachine: About to run SSH command: sudo systemctl daemon-reload I0131 19:42:35.784699 58488 main.go:141] libmachine: SSH cmd err, output: : I0131 19:42:35.784739 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:35.784761 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:35.784769 58488 main.go:141] libmachine: About to run SSH command: sudo systemctl -f restart docker I0131 19:42:36.490674 58488 main.go:141] libmachine: SSH cmd err, output: : I0131 19:42:36.490715 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:36.490736 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:36.490743 58488 main.go:141] libmachine: About to run SSH command: sudo systemctl -f enable docker I0131 19:42:37.037769 58488 main.go:141] libmachine: SSH cmd err, output: : I0131 19:42:37.037784 58488 main.go:141] libmachine: checking docker daemon I0131 19:42:37.037811 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:37.037831 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:37.037838 58488 main.go:141] libmachine: About to run SSH command: sudo docker version I0131 19:42:37.423974 58488 main.go:141] libmachine: SSH cmd err, output: : Client: Docker Engine - Community Version: 20.10.23 API version: 1.41 Go version: go1.18.10 Git commit: 7155243 Built: Thu Jan 19 17:34:54 2023 OS/Arch: linux/amd64 Context: default Experimental: true

Server: Docker Engine - Community Engine: Version: 20.10.23 API version: 1.41 (minimum version 1.12) Go version: go1.18.10 Git commit: 6051f14 Built: Thu Jan 19 17:32:33 2023 OS/Arch: linux/amd64 Experimental: false containerd: Version: 1.6.16 GitCommit: 31aa4358a36870b21a992d3ad2bef29e1d693bec runc: Version: 1.1.4 GitCommit: v1.1.4-0-g5fd4c4d docker-init: Version: 0.19.0 GitCommit: de40ad0

I0131 19:42:37.424023 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:37.424046 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:37.424056 58488 main.go:141] libmachine: About to run SSH command: sudo mkdir -p /etc/docker I0131 19:42:37.776742 58488 main.go:141] libmachine: SSH cmd err, output: : I0131 19:42:37.776762 58488 main.go:141] libmachine: Copying certs to the local machine directory... I0131 19:42:37.776938 58488 main.go:141] libmachine: generating server cert: /home/jiffin/.minikube/machines/server.pem ca-key=/home/jiffin/.minikube/certs/ca.pem private-key=/home/jiffin/.minikube/certs/ca-key.pem org=jiffin.minikube san=[192.168.122.185 localhost 127.0.0.1] I0131 19:42:37.915679 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:37.915710 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:37.915716 58488 main.go:141] libmachine: About to run SSH command: sudo systemctl -f stop docker W0131 19:42:38.266381 58488 main.go:139] libmachine: SSH cmd err, output: : Warning: Stopping docker.service, but it can still be activated by: docker.socket

I0131 19:42:38.266423 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:38.266467 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:38.266489 58488 main.go:141] libmachine: About to run SSH command: if [ ! -z "$(ip link show docker0)" ]; then sudo ip link delete docker0; fi I0131 19:42:38.639642 58488 main.go:141] libmachine: SSH cmd err, output: : I0131 19:42:38.639699 58488 main.go:141] libmachine: Copying certs to the remote machine... I0131 19:42:38.639737 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:38.639766 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:38.639801 58488 main.go:141] libmachine: About to run SSH command: printf '%s' '-----BEGIN CERTIFICATE----- MIIC7zCCAdegAwIBAgIRAOf+UUahl0Gc4fE2pDIMFi0wDQYJKoZIhvcNAQELBQAw ETEPMA0GA1UEChMGamlmZmluMB4XDTIzMDEzMTE0MDIwMFoXDTI2MDExNTE0MDIw MFowETEPMA0GA1UEChMGamlmZmluMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIB CgKCAQEAwvv6qJiiCUQxyP2XTlX98VGAr+fPyitmRNucs3xTRPuUiWCEjb9fKJAa yjI0AyMPgS+iwrzcvTdsAVg9XQs7qXEHQjI1qLAmfLj3f4duGszKxbMP7JGAT+yp 8trHXKv3IAPnDSOchVqFt+zasghjC5aVg84qNFXc/DVzz6rE2/T+yI1aeIxjd2em wRNEMfHfYNdI4A80MpDWcAnPwMmh7yoMBJ/oaAJ48tBXF4tNu7zf9Ak4tq6X+V80 WVKB3U91CPj0IAhsqLemk+aIiPduGAhiqSLORnOB+kC2Dr9CjFyBYxVEFYAben9k LuX8JqerwL0wS8d+4VuvBxMSFy3JAQIDAQABo0IwQDAOBgNVHQ8BAf8EBAMCAqww DwYDVR0TAQH/BAUwAwEB/zAdBgNVHQ4EFgQUz0Hq6BZ8KT1xnQ5O9OFIx1fCol4w DQYJKoZIhvcNAQELBQADggEBAIrj180eKdWL4sg8IGzj2jIcJlnzoMdT7ymhMYDR VIwMYkc3cdeEuBrFchhNZKnn4qpSZltpxgSeJMPG5+eykNIgE8RAXwPiSdvZotME YhfPU0t9UchU4Cm1/qDcY6pke68ZQ7mnv4yhX0YkLc6ehuA2s1oe/lk1vzM+wNL3 QNyJtwT2uP5CkvUl8mc6Pq8dOBcfDCEFcOGvKE/qG+pcMlxqPf4iUScYblipU1X5 sXASu+dQ1EQzphSDfZdazFoiMNiJtbNlhns1StuR3l6ijMdrhx0oNTx3wBYZiYcH ib6ze3GiUxFSjOabaqjyYL07oqXjgPYxLpkFh0rvyLC1nHU= -----END CERTIFICATE----- ' | sudo tee /etc/docker/ca.pem I0131 19:42:38.947504 58488 main.go:141] libmachine: SSH cmd err, output: : -----BEGIN CERTIFICATE----- MIIC7zCCAdegAwIBAgIRAOf+UUahl0Gc4fE2pDIMFi0wDQYJKoZIhvcNAQELBQAw ETEPMA0GA1UEChMGamlmZmluMB4XDTIzMDEzMTE0MDIwMFoXDTI2MDExNTE0MDIw MFowETEPMA0GA1UEChMGamlmZmluMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIB CgKCAQEAwvv6qJiiCUQxyP2XTlX98VGAr+fPyitmRNucs3xTRPuUiWCEjb9fKJAa yjI0AyMPgS+iwrzcvTdsAVg9XQs7qXEHQjI1qLAmfLj3f4duGszKxbMP7JGAT+yp 8trHXKv3IAPnDSOchVqFt+zasghjC5aVg84qNFXc/DVzz6rE2/T+yI1aeIxjd2em wRNEMfHfYNdI4A80MpDWcAnPwMmh7yoMBJ/oaAJ48tBXF4tNu7zf9Ak4tq6X+V80 WVKB3U91CPj0IAhsqLemk+aIiPduGAhiqSLORnOB+kC2Dr9CjFyBYxVEFYAben9k LuX8JqerwL0wS8d+4VuvBxMSFy3JAQIDAQABo0IwQDAOBgNVHQ8BAf8EBAMCAqww DwYDVR0TAQH/BAUwAwEB/zAdBgNVHQ4EFgQUz0Hq6BZ8KT1xnQ5O9OFIx1fCol4w DQYJKoZIhvcNAQELBQADggEBAIrj180eKdWL4sg8IGzj2jIcJlnzoMdT7ymhMYDR VIwMYkc3cdeEuBrFchhNZKnn4qpSZltpxgSeJMPG5+eykNIgE8RAXwPiSdvZotME YhfPU0t9UchU4Cm1/qDcY6pke68ZQ7mnv4yhX0YkLc6ehuA2s1oe/lk1vzM+wNL3 QNyJtwT2uP5CkvUl8mc6Pq8dOBcfDCEFcOGvKE/qG+pcMlxqPf4iUScYblipU1X5 sXASu+dQ1EQzphSDfZdazFoiMNiJtbNlhns1StuR3l6ijMdrhx0oNTx3wBYZiYcH ib6ze3GiUxFSjOabaqjyYL07oqXjgPYxLpkFh0rvyLC1nHU= -----END CERTIFICATE-----

I0131 19:42:38.947563 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:38.947599 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:38.947653 58488 main.go:141] libmachine: About to run SSH command: printf '%s' '-----BEGIN CERTIFICATE----- MIIDLjCCAhagAwIBAgIRAM5KQRfGr1QL8YsbDrSfi1YwDQYJKoZIhvcNAQELBQAw ETEPMA0GA1UEChMGamlmZmluMB4XDTIzMDEzMTE0MDcwMFoXDTI2MDExNTE0MDcw MFowGjEYMBYGA1UEChMPamlmZmluLm1pbmlrdWJlMIIBIjANBgkqhkiG9w0BAQEF AAOCAQ8AMIIBCgKCAQEA9SNB4T5yGo6EsST3AvM3jW0HXfGl/1yTVDXN1ZlaqGCG aaxLV1CyZajKyvMahpQcFNhcryCUwFD2cVGATcx9eq8nfqznITmbqqlZJXTRrj6V IrbjlfNe7Fsh6n4OyvA2GQNWV5ZO0TpQ5Cfy3+uc60ToUWKx6OdPjI9iWCw5mXSL zF1uS/7Z0Sfm7x9pgJHBLlxNIvehC4dxDy/ynmeTqP4wC+IxsZTLEBriaxyAbV0l 5DT5g63pPIOy/hNTMJejZvW+JVfT3h1cmdfjdtuYrTSYIWcULz6YV9LdSn7tjwju sOftcfTfJoYg/fYr1XNJ2fRvTSMXa7Y7upB1Np5yGQIDAQABo3gwdjAOBgNVHQ8B Af8EBAMCA6gwEwYDVR0lBAwwCgYIKwYBBQUHAwEwDAYDVR0TAQH/BAIwADAfBgNV HSMEGDAWgBTPQeroFnwpPXGdDk704UjHV8KiXjAgBgNVHREEGTAXgglsb2NhbGhv c3SHBMCoermHBH8AAAEwDQYJKoZIhvcNAQELBQADggEBAIM6XcswJzBm5d0F5has 1gjxmawuqJrtzj0OjTla57NbmaK/A5MdfoekBsAEK0kevHzOefsfexn3G5k3ReN6 otIIOZU2yHMu50ncFCOwhJ2PP1KVpAAIIUy0G5Xt05klXTroE17QoFqcgvrTLTPo ulHd+iiq/nppkcOBIUF7KJ+LX7L62qh5kwTBPvm6puxq8e/2Iry4JcMFtwGVohPM 567lFH8gwvgZX17ZNvnrPxGD5aEa8ZqOF2YednIhJYb3/b+zCOF6+OiMsTChodg2 dvMuhRTo87jxutipNa3NwG+pbbx1JYDVrQOJm6YT/1IVG1TksppSmAKrTuGXd9Fv hco= -----END CERTIFICATE----- ' | sudo tee /etc/docker/server.pem I0131 19:42:39.265863 58488 main.go:141] libmachine: SSH cmd err, output: : -----BEGIN CERTIFICATE----- MIIDLjCCAhagAwIBAgIRAM5KQRfGr1QL8YsbDrSfi1YwDQYJKoZIhvcNAQELBQAw ETEPMA0GA1UEChMGamlmZmluMB4XDTIzMDEzMTE0MDcwMFoXDTI2MDExNTE0MDcw MFowGjEYMBYGA1UEChMPamlmZmluLm1pbmlrdWJlMIIBIjANBgkqhkiG9w0BAQEF AAOCAQ8AMIIBCgKCAQEA9SNB4T5yGo6EsST3AvM3jW0HXfGl/1yTVDXN1ZlaqGCG aaxLV1CyZajKyvMahpQcFNhcryCUwFD2cVGATcx9eq8nfqznITmbqqlZJXTRrj6V IrbjlfNe7Fsh6n4OyvA2GQNWV5ZO0TpQ5Cfy3+uc60ToUWKx6OdPjI9iWCw5mXSL zF1uS/7Z0Sfm7x9pgJHBLlxNIvehC4dxDy/ynmeTqP4wC+IxsZTLEBriaxyAbV0l 5DT5g63pPIOy/hNTMJejZvW+JVfT3h1cmdfjdtuYrTSYIWcULz6YV9LdSn7tjwju sOftcfTfJoYg/fYr1XNJ2fRvTSMXa7Y7upB1Np5yGQIDAQABo3gwdjAOBgNVHQ8B Af8EBAMCA6gwEwYDVR0lBAwwCgYIKwYBBQUHAwEwDAYDVR0TAQH/BAIwADAfBgNV HSMEGDAWgBTPQeroFnwpPXGdDk704UjHV8KiXjAgBgNVHREEGTAXgglsb2NhbGhv c3SHBMCoermHBH8AAAEwDQYJKoZIhvcNAQELBQADggEBAIM6XcswJzBm5d0F5has 1gjxmawuqJrtzj0OjTla57NbmaK/A5MdfoekBsAEK0kevHzOefsfexn3G5k3ReN6 otIIOZU2yHMu50ncFCOwhJ2PP1KVpAAIIUy0G5Xt05klXTroE17QoFqcgvrTLTPo ulHd+iiq/nppkcOBIUF7KJ+LX7L62qh5kwTBPvm6puxq8e/2Iry4JcMFtwGVohPM 567lFH8gwvgZX17ZNvnrPxGD5aEa8ZqOF2YednIhJYb3/b+zCOF6+OiMsTChodg2 dvMuhRTo87jxutipNa3NwG+pbbx1JYDVrQOJm6YT/1IVG1TksppSmAKrTuGXd9Fv hco= -----END CERTIFICATE-----

I0131 19:42:39.265914 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:39.265937 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:39.265978 58488 main.go:141] libmachine: About to run SSH command: printf '%s' '-----BEGIN RSA PRIVATE KEY----- MIIEpAIBAAKCAQEA9SNB4T5yGo6EsST3AvM3jW0HXfGl/1yTVDXN1ZlaqGCGaaxL V1CyZajKyvMahpQcFNhcryCUwFD2cVGATcx9eq8nfqznITmbqqlZJXTRrj6VIrbj lfNe7Fsh6n4OyvA2GQNWV5ZO0TpQ5Cfy3+uc60ToUWKx6OdPjI9iWCw5mXSLzF1u S/7Z0Sfm7x9pgJHBLlxNIvehC4dxDy/ynmeTqP4wC+IxsZTLEBriaxyAbV0l5DT5 g63pPIOy/hNTMJejZvW+JVfT3h1cmdfjdtuYrTSYIWcULz6YV9LdSn7tjwjusOft cfTfJoYg/fYr1XNJ2fRvTSMXa7Y7upB1Np5yGQIDAQABAoIBAQDdJYCCZmZjxNy6 PqHEfIxKPujdfGoHlImo950IrH9X1TSNUozpaXh3M643JtdwP1+SApqitt7bHG8n TaJVDTzKGAemRO+CTsk7TemJW/jpm7XJCnsIRPUGfzR6qlxIAiqbqCIVhBj4sgZV viBil9kJejGnckUT2tEt+hB7gPI5l2Gefkc8xN5Lvxv67tPNbAOmOp6JuVHfvEiW 8ILXyLcsKE8Vl3aShWco0jDUGBK/IKC1ixCPQdF+odY2crp/TP67X9ucbPNsJpPe xFV9yFaIOw71KqUZea0C2Fl3iazQV5l7OH7OlDMwQaiN7H7B7RKZIfdEh6OBOPNR Nz6uzC5dAoGBAPfrANmHsw4qRy54P/aQlnQPAvCUYGYfPnHXEjQ74vTk5adOkm74 L091tJC0g+D63QDj66ktgihrwsmKKW0WxyMUOw6qr7P/wcmbEqclLe8YhhE/hd+8 +M3N7CSUxfjAmbrANX+oJlHUoKsraceGnJWLM+aWyGEPpkY4mtLCOUqfAoGBAP0h DSmH5906lFvPz5xztDu+y1F/Lljt6ZtKoFYLaybNAB7sqV5NzkceZrXdKdz+Da2z kJspQ2eMD8u1hpduAz1S+25t0ORFR+CMLEZDs7bfDO6eU1C839lRouDgAP8eybVZ s+5lduOEyXasRXkNC7WZ9Ocyz4jPH+dmYkhEDUBHAoGAMc4mV40pbZkUv8Mspm4Z q6swXgCQ9TMlql0YrSGy0JwDfv8L7/swFfiBk+iP7ey35WvkdhJMaa5sbWyyMdY3 n1Z7HtEvhyvEVKowrx+LANOea2ylinM+UKoj3J1+wCCBQcFHfiPbvujGdly8XXcv keNrQ9Ha45TvRIAuqlSWieUCgYA0QhCPlGk/+QoL8lkwOYrqErey+Yi9/1ANKVj0 qqLSfdwahk1pFLMTZ6lYvnIYF7MHO10NS3WI+ReBvNYuiR3OGUWjRLSti8gNCaNS VkPR6zamRLV6o6OrH/l6Z4SNJvQJpp1JCFWFHzLgdyxYk2LpeQFggdLqsagqg66i sLnznQKBgQDsum6qHn+EHQZ/4zsy3yOWUSGBlRFHts18mXeUwDwTsnLc/XNi4tCM wG4O01OyvR3IPOnDJ/uX+xUig1wg515WcOkfNhjsjF6U7HCQNJ+9Ts8N1FTZn9ut 6nWNXclCHudofaGWu+ZF3b1SfLvTEeWi2WQZTHwsvb6dMCoqQC7Y7A== -----END RSA PRIVATE KEY----- ' | sudo tee /etc/docker/server-key.pem I0131 19:42:39.648646 58488 main.go:141] libmachine: SSH cmd err, output: : -----BEGIN RSA PRIVATE KEY----- MIIEpAIBAAKCAQEA9SNB4T5yGo6EsST3AvM3jW0HXfGl/1yTVDXN1ZlaqGCGaaxL V1CyZajKyvMahpQcFNhcryCUwFD2cVGATcx9eq8nfqznITmbqqlZJXTRrj6VIrbj lfNe7Fsh6n4OyvA2GQNWV5ZO0TpQ5Cfy3+uc60ToUWKx6OdPjI9iWCw5mXSLzF1u S/7Z0Sfm7x9pgJHBLlxNIvehC4dxDy/ynmeTqP4wC+IxsZTLEBriaxyAbV0l5DT5 g63pPIOy/hNTMJejZvW+JVfT3h1cmdfjdtuYrTSYIWcULz6YV9LdSn7tjwjusOft cfTfJoYg/fYr1XNJ2fRvTSMXa7Y7upB1Np5yGQIDAQABAoIBAQDdJYCCZmZjxNy6 PqHEfIxKPujdfGoHlImo950IrH9X1TSNUozpaXh3M643JtdwP1+SApqitt7bHG8n TaJVDTzKGAemRO+CTsk7TemJW/jpm7XJCnsIRPUGfzR6qlxIAiqbqCIVhBj4sgZV viBil9kJejGnckUT2tEt+hB7gPI5l2Gefkc8xN5Lvxv67tPNbAOmOp6JuVHfvEiW 8ILXyLcsKE8Vl3aShWco0jDUGBK/IKC1ixCPQdF+odY2crp/TP67X9ucbPNsJpPe xFV9yFaIOw71KqUZea0C2Fl3iazQV5l7OH7OlDMwQaiN7H7B7RKZIfdEh6OBOPNR Nz6uzC5dAoGBAPfrANmHsw4qRy54P/aQlnQPAvCUYGYfPnHXEjQ74vTk5adOkm74 L091tJC0g+D63QDj66ktgihrwsmKKW0WxyMUOw6qr7P/wcmbEqclLe8YhhE/hd+8 +M3N7CSUxfjAmbrANX+oJlHUoKsraceGnJWLM+aWyGEPpkY4mtLCOUqfAoGBAP0h DSmH5906lFvPz5xztDu+y1F/Lljt6ZtKoFYLaybNAB7sqV5NzkceZrXdKdz+Da2z kJspQ2eMD8u1hpduAz1S+25t0ORFR+CMLEZDs7bfDO6eU1C839lRouDgAP8eybVZ s+5lduOEyXasRXkNC7WZ9Ocyz4jPH+dmYkhEDUBHAoGAMc4mV40pbZkUv8Mspm4Z q6swXgCQ9TMlql0YrSGy0JwDfv8L7/swFfiBk+iP7ey35WvkdhJMaa5sbWyyMdY3 n1Z7HtEvhyvEVKowrx+LANOea2ylinM+UKoj3J1+wCCBQcFHfiPbvujGdly8XXcv keNrQ9Ha45TvRIAuqlSWieUCgYA0QhCPlGk/+QoL8lkwOYrqErey+Yi9/1ANKVj0 qqLSfdwahk1pFLMTZ6lYvnIYF7MHO10NS3WI+ReBvNYuiR3OGUWjRLSti8gNCaNS VkPR6zamRLV6o6OrH/l6Z4SNJvQJpp1JCFWFHzLgdyxYk2LpeQFggdLqsagqg66i sLnznQKBgQDsum6qHn+EHQZ/4zsy3yOWUSGBlRFHts18mXeUwDwTsnLc/XNi4tCM wG4O01OyvR3IPOnDJ/uX+xUig1wg515WcOkfNhjsjF6U7HCQNJ+9Ts8N1FTZn9ut 6nWNXclCHudofaGWu+ZF3b1SfLvTEeWi2WQZTHwsvb6dMCoqQC7Y7A== -----END RSA PRIVATE KEY-----

I0131 19:42:39.648937 58488 main.go:141] libmachine: Setting Docker configuration on the remote daemon... I0131 19:42:39.648975 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:39.649011 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:39.649027 58488 main.go:141] libmachine: About to run SSH command: sudo mkdir -p /etc/systemd/system/docker.service.d && printf %s "[Service] ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --storage-driver overlay2 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=ssh --insecure-registry 10.96.0.0/12 Environment= " | sudo tee /etc/systemd/system/docker.service.d/10-machine.conf I0131 19:42:40.016422 58488 main.go:141] libmachine: SSH cmd err, output: : [Service] ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --storage-driver overlay2 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=ssh --insecure-registry 10.96.0.0/12 Environment=

I0131 19:42:40.016466 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:40.016488 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:40.016497 58488 main.go:141] libmachine: About to run SSH command: sudo systemctl daemon-reload I0131 19:42:40.636392 58488 main.go:141] libmachine: SSH cmd err, output: : I0131 19:42:40.636432 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:40.636457 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:40.636466 58488 main.go:141] libmachine: About to run SSH command: sudo systemctl -f start docker I0131 19:42:41.174616 58488 main.go:141] libmachine: SSH cmd err, output: : I0131 19:42:41.174658 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:41.174682 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:41.174689 58488 main.go:141] libmachine: About to run SSH command: if ! type netstat 1>/dev/null; then ss -tln; else netstat -tln; fi I0131 19:42:41.390073 58488 main.go:141] libmachine: SSH cmd err, output: : Active Internet connections (only servers) Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 192.168.122.185:6789 0.0.0.0: LISTEN
tcp 0 0 192.168.122.185:3300 0.0.0.0: LISTEN
tcp 0 0 127.0.0.53:53 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:4343 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:5355 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6822 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6823 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6820 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6821 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6818 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6819 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6816 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6817 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6824 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6825 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6806 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6807 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6804 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6805 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6802 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6803 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6800 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6801 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6814 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6815 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6812 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6813 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6810 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6811 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6808 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:6809 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:8080 0.0.0.0: LISTEN
tcp 0 0 127.0.0.54:53 0.0.0.0: LISTEN
tcp 0 0 0.0.0.0:22 0.0.0.0: LISTEN
tcp 0 0 192.168.122.185:9283 0.0.0.0: LISTEN
tcp 0 0 192.168.122.185:8443 0.0.0.0: LISTEN
tcp6 0 0 :::9094 ::: LISTEN
tcp6 0 0 :::9095 ::: LISTEN
tcp6 0 0 :::9093 ::: LISTEN
tcp6 0 0 :::9090 ::: LISTEN
tcp6 0 0 :::9100 ::: LISTEN
tcp6 0 0 :::4343 ::: LISTEN
tcp6 0 0 :::5355 ::: LISTEN
tcp6 0 0 :::8080 ::: LISTEN
tcp6 0 0 :::22 ::: LISTEN
tcp6 0 0 :::3000 ::: LISTEN
tcp6 0 0 :::2376 :::* LISTEN

I0131 19:42:41.390291 58488 machine.go:91] provisioned docker machine in 10.872728568s I0131 19:42:41.390300 58488 start.go:300] post-start starting for "minikube" (driver="ssh") I0131 19:42:41.390305 58488 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs] I0131 19:42:41.390342 58488 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs I0131 19:42:41.390352 58488 sshutil.go:53] new ssh client: &{IP:192.168.122.185 Port:22 SSHKeyPath: Username:root} I0131 19:42:41.566606 58488 ssh_runner.go:195] Run: cat /etc/os-release I0131 19:42:41.620754 58488 command_runner.go:130] > NAME="Fedora Linux" I0131 19:42:41.620770 58488 command_runner.go:130] > VERSION="37 (Server Edition)" I0131 19:42:41.620778 58488 command_runner.go:130] > ID=fedora I0131 19:42:41.620787 58488 command_runner.go:130] > VERSION_ID=37 I0131 19:42:41.620794 58488 command_runner.go:130] > VERSION_CODENAME="" I0131 19:42:41.620800 58488 command_runner.go:130] > PLATFORM_ID="platform:f37" I0131 19:42:41.620806 58488 command_runner.go:130] > PRETTY_NAME="Fedora Linux 37 (Server Edition)" I0131 19:42:41.620812 58488 command_runner.go:130] > ANSI_COLOR="0;38;2;60;110;180" I0131 19:42:41.620816 58488 command_runner.go:130] > LOGO=fedora-logo-icon I0131 19:42:41.620820 58488 command_runner.go:130] > CPE_NAME="cpe:/o:fedoraproject:fedora:37" I0131 19:42:41.620825 58488 command_runner.go:130] > HOME_URL="https://fedoraproject.org/" I0131 19:42:41.620834 58488 command_runner.go:130] > DOCUMENTATION_URL="https://docs.fedoraproject.org/en-US/fedora/f37/system-administrators-guide/" I0131 19:42:41.620839 58488 command_runner.go:130] > SUPPORT_URL="https://ask.fedoraproject.org/" I0131 19:42:41.620843 58488 command_runner.go:130] > BUG_REPORT_URL="https://bugzilla.redhat.com/" I0131 19:42:41.620848 58488 command_runner.go:130] > REDHAT_BUGZILLA_PRODUCT="Fedora" I0131 19:42:41.620853 58488 command_runner.go:130] > REDHAT_BUGZILLA_PRODUCT_VERSION=37 I0131 19:42:41.620857 58488 command_runner.go:130] > REDHAT_SUPPORT_PRODUCT="Fedora" I0131 19:42:41.620862 58488 command_runner.go:130] > REDHAT_SUPPORT_PRODUCT_VERSION=37 I0131 19:42:41.620867 58488 command_runner.go:130] > SUPPORT_END=2023-11-14 I0131 19:42:41.620871 58488 command_runner.go:130] > VARIANT="Server Edition" I0131 19:42:41.620876 58488 command_runner.go:130] > VARIANT_ID=server I0131 19:42:41.620907 58488 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found I0131 19:42:41.620917 58488 main.go:141] libmachine: Couldn't set key PLATFORM_ID, no corresponding struct field found I0131 19:42:41.620926 58488 main.go:141] libmachine: Couldn't set key LOGO, no corresponding struct field found I0131 19:42:41.620933 58488 main.go:141] libmachine: Couldn't set key CPE_NAME, no corresponding struct field found I0131 19:42:41.620941 58488 main.go:141] libmachine: Couldn't set key DOCUMENTATION_URL, no corresponding struct field found I0131 19:42:41.620951 58488 main.go:141] libmachine: Couldn't set key REDHAT_BUGZILLA_PRODUCT, no corresponding struct field found I0131 19:42:41.620959 58488 main.go:141] libmachine: Couldn't set key REDHAT_BUGZILLA_PRODUCT_VERSION, no corresponding struct field found I0131 19:42:41.620966 58488 main.go:141] libmachine: Couldn't set key REDHAT_SUPPORT_PRODUCT, no corresponding struct field found I0131 19:42:41.620974 58488 main.go:141] libmachine: Couldn't set key REDHAT_SUPPORT_PRODUCT_VERSION, no corresponding struct field found I0131 19:42:41.620981 58488 main.go:141] libmachine: Couldn't set key SUPPORT_END, no corresponding struct field found I0131 19:42:41.620988 58488 info.go:137] Remote host: Fedora Linux 37 (Server Edition) I0131 19:42:41.620995 58488 filesync.go:126] Scanning /home/jiffin/.minikube/addons for local assets ... I0131 19:42:41.621036 58488 filesync.go:126] Scanning /home/jiffin/.minikube/files for local assets ... I0131 19:42:41.621052 58488 start.go:303] post-start completed in 230.746825ms I0131 19:42:41.621057 58488 fix.go:57] fixHost completed within 11.108245666s I0131 19:42:41.621080 58488 main.go:141] libmachine: Using SSH client type: external I0131 19:42:41.621101 58488 main.go:141] libmachine: &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null root@192.168.122.185 -p 22] /usr/bin/ssh } I0131 19:42:41.621107 58488 main.go:141] libmachine: About to run SSH command: date +%s.%N I0131 19:42:41.827448 58488 main.go:141] libmachine: SSH cmd err, output: : 1675174361.829822072

I0131 19:42:41.827461 58488 fix.go:207] guest clock: 1675174361.829822072 I0131 19:42:41.827467 58488 fix.go:220] Guest: 2023-01-31 19:42:41.829822072 +0530 IST Remote: 2023-01-31 19:42:41.621060567 +0530 IST m=+12.662632479 (delta=208.761505ms) I0131 19:42:41.827480 58488 fix.go:191] guest clock delta is within tolerance: 208.761505ms I0131 19:42:41.827484 58488 start.go:83] releasing machines lock for "minikube", held for 11.3147132s I0131 19:42:41.827744 58488 ssh_runner.go:195] Run: cat /version.json I0131 19:42:41.827756 58488 sshutil.go:53] new ssh client: &{IP:192.168.122.185 Port:22 SSHKeyPath: Username:root} I0131 19:42:41.827768 58488 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/ I0131 19:42:41.827805 58488 sshutil.go:53] new ssh client: &{IP:192.168.122.185 Port:22 SSHKeyPath: Username:root} I0131 19:42:41.984049 58488 command_runner.go:130] ! cat: /version.json: No such file or directory W0131 19:42:41.984071 58488 start.go:396] Unable to open version.json: cat /version.json: Process exited with status 1 stdout:

stderr: cat: /version.json: No such file or directory I0131 19:42:42.227381 58488 command_runner.go:130] > Temporary Redirect. I0131 19:42:45.735436 58488 cache.go:157] /home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.6-0 exists I0131 19:42:45.735450 58488 cache.go:96] cache image "registry.k8s.io/etcd:3.5.6-0" -> "/home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.6-0" took 15.223560944s I0131 19:42:45.735460 58488 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.6-0 -> /home/jiffin/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.6-0 succeeded I0131 19:42:45.735466 58488 cache.go:87] Successfully saved all images to host disk. I0131 19:42:45.735500 58488 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/loopback.conf" I0131 19:42:45.789226 58488 command_runner.go:130] ! stat: cannot statx '/etc/cni/net.d/loopback.conf': No such file or directory W0131 19:42:45.789263 58488 cni.go:208] loopback cni configuration skipped: "/etc/cni/net.d/loopback.conf" not found I0131 19:42:45.789332 58488 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d I0131 19:42:45.853662 58488 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (135 bytes) I0131 19:42:45.937737 58488 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name bridge -or -name podman ) -and -not -name .mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ; I0131 19:42:46.005780 58488 cni.go:258] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable I0131 19:42:46.005795 58488 preload.go:132] Checking if preload exists for k8s version v1.26.1 and runtime docker I0131 19:42:46.005801 58488 start.go:483] detecting cgroup driver to use... I0131 19:42:46.005882 58488 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock image-endpoint: unix:///run/containerd/containerd.sock " | sudo tee /etc/crictl.yaml" I0131 19:42:46.143453 58488 command_runner.go:130] > runtime-endpoint: unix:///run/containerd/containerd.sock I0131 19:42:46.143477 58488 command_runner.go:130] > image-endpoint: unix:///run/containerd/containerd.sock I0131 19:42:46.145142 58488 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( )sandbox_image = .$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml" I0131 19:42:46.211449 58488 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( )restrict_oom_score_adj = .$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml" I0131 19:42:46.284319 58488 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver... I0131 19:42:46.284370 58488 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( )SystemdCgroup = .$|\1SystemdCgroup = false|g' /etc/containerd/config.toml" I0131 19:42:46.354306 58488 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml" I0131 19:42:46.422443 58488 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml" I0131 19:42:46.490974 58488 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml" I0131 19:42:46.559627 58488 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk" I0131 19:42:46.622826 58488 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( )conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml" I0131 19:42:46.687723 58488 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables I0131 19:42:46.753540 58488 command_runner.go:130] > net.bridge.bridge-nf-call-iptables = 1 I0131 19:42:46.753584 58488 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward" I0131 19:42:46.821826 58488 ssh_runner.go:195] Run: sudo service containerd restart I0131 19:42:46.997221 58488 command_runner.go:130] ! Redirecting to /bin/systemctl restart containerd.service I0131 19:42:46.997243 58488 openrc.go:158] restart output: stderr Redirecting to /bin/systemctl restart containerd.service

/stderr I0131 19:42:46.997249 58488 start.go:483] detecting cgroup driver to use... I0131 19:42:46.997292 58488 ssh_runner.go:195] Run: sudo systemctl cat docker.service I0131 19:42:47.078588 58488 command_runner.go:130] > # /usr/lib/systemd/system/docker.service I0131 19:42:47.078616 58488 command_runner.go:130] > [Unit] I0131 19:42:47.078624 58488 command_runner.go:130] > Description=Docker Application Container Engine I0131 19:42:47.078630 58488 command_runner.go:130] > Documentation=https://docs.docker.com I0131 19:42:47.078640 58488 command_runner.go:130] > After=network-online.target docker.socket firewalld.service containerd.service I0131 19:42:47.078645 58488 command_runner.go:130] > Wants=network-online.target I0131 19:42:47.078649 58488 command_runner.go:130] > Requires=docker.socket containerd.service I0131 19:42:47.078653 58488 command_runner.go:130] > [Service] I0131 19:42:47.078656 58488 command_runner.go:130] > Type=notify I0131 19:42:47.078661 58488 command_runner.go:130] > # the default is not to use systemd for cgroups because the delegate issues still I0131 19:42:47.078668 58488 command_runner.go:130] > # exists and systemd currently does not support the cgroup feature set required I0131 19:42:47.078672 58488 command_runner.go:130] > # for containers run by docker I0131 19:42:47.078680 58488 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock I0131 19:42:47.078685 58488 command_runner.go:130] > ExecReload=/bin/kill -s HUP $MAINPID I0131 19:42:47.078688 58488 command_runner.go:130] > TimeoutSec=0 I0131 19:42:47.078692 58488 command_runner.go:130] > RestartSec=2 I0131 19:42:47.078695 58488 command_runner.go:130] > Restart=always I0131 19:42:47.078703 58488 command_runner.go:130] > # Note that StartLimit options were moved from "Service" to "Unit" in systemd 229. I0131 19:42:47.078710 58488 command_runner.go:130] > # Both the old, and new location are accepted by systemd 229 and up, so using the old location I0131 19:42:47.078719 58488 command_runner.go:130] > # to make them work for either version of systemd. I0131 19:42:47.078727 58488 command_runner.go:130] > StartLimitBurst=3 I0131 19:42:47.078735 58488 command_runner.go:130] > # Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230. I0131 19:42:47.078750 58488 command_runner.go:130] > # Both the old, and new name are accepted by systemd 230 and up, so using the old name to make I0131 19:42:47.078755 58488 command_runner.go:130] > # this option work for either version of systemd. I0131 19:42:47.078761 58488 command_runner.go:130] > StartLimitInterval=60s I0131 19:42:47.078768 58488 command_runner.go:130] > # Having non-zero Limits causes performance problems due to accounting overhead I0131 19:42:47.078777 58488 command_runner.go:130] > # in the kernel. We recommend using cgroups to do container-local accounting. I0131 19:42:47.078783 58488 command_runner.go:130] > LimitNOFILE=infinity I0131 19:42:47.078789 58488 command_runner.go:130] > LimitNPROC=infinity I0131 19:42:47.078794 58488 command_runner.go:130] > LimitCORE=infinity I0131 19:42:47.078799 58488 command_runner.go:130] > # Comment TasksMax if your systemd version does not support it. I0131 19:42:47.078805 58488 command_runner.go:130] > # Only systemd 226 and above support this option. I0131 19:42:47.078810 58488 command_runner.go:130] > TasksMax=infinity I0131 19:42:47.078816 58488 command_runner.go:130] > # set delegate yes so that systemd does not reset the cgroups of docker containers I0131 19:42:47.078820 58488 command_runner.go:130] > Delegate=yes I0131 19:42:47.078825 58488 command_runner.go:130] > # kill only the docker process, not all processes in the cgroup I0131 19:42:47.078830 58488 command_runner.go:130] > KillMode=process I0131 19:42:47.078836 58488 command_runner.go:130] > OOMScoreAdjust=-500 I0131 19:42:47.078840 58488 command_runner.go:130] > [Install] I0131 19:42:47.078843 58488 command_runner.go:130] > WantedBy=multi-user.target I0131 19:42:47.078849 58488 command_runner.go:130] > # /etc/systemd/system/docker.service.d/10-machine.conf I0131 19:42:47.078863 58488 command_runner.go:130] > [Service] I0131 19:42:47.078867 58488 command_runner.go:130] > ExecStart= I0131 19:42:47.078881 58488 command_runner.go:130] > ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --storage-driver overlay2 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=ssh --insecure-registry 10.96.0.0/12 I0131 19:42:47.078886 58488 command_runner.go:130] > Environment= I0131 19:42:47.080838 58488 ssh_runner.go:195] Run: sudo service containerd status I0131 19:42:47.153806 58488 command_runner.go:130] ! Redirecting to /bin/systemctl status containerd.service I0131 19:42:47.167641 58488 command_runner.go:130] > ● containerd.service - containerd container runtime I0131 19:42:47.167665 58488 command_runner.go:130] > Loaded: loaded (/usr/lib/systemd/system/containerd.service; disabled; preset: disabled) I0131 19:42:47.167676 58488 command_runner.go:130] > Active: active (running) since Tue 2023-01-31 19:42:46 IST; 167ms ago I0131 19:42:47.167684 58488 command_runner.go:130] > Docs: https://containerd.io I0131 19:42:47.167694 58488 command_runner.go:130] > Process: 11005 ExecStartPre=/sbin/modprobe overlay (code=exited, status=0/SUCCESS) I0131 19:42:47.167701 58488 command_runner.go:130] > Main PID: 11007 (containerd) I0131 19:42:47.167707 58488 command_runner.go:130] > Tasks: 9 I0131 19:42:47.167713 58488 command_runner.go:130] > Memory: 13.1M I0131 19:42:47.167720 58488 command_runner.go:130] > CPU: 49ms I0131 19:42:47.167728 58488 command_runner.go:130] > CGroup: /system.slice/containerd.service I0131 19:42:47.167739 58488 command_runner.go:130] > └─11007 /usr/bin/containerd I0131 19:42:47.167752 58488 command_runner.go:130] > Jan 31 19:42:46 minikube containerd[11007]: time="2023-01-31T19:42:46.997972645+05:30" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1 I0131 19:42:47.167765 58488 command_runner.go:130] > Jan 31 19:42:46 minikube containerd[11007]: time="2023-01-31T19:42:46.997980548+05:30" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1 I0131 19:42:47.167778 58488 command_runner.go:130] > Jan 31 19:42:46 minikube containerd[11007]: time="2023-01-31T19:42:46.997987662+05:30" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1 I0131 19:42:47.167796 58488 command_runner.go:130] > Jan 31 19:42:46 minikube containerd[11007]: time="2023-01-31T19:42:46.997997036+05:30" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="no OpenTelemetry endpoint: skip plugin" type=io.containerd.tracing.processor.v1 I0131 19:42:47.167812 58488 command_runner.go:130] > Jan 31 19:42:46 minikube containerd[11007]: time="2023-01-31T19:42:46.998004011+05:30" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1 I0131 19:42:47.167827 58488 command_runner.go:130] > Jan 31 19:42:46 minikube containerd[11007]: time="2023-01-31T19:42:46.998025872+05:30" level=error msg="failed to initialize a tracing processor \"otlp\"" error="no OpenTelemetry endpoint: skip plugin" I0131 19:42:47.167841 58488 command_runner.go:130] > Jan 31 19:42:46 minikube containerd[11007]: time="2023-01-31T19:42:46.998253347+05:30" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc I0131 19:42:47.167855 58488 command_runner.go:130] > Jan 31 19:42:46 minikube containerd[11007]: time="2023-01-31T19:42:46.998302901+05:30" level=info msg=serving... address=/run/containerd/containerd.sock I0131 19:42:47.167867 58488 command_runner.go:130] > Jan 31 19:42:46 minikube containerd[11007]: time="2023-01-31T19:42:46.998343399+05:30" level=info msg="containerd successfully booted in 0.013670s" I0131 19:42:47.167877 58488 command_runner.go:130] > Jan 31 19:42:46 minikube systemd[1]: Started containerd.service - containerd container runtime. I0131 19:42:47.167917 58488 ssh_runner.go:195] Run: sudo service containerd stop I0131 19:42:47.254304 58488 command_runner.go:130] ! Redirecting to /bin/systemctl stop containerd.service I0131 19:42:47.383016 58488 openrc.go:174] stop output: stderr Redirecting to /bin/systemctl stop containerd.service

/stderr I0131 19:42:47.383055 58488 ssh_runner.go:195] Run: sudo service containerd status I0131 19:42:47.460813 58488 command_runner.go:130] > ○ containerd.service - containerd container runtime I0131 19:42:47.460832 58488 command_runner.go:130] > Loaded: loaded (/usr/lib/systemd/system/containerd.service; disabled; preset: disabled) I0131 19:42:47.460842 58488 command_runner.go:130] > Active: inactive (dead) since Tue 2023-01-31 19:42:47 IST; 105ms ago I0131 19:42:47.460849 58488 command_runner.go:130] > Duration: 356ms I0131 19:42:47.460860 58488 command_runner.go:130] > Docs: https://containerd.io I0131 19:42:47.460868 58488 command_runner.go:130] > Process: 11005 ExecStartPre=/sbin/modprobe overlay (code=exited, status=0/SUCCESS) I0131 19:42:47.460877 58488 command_runner.go:130] > Process: 11007 ExecStart=/usr/bin/containerd (code=exited, status=0/SUCCESS) I0131 19:42:47.460884 58488 command_runner.go:130] > Main PID: 11007 (code=exited, status=0/SUCCESS) I0131 19:42:47.460890 58488 command_runner.go:130] > CPU: 52ms I0131 19:42:47.460905 58488 command_runner.go:130] > Jan 31 19:42:46 minikube containerd[11007]: time="2023-01-31T19:42:46.997997036+05:30" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="no OpenTelemetry endpoint: skip plugin" type=io.containerd.tracing.processor.v1 I0131 19:42:47.460917 58488 command_runner.go:130] > Jan 31 19:42:46 minikube containerd[11007]: time="2023-01-31T19:42:46.998004011+05:30" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1 I0131 19:42:47.460930 58488 command_runner.go:130] > Jan 31 19:42:46 minikube containerd[11007]: time="2023-01-31T19:42:46.998025872+05:30" level=error msg="failed to initialize a tracing processor \"otlp\"" error="no OpenTelemetry endpoint: skip plugin" I0131 19:42:47.460940 58488 command_runner.go:130] > Jan 31 19:42:46 minikube containerd[11007]: time="2023-01-31T19:42:46.998253347+05:30" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc I0131 19:42:47.460950 58488 command_runner.go:130] > Jan 31 19:42:46 minikube containerd[11007]: time="2023-01-31T19:42:46.998302901+05:30" level=info msg=serving... address=/run/containerd/containerd.sock I0131 19:42:47.460960 58488 command_runner.go:130] > Jan 31 19:42:46 minikube containerd[11007]: time="2023-01-31T19:42:46.998343399+05:30" level=info msg="containerd successfully booted in 0.013670s" I0131 19:42:47.460969 58488 command_runner.go:130] > Jan 31 19:42:46 minikube systemd[1]: Started containerd.service - containerd container runtime. I0131 19:42:47.460977 58488 command_runner.go:130] > Jan 31 19:42:47 minikube systemd[1]: Stopping containerd.service - containerd container runtime... I0131 19:42:47.460985 58488 command_runner.go:130] > Jan 31 19:42:47 minikube systemd[1]: containerd.service: Deactivated successfully. I0131 19:42:47.460992 58488 command_runner.go:130] > Jan 31 19:42:47 minikube systemd[1]: Stopped containerd.service - containerd container runtime. I0131 19:42:47.462540 58488 command_runner.go:130] ! Redirecting to /bin/systemctl status containerd.service I0131 19:42:47.462586 58488 ssh_runner.go:195] Run: sudo service crio status I0131 19:42:47.536949 58488 command_runner.go:130] ! Redirecting to /bin/systemctl status crio.service I0131 19:42:47.536964 58488 command_runner.go:130] ! Unit crio.service could not be found. I0131 19:42:47.537068 58488 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock image-endpoint: unix:///var/run/cri-dockerd.sock " | sudo tee /etc/crictl.yaml" I0131 19:42:47.663183 58488 command_runner.go:130] > runtime-endpoint: unix:///var/run/cri-dockerd.sock I0131 19:42:47.663206 58488 command_runner.go:130] > image-endpoint: unix:///var/run/cri-dockerd.sock I0131 19:42:47.663224 58488 docker.go:529] configuring docker to use "cgroupfs" as cgroup driver... I0131 19:42:47.663233 58488 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes) I0131 19:42:47.753093 58488 ssh_runner.go:195] Run: sudo service docker restart I0131 19:42:47.926786 58488 command_runner.go:130] ! Redirecting to /bin/systemctl restart docker.service I0131 19:42:47.926830 58488 command_runner.go:130] ! Job for docker.service failed because the control process exited with error code. I0131 19:42:47.926840 58488 command_runner.go:130] ! See "systemctl status docker.service" and "journalctl -xeu docker.service" for details. I0131 19:42:47.932836 58488 out.go:177]

Operating System

Fedora 37

Driver

SSH

afbjorklund commented 1 year ago

I don't think it was ever tested with Fedora, the minikube provisioner only specifies Ubuntu

https://github.com/kubernetes/minikube/blob/master/pkg/provision/ubuntu.go

So the flags are different in the GenericProvisioner, such as including the storage--driver.

https://github.com/docker/machine/blob/master/libmachine/provision/generic.go

thotz commented 1 year ago

@afbjorklund : Thanks for looking into it, can we change flags for the general provisioner ??

afbjorklund commented 1 year ago

Not really, but could add the Fedora provisioner ?

Minikube has forked the provisioners (mostly c/p)

thotz commented 1 year ago

Sure I will take look into in my spare time

opticoder commented 1 year ago

Same problem. The host where my minikube ssh to is Ubuntu 20.04 but fails anyways

jpcanter commented 1 year ago

Same problem. Using the ssh driver. The vm is running Ubuntu 22.04 with all prerequisites, the docker service will not start due to storage driver being specified in both parameter to dockerd in the service config and in the daemon.json file. Error from starting the docker service on the vm:

Apr 28 13:52:27 darkstar systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE

logs.txt

iSuslov commented 1 year ago

Same here. Using docker driver. M1 Mac pro:

% minikube start --driver=docker
😄  minikube v1.30.1 on Darwin 13.0 (arm64)
✨  Using the docker driver based on user configuration
❗  docker is currently using the stargz storage driver, consider switching to overlay2 for better performance
📌  Using Docker Desktop driver with root privileges
👍  Starting control plane node minikube in cluster minikube
🚜  Pulling base image ...
🔥  Creating docker container (CPUs=2, Memory=3885MB) ...
✋  Stopping node "minikube"  ...
🛑  Powering off "minikube" via SSH ...
🔥  Deleting "minikube" in docker ...
🤦  StartHost failed, but will try again: creating host: create: provisioning: Temporary Error: transferring file to machine &{{/Users/zuz/.minikube/machines/server.pem /etc/docker server.pem 0640 } 0x14000c59e60 <nil> 0x14000c42118}: sudo test -d /etc/docker && sudo scp -t /etc/docker && sudo touch -d "2023-06-29 11:12:01.444890718 -0400" /etc/docker/server.pem: Process exited with status 1
output: �scp: /etc/docker/server.pem: No such file or directory
scp: protocol error: expected control record

🔥  Creating docker container (CPUs=2, Memory=3885MB) ...
😿  Failed to start docker container. Running "minikube delete" may fix it: creating host: create: provisioning: Temporary Error: transferring file to machine &{{/Users/zuz/.minikube/machines/server-key.pem /etc/docker server-key.pem 0640 } 0x14000f98450 <nil> 0x140001a2040}: sudo test -d /etc/docker && sudo scp -t /etc/docker && sudo touch -d "2023-06-29 11:13:50.858814412 -0400" /etc/docker/server-key.pem: Process exited with status 1
output: �scp: /etc/docker/server-key.pem: No such file or directory
scp: protocol error: expected control record

E0629 11:13:53.271888   71695 out.go:448] unable to parse "error provisioning guest: Failed to start host: creating host: create: provisioning: Temporary Error: transferring file to machine &{{/Users/zuz/.minikube/machines/server-key.pem /etc/docker server-key.pem 0640 } 0x14000f98450 <nil> 0x140001a2040}: sudo test -d /etc/docker && sudo scp -t /etc/docker && sudo touch -d \"2023-06-29 11:13:50.858814412 -0400\" /etc/docker/server-key.pem: Process exited with status 1\noutput: \x00\x01scp: /etc/docker/server-key.pem: No such file or directory\n\x01scp: protocol error: expected control record\n": template: error provisioning guest: Failed to start host: creating host: create: provisioning: Temporary Error: transferring file to machine &{{/Users/zuz/.minikube/machines/server-key.pem /etc/docker server-key.pem 0640 } 0x14000f98450 <nil> 0x140001a2040}: sudo test -d /etc/docker && sudo scp -t /etc/docker && sudo touch -d "2023-06-29 11:13:50.858814412 -0400" /etc/docker/server-key.pem: Process exited with status 1
output: scp: /etc/docker/server-key.pem: No such file or directory
scp: protocol error: expected control record
:1: unexpected "/" in command - returning raw string.
k8s-triage-robot commented 8 months ago

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

k8s-triage-robot commented 7 months ago

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle rotten

k8s-triage-robot commented 6 months ago

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs.

This bot triages issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/close not-planned

k8s-ci-robot commented 6 months ago

@k8s-triage-robot: Closing this issue, marking it as "Not Planned".

In response to [this](https://github.com/kubernetes/minikube/issues/15760#issuecomment-2016527848): >The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs. > >This bot triages issues according to the following rules: >- After 90d of inactivity, `lifecycle/stale` is applied >- After 30d of inactivity since `lifecycle/stale` was applied, `lifecycle/rotten` is applied >- After 30d of inactivity since `lifecycle/rotten` was applied, the issue is closed > >You can: >- Reopen this issue with `/reopen` >- Mark this issue as fresh with `/remove-lifecycle rotten` >- Offer to help out with [Issue Triage][1] > >Please send feedback to sig-contributor-experience at [kubernetes/community](https://github.com/kubernetes/community). > >/close not-planned > >[1]: https://www.kubernetes.dev/docs/guide/issue-triage/ Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.