Closed mirajraju closed 2 years ago
/kind support
Hi @mirajraju, socat
is required to be installed to run minikube with the none driver. Could you install it and then try starting minikube again.
Hi @mirajraju,
socat
is required to be installed to run minikube with the none driver. Could you install it and then try starting minikube again.
HI @spowelljr thanks for your reply. Yes it's working fine after the install socat
Glad that resolved your issue!
What Happened?
root@devops:~# minikube start --driver=none --force
X Error starting cluster: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.25.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem": exit status 1 stdout: [init] Using Kubernetes version: v1.25.2 [preflight] Running pre-flight checks [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
stderr: W1023 13:59:45.295039 17844 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration! [WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet [WARNING FileExisting-socat]: socat not found in system path [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' error execution phase preflight: [preflight] Some fatal errors occurred: [ERROR ImagePull]: failed to pull image registry.k8s.io/etcd:3.5.4-0: output: E1023 14:09:41.016262 18683 remote_image.go:222] "PullImage from image service failed" err="rpc error: code = Unknown desc = context deadline exceeded" image="registry.k8s.io/etcd:3.5.4-0" time="2022-10-23T14:09:41Z" level=fatal msg="pulling image: rpc error: code = Unknown desc = context deadline exceeded" , error: exit status 1 [preflight] If you know what you are doing, you can make a check non-fatal with
--ignore-preflight-errors=...
To see the stack trace of this error execute with --v=5 or higher╭─────────────────────────────────────────────────────────────────────────────────────────────╮ │ │ │ If the above advice does not help, please let us know: │ │ https://github.com/kubernetes/minikube/issues/new/choose │ │ │ │ * Please run
minikube logs --file=logs.txt
and attach logs.txt to the GitHub issue. │ │ │ ╰─────────────────────────────────────────────────────────────────────────────────────────────╯X Exiting due to GUEST_START: wait: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.25.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem": exit status 1 stdout: [init] Using Kubernetes version: v1.25.2 [preflight] Running pre-flight checks [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
stderr: W1023 13:59:45.295039 17844 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update your configuration! [WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap feature gate of the kubelet [WARNING FileExisting-socat]: socat not found in system path [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' error execution phase preflight: [preflight] Some fatal errors occurred: [ERROR ImagePull]: failed to pull image registry.k8s.io/etcd:3.5.4-0: output: E1023 14:09:41.016262 18683 remote_image.go:222] "PullImage from image service failed" err="rpc error: code = Unknown desc = context deadline exceeded" image="registry.k8s.io/etcd:3.5.4-0" time="2022-10-23T14:09:41Z" level=fatal msg="pulling image: rpc error: code = Unknown desc = context deadline exceeded" , error: exit status 1 [preflight] If you know what you are doing, you can make a check non-fatal with
--ignore-preflight-errors=...
To see the stack trace of this error execute with --v=5 or higher╭─────────────────────────────────────────────────────────────────────────────────────────────╮ │ │ │ If the above advice does not help, please let us know: │ │ https://github.com/kubernetes/minikube/issues/new/choose │ │ │ │ * Please run
minikube logs --file=logs.txt
and attach logs.txt to the GitHub issue. │ │ │ ╰─────────────────────────────────────────────────────────────────────────────────────────────╯Attach the log file
=~=~=~=~=~=~=~=~=~=~=~= PuTTY log 2022.10.23 20:23:45 =~=~=~=~=~=~=~=~=~=~=~= less logs.txt [?1049h[22;0;0t[?1h=
==> Audit <==
==> Last Start <==
Log file created at: 2022/10/23 14:14:05 Running on machine: devops Binary: Built with gc go1.19.1 for linux/amd64 Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg I1023 14:14:05.796177 18976 out.go:296] Setting OutFile to fd 1 ... I1023 14:14:05.796373 18976 out.go:343] TERM=xterm,COLORTERM=, which probably does not support color I1023 14:14:05.796377 18976 out.go:309] Setting ErrFile to fd 2... I1023 14:14:05.796380 18976 out.go:343] TERM=xterm,COLORTERM=, which probably does not support color I1023 14:14:05.796479 18976 root.go:333] Updating PATH: /root/.minikube/bin W1023 14:14:05.796578 18976 root.go:310] Error reading config file at /root/.minikube/config/config.json: open /root/.minikube/config/config.json: no such file or directory I1023 14:14:05.796761 18976 out.go:303] Setting JSON to false I1023 14:14:05.799406 18976 start.go:116] hostinfo: {"hostname":"devops","uptime":4106,"bootTime":1666530340,"procs":214,"os":"linux","platform":"ubuntu"," platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.4.0-131-generic","kernelArch":"x86_64","virtualizationSystem":"vbox","virtualizationRol e":"host","hostId":"27384d56-03c7-62d7-865c-117d075574dd"} I1023 14:14:05.799460 18976 start.go:126] virtualization: vbox host I1023 14:14:05.801407 18976 out.go:177] minikube v1.27.1 on Ubuntu 20.04 W1023 14:14:05.802788 18976 out.go:239] ! minikube skips various validations when --force is supplied; this may lead to unexpected behavior I1023 14:14:05.803367 18976 config.go:180] Loaded profile config "minikube": Driver=none, ContainerRuntime=docker, KubernetesVersion=v1.25.2 W1023 14:14:05.803429 18976 preload.go:295] Failed to list preload files: open /root/.minikube/cache/preloaded-tarball: no such file or directory I1023 14:14:05.803454 18976 notify.go:220] Checking for updates... I1023 14:14:05.803591 18976 exec_runner.go:51] Run: systemctl --version I1023 14:14:05.807204 18976 driver.go:362] Setting default libvirt URI to qemu:///system I1023 14:14:05.808953 18976 out.go:177] Using the none driver based on existing profile I1023 14:14:05.810202 18976 start.go:282] selected driver: none I1023 14:14:05.810223 18976 start.go:808] validating driver "none" against &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr .io/k8s-minikube/kicbase:v0.0.35@sha256:e6f9b2700841634f3b94907f9cfa6785ca4409ef8e428a0322c1781e809d311b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:n one HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 Hyperv VirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOn lyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.25.2 ClusterName:minikube Namespace:d efault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: Ser [7mlogs.txt[27m[K [KviceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:resol :[K [Kv-conf Value:/run/systemd/resolve/resolv.conf}] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name:m01 IP :[K [K:192.168.31.178 Port:8443 KubernetesVersion:v1.25.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonR :[K [Kegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subne :[K
[Kt: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/root:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Mount :[K
[KIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwa :[K
[KrePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
:[K
[KI1023 14:14:05.810308 18976 start.go:819] status for none: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: :[K
[KVersion:}
:[K
[KI1023 14:14:05.810325 18976 start.go:1568] auto setting extra-config to "kubelet.resolv-conf=/run/systemd/resolve/resolv.conf".
:[K
[KI1023 14:14:05.811698 18976 cni.go:95] Creating CNI manager for ""
:[K
[KI1023 14:14:05.811707 18976 cni.go:149] Driver none used, CNI unnecessary in this configuration, recommending no CNI
:[K
[KI1023 14:14:05.811722 18976 start_flags.go:317] config:
:[K
[K{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.35@sha256:e6f9b2700841634f3b94907f9cfa6785ca4409 :[K
[Kef8e428a0322c1781e809d311b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:none HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMoun :[K
[Kts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork :[K
[K:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRo :[K
[Kot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort: :[K
[K22 KubernetesConfig:{KubernetesVersion:v1.25.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cl :[K
[Kuster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: :[K
[K CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:resolv-conf Value:/run/systemd/resolve/resolv.conf}] ShouldLoadCachedImages:false E :[K
[KnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name:m01 IP:192.168.31.178 Port:8443 KubernetesVersion:v1.25.2 ContainerRuntime:docker Co :[K
[KntrolPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHos :[K
[KtTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false :[K
[K MountString:/root:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker :[K
[K BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath:/opt/socket_vmnet/bin/socket_vmnet_client Socket :[K
[KVMnetPath:/var/run/socket_vmnet}
:[K
[KI1023 14:14:05.814014 18976 out.go:177] Starting control plane node minikube in cluster minikube
:[K
[KI1023 14:14:05.815740 18976 profile.go:148] Saving config to /root/.minikube/profiles/minikube/config.json ...
:[K
[KI1023 14:14:05.815965 18976 cache.go:208] Successfully downloaded all kic artifacts
:[K
[KI1023 14:14:05.815984 18976 start.go:364] acquiring machines lock for minikube: {Name:mkc8ab01ad3ea83211c505c81a7ee49a8e3ecb89 Clock:{} Delay:500ms Timeout :[K
[K:13m0s Cancel:}
:[K
[KI1023 14:14:05.816379 18976 start.go:368] acquired machines lock for "minikube" in 365.802µs
:[K
[KI1023 14:14:05.816436 18976 start.go:96] Skipping create...Using existing machine configuration
:[K
[KI1023 14:14:05.816450 18976 fix.go:55] fixHost starting: m01
:[K
[KW1023 14:14:05.817212 18976 none.go:130] unable to get port: "minikube" does not appear in /root/.kube/config
:[K
[KI1023 14:14:05.817452 18976 api_server.go:165] Checking apiserver status ...
:[K
[KI1023 14:14:05.817545 18976 exec_runner.go:51] Run: sudo pgrep -xnf kube-apiserver. minikube.
:[K
[KW1023 14:14:05.836940 18976 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.minikube.: exit status 1
:[K
[Kstdout:
:[K
[K
:[K
[Kstderr:
:[K
[KI1023 14:14:05.836993 18976 exec_runner.go:51] Run: sudo systemctl is-active --quiet service kubelet
:[K
[KI1023 14:14:05.848430 18976 fix.go:103] recreateIfNeeded on minikube: state=Stopped err=
:[K
[KW1023 14:14:05.848458 18976 fix.go:129] unexpected machine state, will restart:
:[K
[KI1023 14:14:05.849646 18976 out.go:177] Restarting existing none bare metal machine for "minikube" ...
:[K
[KI1023 14:14:05.852958 18976 profile.go:148] Saving config to /root/.minikube/profiles/minikube/config.json ...
:[K
[KI1023 14:14:05.853192 18976 start.go:300] post-start starting for "minikube" (driver="none")
:[K
[KI1023 14:14:05.853232 18976 start.go:328] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minik :[K
[Kube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
:[K
[KI1023 14:14:05.853263 18976 exec_runner.go:51] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var :[K
[K/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
:[K
[KI1023 14:14:05.860010 18976 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
:[K
[KI1023 14:14:05.860027 18976 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
:[K
[KI1023 14:14:05.860034 18976 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
:[K
[KI1023 14:14:05.861973 18976 out.go:177] OS release is Ubuntu 20.04.5 LTS
:[K
[KI1023 14:14:05.863079 18976 filesync.go:126] Scanning /root/.minikube/addons for local assets ...
:[K
[KI1023 14:14:05.863134 18976 filesync.go:126] Scanning /root/.minikube/files for local assets ...
:[K
[KI1023 14:14:05.863159 18976 start.go:303] post-start completed in 9.94942ms
:[K
[KI1023 14:14:05.863166 18976 fix.go:57] fixHost completed within 46.722141ms
:[K
[KI1023 14:14:05.863171 18976 start.go:83] releasing machines lock for "minikube", held for 46.779085ms
:[K
[KI1023 14:14:05.863894 18976 exec_runner.go:51] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd. :[K
[Ksock
:[K
[Kimage-endpoint: unix:///var/run/cri-dockerd.sock
:[K
[K" | sudo tee /etc/crictl.yaml"
:[K
[KI1023 14:14:05.864327 18976 exec_runner.go:51] Run: curl -sS -m 2 https://registry.k8s.io/
:[K
[KI1023 14:14:05.889066 18976 exec_runner.go:51] Run: sudo systemctl unmask docker.service
:[K
[KI1023 14:14:06.391558 18976 exec_runner.go:51] Run: sudo systemctl enable docker.socket
:[K
[KI1023 14:14:06.754834 18976 exec_runner.go:51] Run: sudo systemctl daemon-reload
:[K
[KI1023 14:14:07.068473 18976 exec_runner.go:51] Run: sudo systemctl restart docker
:[K
[KI1023 14:14:07.511251 18976 exec_runner.go:51] Run: sudo systemctl enable cri-docker.socket
:[K
[KI1023 14:14:07.923444 18976 exec_runner.go:51] Run: sudo systemctl daemon-reload
:[K
[KI1023 14:14:08.241337 18976 exec_runner.go:51] Run: sudo systemctl start cri-docker.socket
:[K
[KI1023 14:14:08.256480 18976 start.go:451] Will wait 60s for socket path /var/run/cri-dockerd.sock
:[K
[KI1023 14:14:08.256595 18976 exec_runner.go:51] Run: stat /var/run/cri-dockerd.sock
:[K
[KI1023 14:14:08.259455 18976 start.go:472] Will wait 60s for crictl version
:[K
[KI1023 14:14:08.259522 18976 exec_runner.go:51] Run: sudo crictl version
:[K
[KI1023 14:14:08.327330 18976 start.go:481] Version: 0.1.0
:[K
[KRuntimeName: docker
:[K
[KRuntimeVersion: 20.10.20
:[K
[KRuntimeApiVersion: 1.41.0
:[K
[KI1023 14:14:08.327386 18976 exec_runner.go:51] Run: docker version --format {{.Server.Version}}
:[K
[KI1023 14:14:08.382653 18976 exec_runner.go:51] Run: docker version --format {{.Server.Version}}
:[K
[KI1023 14:14:08.425701 18976 out.go:204] Preparing Kubernetes v1.25.2 on Docker 20.10.20 ...
:[K
[KI1023 14:14:08.426281 18976 exec_runner.go:51] Run: grep 127.0.0.1 host.minikube.internal$ /etc/hosts
:[K
[KI1023 14:14:08.428841 18976 out.go:177] - kubelet.resolv-conf=/run/systemd/resolve/resolv.conf
:[K
[KI1023 14:14:08.429916 18976 preload.go:132] Checking if preload exists for k8s version v1.25.2 and runtime docker
:[K
[KI1023 14:14:08.429970 18976 exec_runner.go:51] Run: docker info --format {{.CgroupDriver}}
:[K
[KI1023 14:14:08.634219 18976 cni.go:95] Creating CNI manager for ""
:[K
[KI1023 14:14:08.634230 18976 cni.go:149] Driver none used, CNI unnecessary in this configuration, recommending no CNI
:[K
[KI1023 14:14:08.634246 18976 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
:[K
[KI1023 14:14:08.634267 18976 kubeadm.go:156] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAdd :[K
[Kress:192.168.31.178 APIServerPort:8443 KubernetesVersion:v1.25.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:minikube NodeName:devops :[K
[KDNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:Na :[K
[KmespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook, :[K
[KResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.31.178"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-e :[K
[Klect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.31.178 CgroupDriver:cgroupfs C :[K
[KlientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] :[K
[K ResolvConfSearchRegression:false}
:[K
[KI1023 14:14:08.634560 18976 kubeadm.go:161] kubeadm config:
:[K
[KapiVersion: kubeadm.k8s.io/v1beta3
:[K
[Kkind: InitConfiguration
:[K
[KlocalAPIEndpoint:
:[K
[K advertiseAddress: 192.168.31.178
:[K
[K bindPort: 8443
:[K
[KbootstrapTokens:
:[K
[K - groups:
:[K
[K - system:bootstrappers:kubeadm:default-node-token
:[K
[K ttl: 24h0m0s
:[K
[K usages:
:[K
[K - signing
:[K
[K - authentication
:[K
[KnodeRegistration:
:[K
[K criSocket: /var/run/cri-dockerd.sock
:[K
[K name: "devops"
:[K
[K kubeletExtraArgs:
:[K
[K node-ip: 192.168.31.178
:[K
[K taints: []
:[K
[K---
:[K
[KapiVersion: kubeadm.k8s.io/v1beta3
:[K
[Kkind: ClusterConfiguration
:[K
[KapiServer:
:[K
[K certSANs: ["127.0.0.1", "localhost", "192.168.31.178"]
:[K
[K extraArgs:
:[K
[K enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWe :[K
[Kbhook,ValidatingAdmissionWebhook,ResourceQuota"
:[K
[KcontrollerManager:
:[K
[K extraArgs:
:[K
[K allocate-node-cidrs: "true"
:[K
[K leader-elect: "false"
:[K
[Kscheduler:
:[K
[K extraArgs:
:[K
[K leader-elect: "false"
:[K
[KcertificatesDir: /var/lib/minikube/certs
:[K
[KclusterName: mk
:[K
[KcontrolPlaneEndpoint: control-plane.minikube.internal:8443
:[K
[Ketcd:
:[K
[K local:
:[K
[K dataDir: /var/lib/minikube/etcd
:[K
[K extraArgs:
:[K
[K proxy-refresh-interval: "70000"
:[K
[KkubernetesVersion: v1.25.2
:[K
[Knetworking:
:[K
[K dnsDomain: cluster.local
:[K
[K podSubnet: "10.244.0.0/16"
:[K
[K serviceSubnet: 10.96.0.0/12
:[K
[K---
:[K
[KapiVersion: kubelet.config.k8s.io/v1beta1
:[K
[Kkind: KubeletConfiguration
:[K
[Kauthentication:
:[K
[K x509:
:[K
[K clientCAFile: /var/lib/minikube/certs/ca.crt
:[K
[KcgroupDriver: cgroupfs
:[K
[KclusterDomain: "cluster.local"
:[K
[K# disable disk resource management by default
:[K
[KimageGCHighThresholdPercent: 100
:[K
[KevictionHard:
:[K
[K nodefs.available: "0%!"(MISSING)
:[K
[K nodefs.inodesFree: "0%!"(MISSING)
:[K
[K imagefs.available: "0%!"(MISSING)
:[K
[KfailSwapOn: false
:[K
[KstaticPodPath: /etc/kubernetes/manifests
:[K
[K---
:[K
[KapiVersion: kubeproxy.config.k8s.io/v1alpha1
:[K
[Kkind: KubeProxyConfiguration
:[K
[KclusterCIDR: "10.244.0.0/16"
:[K
[KmetricsBindAddress: 0.0.0.0:10249
:[K
[Kconntrack:
:[K
[K maxPerCore: 0
:[K
[K# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
:[K
[K tcpEstablishedTimeout: 0s
:[K
[K# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
:[K
[K tcpCloseWaitTimeout: 0s
:[K
[K
:[K
[KI1023 14:14:08.634664 18976 kubeadm.go:962] kubelet [Unit]
:[K
[KWants=docker.socket
:[K
[K
:[K
[K[Service]
:[K
[KExecStart=
:[K
[KExecStart=/var/lib/minikube/binaries/v1.25.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --co :[K
[Kntainer-runtime=remote --container-runtime-endpoint=/var/run/cri-dockerd.sock --hostname-override=devops --image-service-endpoint=/var/run/cri-dockerd.sock - :[K
[K-kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.31.178 --resolv-conf=/run/systemd/resolve/resolv.conf --runtime-request-timeout=15m
:[K
[K
:[K
[K[Install]
:[K
[K config:
:[K
[K{KubernetesVersion:v1.25.2 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe :[K
[KrRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: :[K
[KRegistryAliases: ExtraOptions:[{Component:kubelet Key:resolv-conf Value:/run/systemd/resolve/resolv.conf}] ShouldLoadCachedImages:false EnableDefaultCNI:fals :[K
[Ke CNI: NodeIP: NodePort:8443 NodeName:}
:[K
[KI1023 14:14:08.634720 18976 exec_runner.go:51] Run: sudo ls /var/lib/minikube/binaries/v1.25.2
:[K
[KI1023 14:14:08.642972 18976 binaries.go:44] Found k8s binaries, skipping transfer
:[K
[KI1023 14:14:08.643024 18976 exec_runner.go:51] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
:[K
[KI1023 14:14:08.651726 18976 exec_runner.go:144] found /etc/systemd/system/kubelet.service.d/10-kubeadm.conf, removing ...
:[K
[KI1023 14:14:08.651740 18976 exec_runner.go:207] rm: /etc/systemd/system/kubelet.service.d/10-kubeadm.conf
:[K
[KI1023 14:14:08.651811 18976 exec_runner.go:151] cp: memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (517 bytes)
:[K
[KI1023 14:14:08.651947 18976 exec_runner.go:51] Run: sudo cp -a /tmp/minikube695429201 /etc/systemd/system/kubelet.service.d/10-kubeadm.conf
:[K
[KI1023 14:14:08.659801 18976 exec_runner.go:144] found /lib/systemd/system/kubelet.service, removing ...
:[K
[KI1023 14:14:08.659815 18976 exec_runner.go:207] rm: /lib/systemd/system/kubelet.service
:[K
[KI1023 14:14:08.659863 18976 exec_runner.go:151] cp: memory --> /lib/systemd/system/kubelet.service (352 bytes)
:[K
[KI1023 14:14:08.660015 18976 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1665378502 /lib/systemd/system/kubelet.service
:[K
[KI1023 14:14:08.666713 18976 exec_runner.go:144] found /var/tmp/minikube/kubeadm.yaml.new, removing ...
:[K
[KI1023 14:14:08.666732 18976 exec_runner.go:207] rm: /var/tmp/minikube/kubeadm.yaml.new
:[K
[KI1023 14:14:08.666792 18976 exec_runner.go:151] cp: memory --> /var/tmp/minikube/kubeadm.yaml.new (2035 bytes)
:[K
[KI1023 14:14:08.666901 18976 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1694132086 /var/tmp/minikube/kubeadm.yaml.new
:[K
[KI1023 14:14:08.673628 18976 exec_runner.go:51] Run: grep 192.168.31.178 control-plane.minikube.internal$ /etc/hosts
:[K
[KI1023 14:14:08.675066 18976 certs.go:54] Setting up /root/.minikube/profiles/minikube for IP: 192.168.31.178
:[K
[KI1023 14:14:08.675154 18976 certs.go:182] skipping minikubeCA CA generation: /root/.minikube/ca.key
:[K
[KI1023 14:14:08.675191 18976 certs.go:182] skipping proxyClientCA CA generation: /root/.minikube/proxy-client-ca.key
:[K
[KI1023 14:14:08.675274 18976 certs.go:298] skipping minikube-user signed cert generation: /root/.minikube/profiles/minikube/client.key
:[K
[KI1023 14:14:08.675329 18976 certs.go:298] skipping minikube signed cert generation: /root/.minikube/profiles/minikube/apiserver.key.b0d91955
:[K
[KI1023 14:14:08.675371 18976 certs.go:298] skipping aggregator signed cert generation: /root/.minikube/profiles/minikube/proxy-client.key
:[K
[KI1023 14:14:08.675463 18976 certs.go:388] found cert: /root/.minikube/certs/root/.minikube/certs/ca-key.pem (1679 bytes)
:[K
[KI1023 14:14:08.675492 18976 certs.go:388] found cert: /root/.minikube/certs/root/.minikube/certs/ca.pem (1074 bytes)
:[K
[KI1023 14:14:08.675515 18976 certs.go:388] found cert: /root/.minikube/certs/root/.minikube/certs/cert.pem (1119 bytes)
:[K
[KI1023 14:14:08.675599 18976 certs.go:388] found cert: /root/.minikube/certs/root/.minikube/certs/key.pem (1679 bytes)
:[K
[KI1023 14:14:08.676787 18976 exec_runner.go:144] found /var/lib/minikube/certs/apiserver.crt, removing ...
:[K
[KI1023 14:14:08.676794 18976 exec_runner.go:207] rm: /var/lib/minikube/certs/apiserver.crt
:[K
[KI1023 14:14:08.676839 18976 exec_runner.go:151] cp: /root/.minikube/profiles/minikube/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
:[K
[KI1023 14:14:08.676936 18976 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1575336293 /var/lib/minikube/certs/apiserver.crt
:[K
[KI1023 14:14:08.684135 18976 exec_runner.go:144] found /var/lib/minikube/certs/apiserver.key, removing ...
:[K
[KI1023 14:14:08.684148 18976 exec_runner.go:207] rm: /var/lib/minikube/certs/apiserver.key
:[K
[KI1023 14:14:08.684186 18976 exec_runner.go:151] cp: /root/.minikube/profiles/minikube/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
:[K
[KI1023 14:14:08.684302 18976 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1319669956 /var/lib/minikube/certs/apiserver.key
:[K
[KI1023 14:14:08.690434 18976 exec_runner.go:144] found /var/lib/minikube/certs/proxy-client.crt, removing ...
:[K
[KI1023 14:14:08.690444 18976 exec_runner.go:207] rm: /var/lib/minikube/certs/proxy-client.crt
:[K
[KI1023 14:14:08.690477 18976 exec_runner.go:151] cp: /root/.minikube/profiles/minikube/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 b :[K
[Kytes)
:[K
[KI1023 14:14:08.690699 18976 exec_runner.go:51] Run: sudo cp -a /tmp/minikube19696534 /var/lib/minikube/certs/proxy-client.crt
:[K
[KI1023 14:14:08.696971 18976 exec_runner.go:144] found /var/lib/minikube/certs/proxy-client.key, removing ...
:[K
[KI1023 14:14:08.696986 18976 exec_runner.go:207] rm: /var/lib/minikube/certs/proxy-client.key
:[K
[KI1023 14:14:08.697036 18976 exec_runner.go:151] cp: /root/.minikube/profiles/minikube/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 b :[K
[Kytes)
:[K
[KI1023 14:14:08.697450 18976 exec_runner.go:51] Run: sudo cp -a /tmp/minikube3699601446 /var/lib/minikube/certs/proxy-client.key
:[K
[KI1023 14:14:08.707466 18976 exec_runner.go:144] found /var/lib/minikube/certs/ca.crt, removing ...
:[K
[KI1023 14:14:08.707484 18976 exec_runner.go:207] rm: /var/lib/minikube/certs/ca.crt
:[K
[KI1023 14:14:08.707537 18976 exec_runner.go:151] cp: /root/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
:[K
[KI1023 14:14:08.707670 18976 exec_runner.go:51] Run: sudo cp -a /tmp/minikube3393264147 /var/lib/minikube/certs/ca.crt
:[K
[KI1023 14:14:08.715984 18976 exec_runner.go:144] found /var/lib/minikube/certs/ca.key, removing ...
:[K
[KI1023 14:14:08.716018 18976 exec_runner.go:207] rm: /var/lib/minikube/certs/ca.key
:[K
[KI1023 14:14:08.716114 18976 exec_runner.go:151] cp: /root/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
:[K
[KI1023 14:14:08.716351 18976 exec_runner.go:51] Run: sudo cp -a /tmp/minikube292783604 /var/lib/minikube/certs/ca.key
:[K
[KI1023 14:14:08.726507 18976 exec_runner.go:144] found /var/lib/minikube/certs/proxy-client-ca.crt, removing ...
:[K
[KI1023 14:14:08.726518 18976 exec_runner.go:207] rm: /var/lib/minikube/certs/proxy-client-ca.crt
:[K
[KI1023 14:14:08.726553 18976 exec_runner.go:151] cp: /root/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
:[K
[KI1023 14:14:08.726644 18976 exec_runner.go:51] Run: sudo cp -a /tmp/minikube2420886662 /var/lib/minikube/certs/proxy-client-ca.crt
:[K
[KI1023 14:14:08.734079 18976 exec_runner.go:144] found /var/lib/minikube/certs/proxy-client-ca.key, removing ...
:[K
[KI1023 14:14:08.734092 18976 exec_runner.go:207] rm: /var/lib/minikube/certs/proxy-client-ca.key
:[K
[KI1023 14:14:08.734128 18976 exec_runner.go:151] cp: /root/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
:[K
[KI1023 14:14:08.734260 18976 exec_runner.go:51] Run: sudo cp -a /tmp/minikube3813290491 /var/lib/minikube/certs/proxy-client-ca.key
:[K
[KI1023 14:14:08.740217 18976 exec_runner.go:144] found /usr/share/ca-certificates/minikubeCA.pem, removing ...
:[K
[KI1023 14:14:08.740229 18976 exec_runner.go:207] rm: /usr/share/ca-certificates/minikubeCA.pem
:[K
[KI1023 14:14:08.740269 18976 exec_runner.go:151] cp: /root/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
:[K
[KI1023 14:14:08.740358 18976 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1473714834 /usr/share/ca-certificates/minikubeCA.pem
:[K
[KI1023 14:14:08.746468 18976 exec_runner.go:144] found /var/lib/minikube/kubeconfig, removing ...
:[K
[KI1023 14:14:08.746477 18976 exec_runner.go:207] rm: /var/lib/minikube/kubeconfig
:[K
[KI1023 14:14:08.746505 18976 exec_runner.go:151] cp: memory --> /var/lib/minikube/kubeconfig (744 bytes)
:[K
[KI1023 14:14:08.746564 18976 exec_runner.go:51] Run: sudo cp -a /tmp/minikube1814350214 /var/lib/minikube/kubeconfig
:[K
[KI1023 14:14:08.755012 18976 exec_runner.go:51] Run: openssl version
:[K
[KI1023 14:14:08.759661 18976 exec_runner.go:51] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificat :[K
[Kes/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
:[K
[KI1023 14:14:08.769252 18976 exec_runner.go:51] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
:[K
[KI1023 14:14:08.771026 18976 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Oct 23 14:14 /usr/share/ca-certificates/minikubeCA.pem
:[K
[KI1023 14:14:08.771061 18976 exec_runner.go:51] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
:[K
[KI1023 14:14:08.773999 18976 exec_runner.go:51] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/c :[K
[Kerts/b5213941.0"
:[K
[KI1023 14:14:08.783510 18976 kubeadm.go:396] StartCluster: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/k :[K
[Kicbase:v0.0.35@sha256:e6f9b2700841634f3b94907f9cfa6785ca4409ef8e428a0322c1781e809d311b Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:none HyperkitVpnKit :[K
[KSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: Hyp :[K
[KervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 Do :[K
[KckerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio N :[K
[KatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.25.2 ClusterName:minikube Namespace:default APIServerNa :[K
[Kme:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0 :[K
[K/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:resolv-conf Value:/run/ :[K
[Ksystemd/resolve/resolv.conf}] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name:m01 IP:192.168.31.178 Po :[K
[Krt:8443 KubernetesVersion:v1.25.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] Ve :[K
[KrifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeReques :[K
[Kted:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/root:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262 :[K
[K144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMne :[K
[KtClientPath:/opt/socket_vmnet/bin/socket_vmnet_client SocketVMnetPath:/var/run/socket_vmnet}
:[K
[KI1023 14:14:08.783627 18976 execrunner.go:51] Run: docker ps --filter status=paused --filter=name=k8s.(kube-system) --format={{.ID}}
:[K
[KI1023 14:14:08.811509 18976 exec_runner.go:51] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
:[K
[KI1023 14:14:08.820059 18976 exec_runner.go:51] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
:[K
[KI1023 14:14:08.829631 18976 exec_runner.go:51] Run: docker version --format {{.Server.Version}}
:[K
[KI1023 14:14:08.866708 18976 exec_runner.go:51] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager. :[K
[Kconf /etc/kubernetes/scheduler.conf
:[K
[KI1023 14:14:08.877355 18976 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kube :[K
[Klet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: exit status 2
:[K
[Kstdout:
:[K
[K
:[K
[Kstderr:
:[K
[Kls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
:[K
[Kls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
:[K
[Kls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
:[K
[Kls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
:[K
[KI1023 14:14:08.877396 18976 exec_runner.go:97] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.25.2:$PATH" kubeadm init --config /var/tmp :[K
[K/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,F :[K
[KileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifest :[K
[Ks-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem"
:[K
[KI1023 14:14:08.946788 18976 kubeadm.go:317] W1023 14:14:08.946246 19452 initconfiguration.go:119] Usage of CRI endpoints without URL scheme is deprecated :[K
[K and can cause kubelet errors in the future. Automatically prepending scheme "unix" to the "criSocket" with value "/var/run/cri-dockerd.sock". Please update :[K
[Kyour configuration!
:[K
[KI1023 14:14:08.952024 18976 kubeadm.go:317] [init] Using Kubernetes version: v1.25.2
:[K
[KI1023 14:14:08.952129 18976 kubeadm.go:317] [preflight] Running pre-flight checks
:[K
[KI1023 14:14:09.002269 18976 kubeadm.go:317] [WARNING Swap]: swap is enabled; production deployments should disable swap unless testing the NodeSwap featu :[K
[Kre gate of the kubelet
:[K
[KI1023 14:14:09.002493 18976 kubeadm.go:317] [WARNING FileExisting-socat]: socat not found in system path
:[K
[KI1023 14:14:09.175342 18976 kubeadm.go:317] [preflight] Pulling images required for setting up a Kubernetes cluster
:[K
[KI1023 14:14:09.175361 18976 kubeadm.go:317] [preflight] This might take a minute or two, depending on the speed of your internet connection
:[K
[KI1023 14:14:09.175367 18976 kubeadm.go:317] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
:[K
[KI1023 14:14:09.175391 18976 kubeadm.go:317] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
:[K
[K
:[K
[K
?1049l[23;0;0t]0;root@devops: ~root@devops:~# ^C
[27m[K
[K
[K?1049l[23;0;0t]0;root@devops: ~root@devops:~# ^C
[27m[K
[K
[K?1049l[23;0;0t]0;root@devops: ~root@devops:~# ^C
[27m[K
[K
[K[7m(END)[27m[K
[K
[K[7m(END)[27m[K
[K [KESCESC[KOO[KBB
[K
[K[7m(END)[27m[K
[K [KESCESC[KOO[KBB
[K
[K[7m(END)[27m[K
[K [KESCESC[KOO[KBB
[K
[K[7m(END)[27m[K
[K [KESCESC[Kqq
[K[7m(END)[27m[K
[K[?1l>[?1049l[23;0;0t]0;root@devops: ~root@devops:~# ^C
]0;root@devops: ~root@devops:~#