search

kubernetes / minikube

Run Kubernetes locally
https://minikube.sigs.k8s.io/
Apache License 2.0
28.77k stars 4.81k forks source link

error execution phase upload-config/kubelet: Error writing Crisocket information for the control-plane node: timed out waiting for the condition #6399

Closed a1exus closed 4 years ago

a1exus commented 4 years ago

The exact command to reproduce the issue:

$ time minikube start --vm-driver kvm2 --cpus 4 --memory 10240 --disk-size=500000 --extra-config=apiserver.authorization-mode=RBAC

The full output of the command that failed:

toor@suey:~$ MINIKUBE_HOME=/media/toor/more/home/toor/.minikube
toor@suey:~$ test -d $MINIKUBE_HOME
toor@suey:~$ echo $?
0
toor@suey:~$ 
toor@suey:~$ time minikube start --vm-driver kvm2 --cpus 4 --memory 10240 --disk-size=500000 --extra-config=apiserver.authorization-mode=RBAC
😄  minikube v1.6.2 on Debian kali-rolling
✨  Selecting 'kvm2' driver from user configuration (alternates: [none])
🔥  Creating kvm2 VM (CPUs=4, Memory=10240MB, Disk=500000MB) ...
🐳  Preparing Kubernetes v1.17.0 on Docker '19.03.5' ...
    ▪ apiserver.authorization-mode=RBAC
🚜  Pulling images ...
🚀  Launching Kubernetes ... 

💣  Error starting cluster: init failed. cmd: "/bin/bash -c \"sudo env PATH=/var/lib/minikube/binaries/v1.17.0:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap\"": /bin/bash -c "sudo env PATH=/var/lib/minikube/binaries/v1.17.0:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap": Process exited with status 1
stdout:
[init] Using Kubernetes version: v1.17.0
[preflight] Running pre-flight checks
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[certs] Using certificateDir folder "/var/lib/minikube/certs"
[certs] Using existing ca certificate authority
[certs] Using existing apiserver certificate and key on disk
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [minikube localhost] and IPs [192.168.39.222 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [minikube localhost] and IPs [192.168.39.222 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[apiclient] All control plane components are healthy after 8.505453 seconds
[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
[kubelet] Creating a ConfigMap "kubelet-config-1.17" in namespace kube-system with the configuration for the kubelets in the cluster
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get http://localhost:10248/healthz: dial tcp 127.0.0.1:10248: connect: connection refused.

stderr:
W0125 20:22:40.163322    3264 common.go:77] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta1". Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
W0125 20:22:40.164130    3264 common.go:77] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta1". Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
W0125 20:22:40.165715    3264 validation.go:28] Cannot validate kubelet config - no validator is available
W0125 20:22:40.165723    3264 validation.go:28] Cannot validate kube-proxy config - no validator is available
    [WARNING Service-Docker]: docker service is not enabled, please run 'systemctl enable docker.service'
    [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
    [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
W0125 20:22:42.421845    3264 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "RBAC"
W0125 20:22:42.428373    3264 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "RBAC"
W0125 20:22:42.430465    3264 manifests.go:214] the default kube-apiserver authorization-mode is "Node,RBAC"; using "RBAC"
error execution phase upload-config/kubelet: Error writing Crisocket information for the control-plane node: timed out waiting for the condition
To see the stack trace of this error execute with --v=5 or higher

😿  minikube is exiting due to an error. If the above message is not useful, open an issue:
👉  https://github.com/kubernetes/minikube/issues/new/choose

real    3m13.551s
user    0m1.499s
sys 0m0.621s
toor@suey:~$

The output of the minikube logs command:

toor@suey:~$ minikube logs
==> Docker <==
-- Logs begin at Sat 2020-01-25 20:21:56 UTC, end at Sat 2020-01-25 20:31:06 UTC. --
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.158863432Z" level=info msg="loading plugin "io.containerd.service.v1.containers-service"..." type=io.containerd.service.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.158898526Z" level=info msg="loading plugin "io.containerd.service.v1.content-service"..." type=io.containerd.service.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.158939306Z" level=info msg="loading plugin "io.containerd.service.v1.diff-service"..." type=io.containerd.service.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.158969723Z" level=info msg="loading plugin "io.containerd.service.v1.images-service"..." type=io.containerd.service.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.158997146Z" level=info msg="loading plugin "io.containerd.service.v1.leases-service"..." type=io.containerd.service.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.159032069Z" level=info msg="loading plugin "io.containerd.service.v1.namespaces-service"..." type=io.containerd.service.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.159062985Z" level=info msg="loading plugin "io.containerd.service.v1.snapshots-service"..." type=io.containerd.service.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.159118467Z" level=info msg="loading plugin "io.containerd.runtime.v1.linux"..." type=io.containerd.runtime.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.159519747Z" level=info msg="loading plugin "io.containerd.runtime.v2.task"..." type=io.containerd.runtime.v2
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.159769770Z" level=info msg="loading plugin "io.containerd.monitor.v1.cgroups"..." type=io.containerd.monitor.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.161282110Z" level=info msg="loading plugin "io.containerd.service.v1.tasks-service"..." type=io.containerd.service.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.161427540Z" level=info msg="loading plugin "io.containerd.internal.v1.restart"..." type=io.containerd.internal.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.161579837Z" level=info msg="loading plugin "io.containerd.grpc.v1.containers"..." type=io.containerd.grpc.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.161616431Z" level=info msg="loading plugin "io.containerd.grpc.v1.content"..." type=io.containerd.grpc.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.161646974Z" level=info msg="loading plugin "io.containerd.grpc.v1.diff"..." type=io.containerd.grpc.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.161675683Z" level=info msg="loading plugin "io.containerd.grpc.v1.events"..." type=io.containerd.grpc.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.161702244Z" level=info msg="loading plugin "io.containerd.grpc.v1.healthcheck"..." type=io.containerd.grpc.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.161731232Z" level=info msg="loading plugin "io.containerd.grpc.v1.images"..." type=io.containerd.grpc.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.161759953Z" level=info msg="loading plugin "io.containerd.grpc.v1.leases"..." type=io.containerd.grpc.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.161788635Z" level=info msg="loading plugin "io.containerd.grpc.v1.namespaces"..." type=io.containerd.grpc.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.161871055Z" level=info msg="loading plugin "io.containerd.internal.v1.opt"..." type=io.containerd.internal.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.162005280Z" level=info msg="loading plugin "io.containerd.grpc.v1.snapshots"..." type=io.containerd.grpc.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.162042235Z" level=info msg="loading plugin "io.containerd.grpc.v1.tasks"..." type=io.containerd.grpc.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.162071316Z" level=info msg="loading plugin "io.containerd.grpc.v1.version"..." type=io.containerd.grpc.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.162098831Z" level=info msg="loading plugin "io.containerd.grpc.v1.introspection"..." type=io.containerd.grpc.v1
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.162550616Z" level=info msg=serving... address="/var/run/docker/containerd/containerd-debug.sock"
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.162701225Z" level=info msg=serving... address="/var/run/docker/containerd/containerd.sock"
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.163160765Z" level=info msg="containerd successfully booted in 0.031966s"
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.180944131Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.181010994Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.181073781Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock 0  <nil>}] <nil>}" module=grpc
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.181115588Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.184180821Z" level=info msg="parsed scheme: \"unix\"" module=grpc
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.184400619Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.184509001Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///var/run/docker/containerd/containerd.sock 0  <nil>}] <nil>}" module=grpc
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.184624972Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.226931727Z" level=warning msg="Your kernel does not support cgroup blkio weight"
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.226964216Z" level=warning msg="Your kernel does not support cgroup blkio weight_device"
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.226972695Z" level=warning msg="Your kernel does not support cgroup blkio throttle.read_bps_device"
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.226979331Z" level=warning msg="Your kernel does not support cgroup blkio throttle.write_bps_device"
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.226985676Z" level=warning msg="Your kernel does not support cgroup blkio throttle.read_iops_device"
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.226992131Z" level=warning msg="Your kernel does not support cgroup blkio throttle.write_iops_device"
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.227155570Z" level=info msg="Loading containers: start."
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.338007305Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.404718397Z" level=info msg="Loading containers: done."
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.422670591Z" level=info msg="Docker daemon" commit=633a0ea838 graphdriver(s)=overlay2 version=19.03.5
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.422811824Z" level=info msg="Daemon has completed initialization"
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.470179540Z" level=info msg="API listen on /var/run/docker.sock"
Jan 25 20:22:12 minikube dockerd[2144]: time="2020-01-25T20:22:12.470220715Z" level=info msg="API listen on [::]:2376"
Jan 25 20:22:12 minikube systemd[1]: Started Docker Application Container Engine.
Jan 25 20:22:45 minikube dockerd[2144]: time="2020-01-25T20:22:45.518601189Z" level=info msg="shim containerd-shim started" address="/containerd-shim/moby/8605701febccbccfceefeb645622fb58cbe56c317e1e64bd1003cee967b64256/shim.sock" debug=false pid=4009
Jan 25 20:22:45 minikube dockerd[2144]: time="2020-01-25T20:22:45.543127505Z" level=info msg="shim containerd-shim started" address="/containerd-shim/moby/ddcb417af017f87420cddb3281edc861e78178568835d9872c047259b5870593/shim.sock" debug=false pid=4026
Jan 25 20:22:45 minikube dockerd[2144]: time="2020-01-25T20:22:45.547857243Z" level=info msg="shim containerd-shim started" address="/containerd-shim/moby/fa15962c99f7826a263c3578803b3ee58ebb06787f17c7fe5986b0d1ca568eb5/shim.sock" debug=false pid=4043
Jan 25 20:22:45 minikube dockerd[2144]: time="2020-01-25T20:22:45.561896369Z" level=info msg="shim containerd-shim started" address="/containerd-shim/moby/24aed5676c8b9ba77c9ed1eb75b79ae7d8f9bd17dfe785aa2478c1b3b58dcf03/shim.sock" debug=false pid=4060
Jan 25 20:22:45 minikube dockerd[2144]: time="2020-01-25T20:22:45.564667159Z" level=info msg="shim containerd-shim started" address="/containerd-shim/moby/6129255dc4adcdb273358c3fd64aba91da70fcc7419ae0244720cf5354fa2d13/shim.sock" debug=false pid=4065
Jan 25 20:22:45 minikube dockerd[2144]: time="2020-01-25T20:22:45.781002875Z" level=info msg="shim containerd-shim started" address="/containerd-shim/moby/0c108e98850ac0d14e529afdc831894335f6604ca96d33abe2e352833ab04ca1/shim.sock" debug=false pid=4297
Jan 25 20:22:45 minikube dockerd[2144]: time="2020-01-25T20:22:45.839530024Z" level=info msg="shim containerd-shim started" address="/containerd-shim/moby/9b2de733da944c38c5ee9e4c330fd3fc6cb30350a59c2f923d5c1800a03dee76/shim.sock" debug=false pid=4367
Jan 25 20:22:45 minikube dockerd[2144]: time="2020-01-25T20:22:45.847515542Z" level=info msg="shim containerd-shim started" address="/containerd-shim/moby/53f05fb2adc30ab51aa26df7106855b8012faa2d8ca930c46a60f6a715ce964d/shim.sock" debug=false pid=4386
Jan 25 20:22:45 minikube dockerd[2144]: time="2020-01-25T20:22:45.855089865Z" level=info msg="shim containerd-shim started" address="/containerd-shim/moby/44018b2e27a54d8757c5f5a7cf9b16b82c87d76bf3506bebcd2332b5b300c378/shim.sock" debug=false pid=4406
Jan 25 20:22:45 minikube dockerd[2144]: time="2020-01-25T20:22:45.858877762Z" level=info msg="shim containerd-shim started" address="/containerd-shim/moby/9b28a2dda7c2f9495e653390cd833af1e571e1f59d6cd48493bef8767d80ff72/shim.sock" debug=false pid=4411

==> container status <==
CONTAINER           IMAGE               CREATED             STATE               NAME                      ATTEMPT             POD ID
44018b2e27a54       303ce5db0e90d       8 minutes ago       Running             etcd                      0                   24aed5676c8b9
9b2de733da944       78c190f736b11       8 minutes ago       Running             kube-scheduler            0                   6129255dc4adc
9b28a2dda7c2f       0cae8d5cc64c7       8 minutes ago       Running             kube-apiserver            0                   fa15962c99f78
53f05fb2adc30       5eb3b74868724       8 minutes ago       Running             kube-controller-manager   0                   ddcb417af017f
0c108e98850ac       bd12a212f9dcb       8 minutes ago       Running             kube-addon-manager        0                   8605701febccb

==> dmesg <==
[Jan25 20:21] You have booted with nomodeset. This means your GPU drivers are DISABLED
[  +0.000000] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly
[  +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it
[  +0.047406]  #2
[  +0.000900]  #3
[  +0.012401] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ +15.114739] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[  +0.855356] systemd[1]: Failed to bump fs.file-max, ignoring: Invalid argument
[  +0.003243] systemd-fstab-generator[1171]: Ignoring "noauto" for root device
[  +0.004032] systemd[1]: File /usr/lib/systemd/system/systemd-journald.service:12 configures an IP firewall (IPAddressDeny=any), but the local system does not support BPF/cgroup based firewalling.
[  +0.000001] systemd[1]: Proceeding WITHOUT firewalling in effect! (This warning is only shown for the first loaded unit using IP firewalling.)
[  +1.109396] NFSD: the nfsdcld client tracking upcall will be removed in 3.10. Please transition to using nfsdcltrack.
[  +1.317130] vboxguest: loading out-of-tree module taints kernel.
[  +0.003089] vboxguest: PCI device not found, probably running on physical hardware.
[Jan25 20:22] systemd-fstab-generator[2039]: Ignoring "noauto" for root device
[ +29.093700] systemd-fstab-generator[3020]: Ignoring "noauto" for root device
[  +9.012632] systemd-fstab-generator[3419]: Ignoring "noauto" for root device
[  +2.977281] kauditd_printk_skb: 68 callbacks suppressed
[Jan25 20:23] serial8250: too much work for irq4
[ +16.924791] serial8250: too much work for irq4
[ +27.377849] NFSD: Unable to end grace period: -110

==> kernel <==
 20:31:06 up 9 min,  1 user,  load average: 0.61, 0.74, 0.45
Linux minikube 4.19.81 #1 SMP Tue Dec 10 16:09:50 PST 2019 x86_64 GNU/Linux
PRETTY_NAME="Buildroot 2019.02.7"

==> kube-addon-manager ["0c108e98850a"] <==
error: no objects passed to apply
error: no objects passed to apply
secret/kubernetes-dashboard-csrf unchanged
secret/kubernetes-dashboard-key-holder unchanged
service/kubernetes-dashboard unchanged
service/dashboard-metrics-scraper unchanged
deployment.apps/tiller-deploy unchanged
serviceaccount/tiller unchanged
service/tiller-deploy unchanged
serviceaccount/minikube-ingress-dns unchanged
clusterrole.rbac.authorization.k8s.io/minikube-ingress-dns unchanged
clusterrolebinding.rbac.authorization.k8s.io/minikube-ingress-dns unchanged
pod/kube-ingress-dns-minikube unchanged
deployment.apps/nginx-ingress-controller unchanged
serviceaccount/nginx-ingress unchanged
clusterrole.rbac.authorization.k8s.io/system:nginx-ingress unchanged
role.rbac.authorization.k8s.io/system::nginx-ingress-role unchanged
daemonset.apps/registry-proxy unchanged
replicationcontroller/registry unchanged
service/registry unchanged
serviceaccount/storage-provisioner unchanged
INFO: == Kubernetes addon reconcile completed at 2020-01-25T20:30:59+00:00 ==
INFO: Leader election disabled.
INFO: == Kubernetes addon ensure completed at 2020-01-25T20:31:01+00:00 ==
INFO: == Reconciling with deprecated label ==
INFO: == Reconciling with addon-manager label ==
clusterrole.rbac.authorization.k8s.io/kubernetes-dashboard unchanged
clusterrolebinding.rbac.authorization.k8s.io/kubernetes-dashboard unchanged
configmap/kubernetes-dashboard-settings unchanged
deployment.apps/dashboard-metrics-scraper unchanged
deployment.apps/kubernetes-dashboard unchanged
namespace/kubernetes-dashboard unchanged
role.rbac.authorization.k8s.io/kubernetes-dashboard unchanged
rolebinding.rbac.authorization.k8s.io/kubernetes-dashboard unchanged
serviceaccount/kubernetes-dashboard unchanged
secret/kubernetes-dashboard-certs unchanged
secret/kubernetes-dashboard-csrf unchanged
secret/kubernetes-dashboard-key-holder unchanged
service/kubernetes-dashboard unchanged
service/dashboard-metrics-scraper unchanged
deployment.apps/tiller-deploy unchanged
serviceaccount/tiller unchanged
service/tiller-deploy unchanged
serviceaccount/minikube-ingress-dns unchanged
clusterrole.rbac.authorization.k8s.io/minikube-ingress-dns unchanged
clusterrolebinding.rbac.authorization.k8s.io/minikube-ingress-dns unchanged
pod/kube-ingress-dns-minikube unchanged
deployment.apps/nginx-ingress-controller unchanged
serviceaccount/nginx-ingress unchanged
clusterrole.rbac.authorization.k8s.io/system:nginx-ingress unchanged
role.rbac.authorization.k8s.io/system::nginx-ingress-role unchanged
daemonset.apps/registry-proxy unchanged
replicationcontroller/registry unchanged
service/registry unchanged
serviceaccount/storage-provisioner unchanged
INFO: == Kubernetes addon reconcile completed at 2020-01-25T20:31:05+00:00 ==
INFO: Leader election disabled.
INFO: == Kubernetes addon ensure completed at 2020-01-25T20:31:05+00:00 ==
INFO: == Reconciling with deprecated label ==
INFO: == Reconciling with addon-manager label ==

==> kube-apiserver ["9b28a2dda7c2"] <==
W0125 20:22:47.508142       1 genericapiserver.go:404] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
W0125 20:22:47.513543       1 genericapiserver.go:404] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
W0125 20:22:47.547053       1 genericapiserver.go:404] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
W0125 20:22:47.563451       1 genericapiserver.go:404] Skipping API apps/v1beta2 because it has no resources.
W0125 20:22:47.563475       1 genericapiserver.go:404] Skipping API apps/v1beta1 because it has no resources.
I0125 20:22:47.571346       1 plugins.go:158] Loaded 11 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,MutatingAdmissionWebhook,RuntimeClass.
I0125 20:22:47.571363       1 plugins.go:161] Loaded 7 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,ValidatingAdmissionWebhook,RuntimeClass,ResourceQuota.
I0125 20:22:47.572893       1 client.go:361] parsed scheme: "endpoint"
I0125 20:22:47.572931       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 0  <nil>}]
I0125 20:22:47.579082       1 client.go:361] parsed scheme: "endpoint"
I0125 20:22:47.579145       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 0  <nil>}]
I0125 20:22:47.707451       1 client.go:361] parsed scheme: "endpoint"
I0125 20:22:47.707477       1 endpoint.go:68] ccResolverWrapper: sending new addresses to cc: [{https://127.0.0.1:2379 0  <nil>}]
I0125 20:22:48.994990       1 dynamic_cafile_content.go:166] Starting request-header::/var/lib/minikube/certs/front-proxy-ca.crt
I0125 20:22:48.994990       1 dynamic_cafile_content.go:166] Starting client-ca-bundle::/var/lib/minikube/certs/ca.crt
I0125 20:22:48.995282       1 dynamic_serving_content.go:129] Starting serving-cert::/var/lib/minikube/certs/apiserver.crt::/var/lib/minikube/certs/apiserver.key
I0125 20:22:48.995640       1 secure_serving.go:178] Serving securely on [::]:8443
I0125 20:22:48.995668       1 controller.go:81] Starting OpenAPI AggregationController
I0125 20:22:48.995676       1 tlsconfig.go:219] Starting DynamicServingCertificateController
I0125 20:22:48.995728       1 autoregister_controller.go:140] Starting autoregister controller
I0125 20:22:48.995737       1 cache.go:32] Waiting for caches to sync for autoregister controller
I0125 20:22:48.996106       1 crd_finalizer.go:263] Starting CRDFinalizer
I0125 20:22:48.996478       1 apiservice_controller.go:94] Starting APIServiceRegistrationController
I0125 20:22:48.996488       1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
I0125 20:22:48.996498       1 available_controller.go:386] Starting AvailableConditionController
I0125 20:22:48.996501       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
I0125 20:22:48.996682       1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller
I0125 20:22:48.996747       1 shared_informer.go:197] Waiting for caches to sync for cluster_authentication_trust_controller
I0125 20:22:48.996828       1 controller.go:85] Starting OpenAPI controller
I0125 20:22:48.996895       1 customresource_discovery_controller.go:208] Starting DiscoveryController
I0125 20:22:48.996961       1 naming_controller.go:288] Starting NamingConditionController
I0125 20:22:48.997027       1 establishing_controller.go:73] Starting EstablishingController
I0125 20:22:48.997097       1 nonstructuralschema_controller.go:191] Starting NonStructuralSchemaConditionController
I0125 20:22:48.997156       1 apiapproval_controller.go:185] Starting KubernetesAPIApprovalPolicyConformantConditionController
I0125 20:22:48.997228       1 dynamic_cafile_content.go:166] Starting client-ca-bundle::/var/lib/minikube/certs/ca.crt
I0125 20:22:48.997308       1 dynamic_cafile_content.go:166] Starting request-header::/var/lib/minikube/certs/front-proxy-ca.crt
I0125 20:22:48.999015       1 crdregistration_controller.go:111] Starting crd-autoregister controller
I0125 20:22:48.999027       1 shared_informer.go:197] Waiting for caches to sync for crd-autoregister
E0125 20:22:49.020346       1 controller.go:151] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.39.222, ResourceVersion: 0, AdditionalErrorMsg: 
I0125 20:22:49.095941       1 cache.go:39] Caches are synced for autoregister controller
I0125 20:22:49.096689       1 cache.go:39] Caches are synced for AvailableConditionController controller
I0125 20:22:49.096706       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0125 20:22:49.096975       1 shared_informer.go:204] Caches are synced for cluster_authentication_trust_controller 
I0125 20:22:49.099098       1 shared_informer.go:204] Caches are synced for crd-autoregister 
I0125 20:22:49.995072       1 controller.go:107] OpenAPI AggregationController: Processing item 
I0125 20:22:49.995089       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0125 20:22:49.995099       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0125 20:22:49.998946       1 storage_scheduling.go:133] created PriorityClass system-node-critical with value 2000001000
I0125 20:22:50.089363       1 storage_scheduling.go:133] created PriorityClass system-cluster-critical with value 2000000000
I0125 20:22:50.089421       1 storage_scheduling.go:142] all system priority classes are created successfully or already exist.
I0125 20:22:50.745014       1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0125 20:22:50.781246       1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
W0125 20:22:50.842249       1 lease.go:224] Resetting endpoints for master service "kubernetes" to [192.168.39.222]
I0125 20:22:50.843929       1 controller.go:606] quota admission added evaluator for: endpoints
I0125 20:22:51.177147       1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
I0125 20:22:53.720652       1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0125 20:23:02.028120       1 controller.go:606] quota admission added evaluator for: deployments.apps
I0125 20:23:02.030390       1 controller.go:606] quota admission added evaluator for: replicasets.apps
I0125 20:23:02.183024       1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0125 20:23:02.186633       1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps

==> kube-controller-manager ["53f05fb2adc3"] <==
I0125 20:22:59.268273       1 shared_informer.go:197] Waiting for caches to sync for daemon sets
I0125 20:22:59.521193       1 controllermanager.go:533] Started "replicaset"
I0125 20:22:59.521655       1 replica_set.go:180] Starting replicaset controller
I0125 20:22:59.522032       1 shared_informer.go:197] Waiting for caches to sync for ReplicaSet
I0125 20:22:59.770879       1 controllermanager.go:533] Started "persistentvolume-binder"
I0125 20:22:59.770979       1 pv_controller_base.go:294] Starting persistent volume controller
I0125 20:22:59.770993       1 shared_informer.go:197] Waiting for caches to sync for persistent volume
I0125 20:22:59.921676       1 node_lifecycle_controller.go:77] Sending events to api server
E0125 20:22:59.921804       1 core.go:232] failed to start cloud node lifecycle controller: no cloud provider provided
W0125 20:22:59.921833       1 controllermanager.go:525] Skipping "cloud-node-lifecycle"
I0125 20:23:00.170223       1 controllermanager.go:533] Started "pv-protection"
I0125 20:23:00.171220       1 pv_protection_controller.go:81] Starting PV protection controller
I0125 20:23:00.171492       1 shared_informer.go:197] Waiting for caches to sync for PV protection
I0125 20:23:00.172178       1 shared_informer.go:197] Waiting for caches to sync for garbage collector
I0125 20:23:00.182328       1 shared_informer.go:197] Waiting for caches to sync for resource quota
I0125 20:23:00.198599       1 shared_informer.go:204] Caches are synced for HPA 
I0125 20:23:00.217835       1 shared_informer.go:204] Caches are synced for disruption 
I0125 20:23:00.217884       1 disruption.go:338] Sending events to api server.
I0125 20:23:00.220448       1 shared_informer.go:204] Caches are synced for ClusterRoleAggregator 
I0125 20:23:00.220576       1 shared_informer.go:204] Caches are synced for certificate-csrapproving 
I0125 20:23:00.222511       1 shared_informer.go:204] Caches are synced for ReplicaSet 
I0125 20:23:00.223410       1 shared_informer.go:204] Caches are synced for endpoint 
I0125 20:23:00.223442       1 shared_informer.go:204] Caches are synced for bootstrap_signer 
E0125 20:23:00.233468       1 clusterroleaggregation_controller.go:180] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
E0125 20:23:00.235706       1 clusterroleaggregation_controller.go:180] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
I0125 20:23:00.236878       1 shared_informer.go:204] Caches are synced for service account 
I0125 20:23:00.268998       1 shared_informer.go:204] Caches are synced for ReplicationController 
I0125 20:23:00.270421       1 shared_informer.go:204] Caches are synced for certificate-csrsigning 
I0125 20:23:00.271925       1 shared_informer.go:204] Caches are synced for PV protection 
I0125 20:23:00.278962       1 shared_informer.go:204] Caches are synced for namespace 
I0125 20:23:00.280184       1 shared_informer.go:204] Caches are synced for deployment 
I0125 20:23:00.322155       1 shared_informer.go:204] Caches are synced for job 
I0125 20:23:00.632474       1 shared_informer.go:204] Caches are synced for PVC protection 
I0125 20:23:00.661954       1 shared_informer.go:204] Caches are synced for GC 
I0125 20:23:00.668370       1 shared_informer.go:204] Caches are synced for daemon sets 
I0125 20:23:00.668517       1 shared_informer.go:204] Caches are synced for stateful set 
I0125 20:23:00.668696       1 shared_informer.go:204] Caches are synced for TTL 
I0125 20:23:00.671118       1 shared_informer.go:204] Caches are synced for persistent volume 
I0125 20:23:00.671864       1 shared_informer.go:204] Caches are synced for expand 
I0125 20:23:00.672267       1 shared_informer.go:204] Caches are synced for attach detach 
I0125 20:23:00.719689       1 shared_informer.go:204] Caches are synced for taint 
I0125 20:23:00.720067       1 taint_manager.go:186] Starting NoExecuteTaintManager
I0125 20:23:00.772410       1 shared_informer.go:204] Caches are synced for garbage collector 
I0125 20:23:00.772554       1 garbagecollector.go:138] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
I0125 20:23:00.772422       1 shared_informer.go:204] Caches are synced for garbage collector 
I0125 20:23:00.782558       1 shared_informer.go:204] Caches are synced for resource quota 
I0125 20:23:00.787623       1 shared_informer.go:204] Caches are synced for resource quota 
I0125 20:23:02.034951       1 event.go:281] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"tiller-deploy", UID:"25fe4075-857b-4a0b-9667-36804f66e52b", APIVersion:"apps/v1", ResourceVersion:"308", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set tiller-deploy-77855d9dcf to 1
I0125 20:23:02.037964       1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"tiller-deploy-77855d9dcf", UID:"60a0d0d4-171d-4dde-9dc9-f87642839901", APIVersion:"apps/v1", ResourceVersion:"309", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "tiller-deploy-77855d9dcf-" is forbidden: error looking up service account kube-system/tiller: serviceaccount "tiller" not found
E0125 20:23:02.044057       1 replica_set.go:534] sync "kube-system/tiller-deploy-77855d9dcf" failed with pods "tiller-deploy-77855d9dcf-" is forbidden: error looking up service account kube-system/tiller: serviceaccount "tiller" not found
I0125 20:23:02.144270       1 event.go:281] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"nginx-ingress-controller", UID:"f103724e-a327-41b9-8416-f1fc68412563", APIVersion:"apps/v1", ResourceVersion:"331", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set nginx-ingress-controller-6fc5bcc8c9 to 1
I0125 20:23:02.153445       1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"nginx-ingress-controller-6fc5bcc8c9", UID:"188e9eb2-9f1e-4e91-a1dc-6c2951ac33ac", APIVersion:"apps/v1", ResourceVersion:"332", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "nginx-ingress-controller-6fc5bcc8c9-" is forbidden: error looking up service account kube-system/nginx-ingress: serviceaccount "nginx-ingress" not found
E0125 20:23:02.158832       1 replica_set.go:534] sync "kube-system/nginx-ingress-controller-6fc5bcc8c9" failed with pods "nginx-ingress-controller-6fc5bcc8c9-" is forbidden: error looking up service account kube-system/nginx-ingress: serviceaccount "nginx-ingress" not found
I0125 20:23:02.203746       1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicationController", Namespace:"kube-system", Name:"registry", UID:"2d82f435-1ef4-451b-aa43-1a27b8cf72a1", APIVersion:"v1", ResourceVersion:"347", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: registry-kpfgr
I0125 20:23:03.052994       1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"tiller-deploy-77855d9dcf", UID:"60a0d0d4-171d-4dde-9dc9-f87642839901", APIVersion:"apps/v1", ResourceVersion:"313", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: tiller-deploy-77855d9dcf-b5jk4
I0125 20:23:03.176664       1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"nginx-ingress-controller-6fc5bcc8c9", UID:"188e9eb2-9f1e-4e91-a1dc-6c2951ac33ac", APIVersion:"apps/v1", ResourceVersion:"337", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: nginx-ingress-controller-6fc5bcc8c9-xkzrg
I0125 20:23:05.962451       1 event.go:281] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper", UID:"ff9588d4-329a-4500-90f2-8cd671e12a15", APIVersion:"apps/v1", ResourceVersion:"393", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set dashboard-metrics-scraper-7b64584c5c to 1
I0125 20:23:05.974391       1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-7b64584c5c", UID:"b3323848-4fd3-4071-a9cd-8824a3b46fe1", APIVersion:"apps/v1", ResourceVersion:"394", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: dashboard-metrics-scraper-7b64584c5c-cpkd2
I0125 20:23:05.974765       1 event.go:281] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard", UID:"5d5f3776-49c3-4d94-bcb1-187488f48756", APIVersion:"apps/v1", ResourceVersion:"397", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set kubernetes-dashboard-79d9cd965 to 1
I0125 20:23:05.980733       1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-79d9cd965", UID:"12bdc3fd-ba89-4937-961f-092b2450b400", APIVersion:"apps/v1", ResourceVersion:"399", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kubernetes-dashboard-79d9cd965-c5rfb

==> kube-scheduler ["9b2de733da94"] <==
I0125 20:22:51.162530       1 shared_informer.go:204] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
I0125 20:22:51.162694       1 leaderelection.go:242] attempting to acquire leader lease  kube-system/kube-scheduler...
I0125 20:22:51.181585       1 leaderelection.go:252] successfully acquired lease kube-system/kube-scheduler
E0125 20:23:02.121527       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:23:02.121712       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:23:02.136054       1 factory.go:494] pod is already present in unschedulableQ
E0125 20:23:02.209926       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:23:03.166936       1 factory.go:494] pod is already present in the activeQ
E0125 20:23:03.173982       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:23:03.174220       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:23:03.186366       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:23:03.186828       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:23:03.237640       1 factory.go:494] pod is already present in unschedulableQ
E0125 20:23:03.248014       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:23:03.249184       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:23:03.255112       1 factory.go:494] pod is already present in unschedulableQ
E0125 20:23:04.073015       1 scheduler.go:440] Error updating the condition of the pod kube-system/kube-ingress-dns-minikube: Operation cannot be fulfilled on pods "kube-ingress-dns-minikube": the object has been modified; please apply your changes to the latest version and try again
E0125 20:23:04.073068       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:23:04.073563       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:23:05.977750       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:23:05.977960       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:23:05.985318       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:23:05.987240       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:23:05.989409       1 factory.go:494] pod is already present in unschedulableQ
E0125 20:23:05.993088       1 factory.go:494] pod is already present in unschedulableQ
E0125 20:24:19.062545       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:24:19.063056       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:24:19.063531       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:24:19.064054       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:24:19.064584       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:24:19.065749       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:24:19.067228       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:25:49.063722       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:25:49.064263       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:25:49.064967       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:25:49.065412       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:25:49.065697       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:25:49.065973       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:25:49.067407       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:27:19.064761       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:27:19.065234       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:27:19.065875       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:27:19.067250       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:27:19.068126       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:27:19.070881       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:27:19.071240       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:28:49.065691       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:28:49.065872       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:28:49.066062       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:28:49.066286       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:28:49.067098       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:28:49.067465       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:28:49.067677       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:30:19.066676       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:30:19.067058       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:30:19.067321       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:30:19.067572       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:30:19.067789       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:30:19.068607       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods
E0125 20:30:19.068958       1 scheduler.go:638] error selecting node for pod: no nodes available to schedule pods

==> kubelet <==
-- Logs begin at Sat 2020-01-25 20:21:56 UTC, end at Sat 2020-01-25 20:31:06 UTC. --
Jan 25 20:31:02 minikube kubelet[17985]: E0125 20:31:02.872827   17985 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: pods is forbidden: User "system:node:minikube" cannot list resource "pods" in API group "" at the cluster scope
Jan 25 20:31:02 minikube kubelet[17985]: E0125 20:31:02.873450   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:02 minikube kubelet[17985]: E0125 20:31:02.973689   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:03 minikube kubelet[17985]: I0125 20:31:03.057597   17985 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach
Jan 25 20:31:03 minikube kubelet[17985]: E0125 20:31:03.073345   17985 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/kubelet.go:458: Failed to list *v1.Node: nodes "minikube" is forbidden: User "system:node:minikube" cannot list resource "nodes" in API group "" at the cluster scope
Jan 25 20:31:03 minikube kubelet[17985]: E0125 20:31:03.073905   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:03 minikube kubelet[17985]: I0125 20:31:03.090675   17985 kubelet_node_status.go:70] Attempting to register node minikube
Jan 25 20:31:03 minikube kubelet[17985]: E0125 20:31:03.174283   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:03 minikube kubelet[17985]: E0125 20:31:03.257449   17985 kubelet_node_status.go:92] Unable to register node "minikube" with API server: nodes is forbidden: User "system:node:minikube" cannot create resource "nodes" in API group "" at the cluster scope
Jan 25 20:31:03 minikube kubelet[17985]: E0125 20:31:03.274694   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:03 minikube kubelet[17985]: E0125 20:31:03.374989   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:03 minikube kubelet[17985]: E0125 20:31:03.457495   17985 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/kubelet.go:449: Failed to list *v1.Service: services is forbidden: User "system:node:minikube" cannot list resource "services" in API group "" at the cluster scope
Jan 25 20:31:03 minikube kubelet[17985]: E0125 20:31:03.475332   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:03 minikube kubelet[17985]: E0125 20:31:03.575610   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:03 minikube kubelet[17985]: E0125 20:31:03.657457   17985 reflector.go:156] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:node:minikube" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
Jan 25 20:31:03 minikube kubelet[17985]: E0125 20:31:03.675969   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:03 minikube kubelet[17985]: E0125 20:31:03.776390   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:03 minikube kubelet[17985]: E0125 20:31:03.857417   17985 reflector.go:156] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User "system:node:minikube" cannot list resource "runtimeclasses" in API group "node.k8s.io" at the cluster scope
Jan 25 20:31:03 minikube kubelet[17985]: E0125 20:31:03.877254   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:03 minikube kubelet[17985]: E0125 20:31:03.977652   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:04 minikube kubelet[17985]: E0125 20:31:04.057961   17985 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: pods is forbidden: User "system:node:minikube" cannot list resource "pods" in API group "" at the cluster scope
Jan 25 20:31:04 minikube kubelet[17985]: E0125 20:31:04.078123   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:04 minikube kubelet[17985]: E0125 20:31:04.178521   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:04 minikube kubelet[17985]: E0125 20:31:04.257410   17985 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/kubelet.go:458: Failed to list *v1.Node: nodes "minikube" is forbidden: User "system:node:minikube" cannot list resource "nodes" in API group "" at the cluster scope
Jan 25 20:31:04 minikube kubelet[17985]: E0125 20:31:04.279031   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:04 minikube kubelet[17985]: E0125 20:31:04.379889   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:04 minikube kubelet[17985]: E0125 20:31:04.460374   17985 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/kubelet.go:449: Failed to list *v1.Service: services is forbidden: User "system:node:minikube" cannot list resource "services" in API group "" at the cluster scope
Jan 25 20:31:04 minikube kubelet[17985]: E0125 20:31:04.480550   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:04 minikube kubelet[17985]: E0125 20:31:04.580895   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:04 minikube kubelet[17985]: E0125 20:31:04.661146   17985 reflector.go:156] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:node:minikube" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
Jan 25 20:31:04 minikube kubelet[17985]: E0125 20:31:04.681454   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:04 minikube kubelet[17985]: E0125 20:31:04.781910   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:04 minikube kubelet[17985]: E0125 20:31:04.859362   17985 reflector.go:156] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User "system:node:minikube" cannot list resource "runtimeclasses" in API group "node.k8s.io" at the cluster scope
Jan 25 20:31:04 minikube kubelet[17985]: E0125 20:31:04.882385   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:04 minikube kubelet[17985]: E0125 20:31:04.982739   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.060602   17985 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: pods is forbidden: User "system:node:minikube" cannot list resource "pods" in API group "" at the cluster scope
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.082978   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.183424   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.260385   17985 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/kubelet.go:458: Failed to list *v1.Node: nodes "minikube" is forbidden: User "system:node:minikube" cannot list resource "nodes" in API group "" at the cluster scope
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.283720   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.383996   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.463780   17985 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/kubelet.go:449: Failed to list *v1.Service: services is forbidden: User "system:node:minikube" cannot list resource "services" in API group "" at the cluster scope
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.484429   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.585004   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.685308   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.717070   17985 reflector.go:156] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:node:minikube" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.785473   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.862450   17985 reflector.go:156] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User "system:node:minikube" cannot list resource "runtimeclasses" in API group "node.k8s.io" at the cluster scope
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.885782   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.915527   17985 controller.go:135] failed to ensure node lease exists, will retry in 7s, error: leases.coordination.k8s.io "minikube" is forbidden: User "system:node:minikube" cannot get resource "leases" in API group "coordination.k8s.io" in the namespace "kube-node-lease"
Jan 25 20:31:05 minikube kubelet[17985]: E0125 20:31:05.986013   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:06 minikube kubelet[17985]: E0125 20:31:06.061699   17985 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: pods is forbidden: User "system:node:minikube" cannot list resource "pods" in API group "" at the cluster scope
Jan 25 20:31:06 minikube kubelet[17985]: E0125 20:31:06.086285   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:06 minikube kubelet[17985]: E0125 20:31:06.186530   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:06 minikube kubelet[17985]: E0125 20:31:06.261508   17985 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/kubelet.go:458: Failed to list *v1.Node: nodes "minikube" is forbidden: User "system:node:minikube" cannot list resource "nodes" in API group "" at the cluster scope
Jan 25 20:31:06 minikube kubelet[17985]: E0125 20:31:06.286693   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:06 minikube kubelet[17985]: E0125 20:31:06.386822   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:06 minikube kubelet[17985]: E0125 20:31:06.465386   17985 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/kubelet.go:449: Failed to list *v1.Service: services is forbidden: User "system:node:minikube" cannot list resource "services" in API group "" at the cluster scope
Jan 25 20:31:06 minikube kubelet[17985]: E0125 20:31:06.486972   17985 kubelet.go:2263] node "minikube" not found
Jan 25 20:31:06 minikube kubelet[17985]: E0125 20:31:06.587154   17985 kubelet.go:2263] node "minikube" not found
toor@suey:~$

The operating system version:

toor@suey:~$ cat /etc/debian_version 
kali-rolling
toor@suey:~$ uname -a
Linux suey.nknwn.local 5.4.0-kali2-amd64 #1 SMP Debian 5.4.8-1kali1 (2020-01-06) x86_64 GNU/Linux
toor@suey:~$
priyawadhwa commented 4 years ago

Hey @a1exus thank you for submitting this issue. Could you please upgrade to the latest version of minikube, and try running:

minikube delete
minikube start --vm-driver kvm2 --cpus 4 --memory 10240 --disk-size=500000 --extra-config=apiserver.authorization-mode=RBAC,Node

This issue seems to be a dupe of #6061, and using that minikube start command with k8s version v1.17.0 seems to have resolved it.

tstromberg commented 4 years ago

I'm closing this issue as it hasn't seen activity in awhile, and it's unclear if this issue still exists. If this issue does continue to exist in the most recent release of minikube, please feel free to re-open it.

Thank you for opening the issue!