search

kubernetes / minikube

Run Kubernetes locally
https://minikube.sigs.k8s.io/
Apache License 2.0
29.6k stars 4.89k forks source link

Random localkube crashes throughout the day #1839

Closed eecue closed 7 years ago

eecue commented 7 years ago

BUG REPORT

Environment: Minikube version v0.21.0

What happened:

Minikube randomly stops working throughout the day. This is happening to everyone on my team. When you run minikube status you see minikube: Running and localkube: Stopped. There is nothing in the logs that would indicate why it happens, and no solid path to reproduce. I have run minikube with verbose logging and didn't see any pattern before or after the crash. I'll do the same and post what I see here as a follow up.

What you expected to happen:

localkube keeps running

How to reproduce it (as minimally and precisely as possible):

No clear path, run a cluster and do dev work for the day.

Output of minikube logs (if applicable):

Here's the standard logs from my crash sometime last night:

Aug 18 04:12:00 minikube localkube[3610]: W0818 04:12:00.615461 3610 helpers.go:771] eviction manager: no observation found for eviction signal allocatableNodeFs.available

Connection to 127.0.0.1 closed by remote host. 2017/08/18 07:34:48 Error getting machine logs: error ssh shell: exit status 255

Here are the last 5 seconds logs from before the localkube crash this morning, note that I was running ab against a bunch of our different services to provide some load, but the crash sometimes happens without any load on the system:

Aug 18 15:30:00 minikube localkube[3336]: W0818 15:30:00.210155 3336 helpers.go:771] eviction manager: no observation found for eviction signal allocatableNodeFs.available Aug 18 15:30:00 minikube localkube[3336]: I0818 15:30:00.210326 3336 eviction_manager.go:324] eviction manager: no resources are starved Aug 18 15:30:00 minikube localkube[3336]: I0818 15:30:00.986625 3336 generic.go:182] GenericPLEG: Relisting Aug 18 15:30:01 minikube localkube[3336]: I0818 15:30:01.051549 3336 kubelet.go:2133] Container runtime status: Runtime Conditions: RuntimeReady=true reason: message:, NetworkReady=true reason: message: Aug 18 15:30:01 minikube localkube[3336]: I0818 15:30:01.819271 3336 handler.go:160] kube-aggregator: GET "/api/v1/namespaces/kube-system/endpoints/kube-scheduler" satisfied by nonGoRestful Aug 18 15:30:01 minikube localkube[3336]: I0818 15:30:01.819664 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/endpoints/kube-scheduler" satisfied by prefix /api/ Aug 18 15:30:01 minikube localkube[3336]: I0818 15:30:01.819899 3336 handler.go:150] kube-apiserver: GET "/api/v1/namespaces/kube-system/endpoints/kube-scheduler" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:01 minikube localkube[3336]: I0818 15:30:01.821627 3336 wrap.go:42] GET /api/v1/namespaces/kube-system/endpoints/kube-scheduler: (2.373229ms) 200 [[localkube/v1.7.0 (linux/amd64) kubernetes/d3ada01/leader-election] 127.0.0.1:57806] Aug 18 15:30:01 minikube localkube[3336]: I0818 15:30:01.822272 3336 handler.go:160] kube-aggregator: PUT "/api/v1/namespaces/kube-system/endpoints/kube-scheduler" satisfied by nonGoRestful Aug 18 15:30:01 minikube localkube[3336]: I0818 15:30:01.822428 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/endpoints/kube-scheduler" satisfied by prefix /api/ Aug 18 15:30:01 minikube localkube[3336]: I0818 15:30:01.822607 3336 handler.go:150] kube-apiserver: PUT "/api/v1/namespaces/kube-system/endpoints/kube-scheduler" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:01 minikube localkube[3336]: I0818 15:30:01.825523 3336 wrap.go:42] PUT /api/v1/namespaces/kube-system/endpoints/kube-scheduler: (3.266118ms) 200 [[localkube/v1.7.0 (linux/amd64) kubernetes/d3ada01/leader-election] 127.0.0.1:57806] Aug 18 15:30:01 minikube localkube[3336]: I0818 15:30:01.826383 3336 config.go:141] Calling handler.OnEndpointsUpdate Aug 18 15:30:01 minikube localkube[3336]: I0818 15:30:01.826749 3336 graph_builder.go:471] GraphBuilder process object: v1/Endpoints, namespace kube-system, name kube-scheduler, uid 51b88482-83b6-11e7-9920-080027a2b9a1, event type update Aug 18 15:30:01 minikube localkube[3336]: I0818 15:30:01.827285 3336 leaderelection.go:204] successfully renewed lease kube-system/kube-scheduler Aug 18 15:30:01 minikube localkube[3336]: I0818 15:30:01.892614 3336 kubelet.go:1954] SyncLoop (housekeeping) Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.000738 3336 generic.go:182] GenericPLEG: Relisting Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.018924 3336 handler.go:160] kube-aggregator: GET "/api/v1/namespaces/kube-system/endpoints/kube-controller-manager" satisfied by nonGoRestful Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.019163 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/endpoints/kube-controller-manager" satisfied by prefix /api/ Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.019346 3336 handler.go:150] kube-apiserver: GET "/api/v1/namespaces/kube-system/endpoints/kube-controller-manager" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.028691 3336 wrap.go:42] GET /api/v1/namespaces/kube-system/endpoints/kube-controller-manager: (9.770131ms) 200 [[localkube/v1.7.0 (linux/amd64) kubernetes/d3ada01/leader-election] 127.0.0.1:57806] Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.029977 3336 handler.go:160] kube-aggregator: PUT "/api/v1/namespaces/kube-system/endpoints/kube-controller-manager" satisfied by nonGoRestful Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.032107 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/endpoints/kube-controller-manager" satisfied by prefix /api/ Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.032347 3336 handler.go:150] kube-apiserver: PUT "/api/v1/namespaces/kube-system/endpoints/kube-controller-manager" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.066113 3336 config.go:141] Calling handler.OnEndpointsUpdate Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.074982 3336 graph_builder.go:471] GraphBuilder process object: v1/Endpoints, namespace kube-system, name kube-controller-manager, uid 509badd6-83b6-11e7-9920-080027a2b9a1, event type update Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.076618 3336 wrap.go:42] PUT /api/v1/namespaces/kube-system/endpoints/kube-controller-manager: (46.65703ms) 200 [[localkube/v1.7.0 (linux/amd64) kubernetes/d3ada01/leader-election] 127.0.0.1:57806] Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.076958 3336 leaderelection.go:204] successfully renewed lease kube-system/kube-controller-manager Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.895084 3336 prober.go:160] HTTP-Probe Host: http://172.17.0.2, Port: 9090, Path: / Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.895329 3336 prober.go:163] HTTP-Probe Headers: map[] Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.905608 3336 http.go:87] Probe succeeded for http://172.17.0.2:9090/, Response: {200 OK 200 HTTP/1.1 1 1 map[Content-Type:[text/html; charset=utf-8] Date:[Fri, 18 Aug 2017 15:30:02 GMT] Cache-Control:[no-store] Accept-Ranges:[bytes] Last-Modified:[Tue, 16 May 2017 12:53:01 GMT]] 0xc42d54f000 -1 [] true true map[] 0xc4284bc800 } Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.905904 3336 prober.go:113] Liveness probe for "kubernetes-dashboard-g1v7z_kube-system(5a2c09f8-83b6-11e7-9920-080027a2b9a1):kubernetes-dashboard" succeeded Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.907207 3336 prober.go:160] HTTP-Probe Host: http://172.17.0.5, Port: 10054, Path: /metrics Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.907297 3336 prober.go:163] HTTP-Probe Headers: map[] Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.907239 3336 prober.go:160] HTTP-Probe Host: http://172.17.0.5, Port: 10054, Path: /healthcheck/dnsmasq Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.907750 3336 prober.go:163] HTTP-Probe Headers: map[] Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.907207 3336 prober.go:160] HTTP-Probe Host: http://172.17.0.5, Port: 10054, Path: /healthcheck/kubedns Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.908098 3336 prober.go:163] HTTP-Probe Headers: map[] Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.907222 3336 prober.go:160] HTTP-Probe Host: http://172.17.0.5, Port: 8081, Path: /readiness Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.908552 3336 prober.go:163] HTTP-Probe Headers: map[] Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.908713 3336 prober.go:160] HTTP-Probe Host: http://172.17.0.3, Port: 10254, Path: /healthz Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.908887 3336 prober.go:163] HTTP-Probe Headers: map[] Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.908727 3336 prober.go:160] HTTP-Probe Host: http://172.17.0.6, Port: 8080, Path: /healthz Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.909086 3336 prober.go:163] HTTP-Probe Headers: map[] Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.908740 3336 prober.go:160] HTTP-Probe Host: http://172.17.0.3, Port: 10254, Path: /healthz Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.909253 3336 prober.go:163] HTTP-Probe Headers: map[] Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.910423 3336 http.go:87] Probe succeeded for http://172.17.0.6:8080/healthz, Response: {200 OK 200 HTTP/1.1 1 1 map[Date:[Fri, 18 Aug 2017 15:30:02 GMT] Content-Length:[2] Content-Type:[text/plain; charset=utf-8]] 0xc4289f1220 2 [] true false map[] 0xc4284bd100 } Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.910475 3336 prober.go:113] Liveness probe for "default-http-backend-jkmfq_kube-system(5a98819a-83b6-11e7-9920-080027a2b9a1):default-http-backend" succeeded Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.911315 3336 http.go:87] Probe succeeded for http://172.17.0.5:8081/readiness, Response: {200 OK 200 HTTP/1.1 1 1 map[Content-Type:[text/plain; charset=utf-8] Date:[Fri, 18 Aug 2017 15:30:02 GMT] Content-Length:[3]] 0xc4289f13e0 3 [] true false map[] 0xc430bf9200 } Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.911377 3336 prober.go:113] Readiness probe for "kube-dns-910330662-pcfns_kube-system(5ad411b5-83b6-11e7-9920-080027a2b9a1):kubedns" succeeded Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.912602 3336 http.go:87] Probe succeeded for http://172.17.0.3:10254/healthz, Response: {200 OK 200 HTTP/1.1 1 1 map[Date:[Fri, 18 Aug 2017 15:30:02 GMT] Content-Length:[2] Content-Type:[text/plain; charset=utf-8]] 0xc4289e6920 2 [] true false map[] 0xc4284bcf00 } Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.912872 3336 prober.go:113] Liveness probe for "nginx-ingress-controller-glf1g_kube-system(5ab095c3-83b6-11e7-9920-080027a2b9a1):nginx-ingress-controller" succeeded Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.913133 3336 http.go:87] Probe succeeded for http://172.17.0.5:10054/healthcheck/dnsmasq, Response: {200 OK 200 HTTP/1.1 1 1 map[Content-Type:[application/json] Date:[Fri, 18 Aug 2017 15:30:02 GMT] Content-Length:[51]] 0xc4289f15e0 51 [] true false map[] 0xc430bf8f00 } Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.913334 3336 prober.go:113] Liveness probe for "kube-dns-910330662-pcfns_kube-system(5ad411b5-83b6-11e7-9920-080027a2b9a1):dnsmasq" succeeded Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.913583 3336 http.go:87] Probe succeeded for http://172.17.0.5:10054/healthcheck/kubedns, Response: {200 OK 200 HTTP/1.1 1 1 map[Content-Type:[application/json] Date:[Fri, 18 Aug 2017 15:30:02 GMT] Content-Length:[51]] 0xc4289f1760 51 [] true false map[] 0xc4284bcc00 } Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.913765 3336 prober.go:113] Liveness probe for "kube-dns-910330662-pcfns_kube-system(5ad411b5-83b6-11e7-9920-080027a2b9a1):kubedns" succeeded Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.919056 3336 http.go:87] Probe succeeded for http://172.17.0.3:10254/healthz, Response: {200 OK 200 HTTP/1.1 1 1 map[Content-Type:[text/plain; charset=utf-8] Date:[Fri, 18 Aug 2017 15:30:02 GMT] Content-Length:[2]] 0xc4289f18c0 2 [] true false map[] 0xc4284bd300 } Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.919201 3336 prober.go:113] Readiness probe for "nginx-ingress-controller-glf1g_kube-system(5ab095c3-83b6-11e7-9920-080027a2b9a1):nginx-ingress-controller" succeeded Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.927301 3336 http.go:87] Probe succeeded for http://172.17.0.5:10054/metrics, Response: {200 OK 200 HTTP/1.1 1 1 map[Date:[Fri, 18 Aug 2017 15:30:02 GMT] Content-Type:[text/plain; version=0.0.4]] 0xc4289f1aa0 -1 [] true true map[] 0xc4284bca00 } Aug 18 15:30:02 minikube localkube[3336]: I0818 15:30:02.927454 3336 prober.go:113] Liveness probe for "kube-dns-910330662-pcfns_kube-system(5ad411b5-83b6-11e7-9920-080027a2b9a1):sidecar" succeeded Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.091786 3336 generic.go:182] GenericPLEG: Relisting Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.341229 3336 wrap.go:42] GET /api/v1/persistentvolumes?resourceVersion=12410&timeoutSeconds=482&watch=true: (8m2.00053497s) 200 [[localkube/v1.7.0 (linux/amd64) kubernetes/d3ada01] 127.0.0.1:47228] Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.341791 3336 reflector.go:405] k8s.io/minikube/vendor/github.com/r2d4/external-storage/lib/controller/controller.go:255: Watch close - *v1.PersistentVolume total 0 items received Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.342067 3336 handler.go:160] kube-aggregator: GET "/api/v1/persistentvolumes" satisfied by nonGoRestful Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.342089 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/persistentvolumes" satisfied by prefix /api/ Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.342132 3336 handler.go:150] kube-apiserver: GET "/api/v1/persistentvolumes" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.342311 3336 rest.go:349] Starting watch for /api/v1/persistentvolumes, rv=12410 labels= fields= timeout=8m22s Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.828114 3336 handler.go:160] kube-aggregator: GET "/api/v1/namespaces/kube-system/endpoints/kube-scheduler" satisfied by nonGoRestful Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.828141 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/endpoints/kube-scheduler" satisfied by prefix /api/ Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.828184 3336 handler.go:150] kube-apiserver: GET "/api/v1/namespaces/kube-system/endpoints/kube-scheduler" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.828917 3336 wrap.go:42] GET /api/v1/namespaces/kube-system/endpoints/kube-scheduler: (824.552µs) 200 [[localkube/v1.7.0 (linux/amd64) kubernetes/d3ada01/leader-election] 127.0.0.1:57806] Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.829606 3336 handler.go:160] kube-aggregator: PUT "/api/v1/namespaces/kube-system/endpoints/kube-scheduler" satisfied by nonGoRestful Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.829628 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/endpoints/kube-scheduler" satisfied by prefix /api/ Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.829646 3336 handler.go:150] kube-apiserver: PUT "/api/v1/namespaces/kube-system/endpoints/kube-scheduler" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.831860 3336 wrap.go:42] PUT /api/v1/namespaces/kube-system/endpoints/kube-scheduler: (2.26252ms) 200 [[localkube/v1.7.0 (linux/amd64) kubernetes/d3ada01/leader-election] 127.0.0.1:57806] Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.831963 3336 leaderelection.go:204] successfully renewed lease kube-system/kube-scheduler Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.832077 3336 config.go:141] Calling handler.OnEndpointsUpdate Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.832131 3336 graph_builder.go:471] GraphBuilder process object: v1/Endpoints, namespace kube-system, name kube-scheduler, uid 51b88482-83b6-11e7-9920-080027a2b9a1, event type update Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.833019 3336 handler.go:160] kube-aggregator: GET "/api/v1/services" satisfied by nonGoRestful Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.833042 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/services" satisfied by prefix /api/ Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.833048 3336 handler.go:150] kube-apiserver: GET "/api/v1/services" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.834261 3336 wrap.go:42] GET /api/v1/services: (1.260978ms) 200 [[localkube/v1.7.0 (linux/amd64) kubernetes/d3ada01] 127.0.0.1:52176] Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.836059 3336 handler.go:160] kube-aggregator: GET "/api/v1/services" satisfied by nonGoRestful Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.836082 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/services" satisfied by prefix /api/ Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.836091 3336 handler.go:150] kube-apiserver: GET "/api/v1/services" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.837167 3336 wrap.go:42] GET /api/v1/services: (1.125981ms) 200 [[localkube/v1.7.0 (linux/amd64) kubernetes/d3ada01] 127.0.0.1:52176] Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.892901 3336 kubelet.go:1954] SyncLoop (housekeeping) Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.984663 3336 handler.go:160] kube-aggregator: GET "/api/v1/namespaces/kube-system" satisfied by nonGoRestful Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.984749 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system" satisfied by prefix /api/ Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.984760 3336 handler.go:150] kube-apiserver: GET "/api/v1/namespaces/kube-system" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.985379 3336 wrap.go:42] GET /api/v1/namespaces/kube-system: (757.323µs) 200 [[localkube/v1.7.0 (linux/amd64) kubernetes/d3ada01] 127.0.0.1:52176] Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.986191 3336 handler.go:160] kube-aggregator: GET "/api/v1/namespaces/kube-public" satisfied by nonGoRestful Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.986214 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-public" satisfied by prefix /api/ Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.986221 3336 handler.go:150] kube-apiserver: GET "/api/v1/namespaces/kube-public" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:03 minikube localkube[3336]: I0818 15:30:03.986733 3336 wrap.go:42] GET /api/v1/namespaces/kube-public: (563.329µs) 200 [[localkube/v1.7.0 (linux/amd64) kubernetes/d3ada01] 127.0.0.1:52176] Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.073104 3336 handler.go:160] kube-aggregator: GET "/api/v1/namespaces/kube-system/configmaps/ingress-controller-leader-nginx" satisfied by nonGoRestful Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.073181 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/ingress-controller-leader-nginx" satisfied by prefix /api/ Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.073194 3336 handler.go:150] kube-apiserver: GET "/api/v1/namespaces/kube-system/configmaps/ingress-controller-leader-nginx" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.073914 3336 wrap.go:42] GET /api/v1/namespaces/kube-system/configmaps/ingress-controller-leader-nginx: (2.206128ms) 200 [[nginx-ingress-controller/v0.0.0 (linux/amd64) kubernetes/$Format] 172.17.0.3:32952] Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.076760 3336 handler.go:160] kube-aggregator: PUT "/api/v1/namespaces/kube-system/configmaps/ingress-controller-leader-nginx" satisfied by nonGoRestful Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.076845 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/configmaps/ingress-controller-leader-nginx" satisfied by prefix /api/ Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.076855 3336 handler.go:150] kube-apiserver: PUT "/api/v1/namespaces/kube-system/configmaps/ingress-controller-leader-nginx" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.077936 3336 handler.go:160] kube-aggregator: GET "/api/v1/namespaces/kube-system/endpoints/kube-controller-manager" satisfied by nonGoRestful Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.078006 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/endpoints/kube-controller-manager" satisfied by prefix /api/ Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.078028 3336 handler.go:150] kube-apiserver: GET "/api/v1/namespaces/kube-system/endpoints/kube-controller-manager" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.078772 3336 wrap.go:42] GET /api/v1/namespaces/kube-system/endpoints/kube-controller-manager: (849.257µs) 200 [[localkube/v1.7.0 (linux/amd64) kubernetes/d3ada01/leader-election] 127.0.0.1:57806] Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.079588 3336 handler.go:160] kube-aggregator: PUT "/api/v1/namespaces/kube-system/endpoints/kube-controller-manager" satisfied by nonGoRestful Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.079676 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/endpoints/kube-controller-manager" satisfied by prefix /api/ Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.079697 3336 handler.go:150] kube-apiserver: PUT "/api/v1/namespaces/kube-system/endpoints/kube-controller-manager" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.082102 3336 wrap.go:42] PUT /api/v1/namespaces/kube-system/configmaps/ingress-controller-leader-nginx: (6.6274ms) 200 [[nginx-ingress-controller/v0.0.0 (linux/amd64) kubernetes/$Format] 172.17.0.3:32952] Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.082543 3336 graph_builder.go:471] GraphBuilder process object: v1/ConfigMap, namespace kube-system, name ingress-controller-leader-nginx, uid 6ca0122a-83b6-11e7-9920-080027a2b9a1, event type update Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.086724 3336 wrap.go:42] PUT /api/v1/namespaces/kube-system/endpoints/kube-controller-manager: (6.973965ms) 200 [[localkube/v1.7.0 (linux/amd64) kubernetes/d3ada01/leader-election] 127.0.0.1:57806] Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.086901 3336 leaderelection.go:204] successfully renewed lease kube-system/kube-controller-manager Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.087452 3336 graph_builder.go:471] GraphBuilder process object: v1/Endpoints, namespace kube-system, name kube-controller-manager, uid 509badd6-83b6-11e7-9920-080027a2b9a1, event type update Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.087815 3336 config.go:141] Calling handler.OnEndpointsUpdate Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.121221 3336 generic.go:182] GenericPLEG: Relisting Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.892750 3336 kubelet.go:1931] SyncLoop (SYNC): 1 pods; kubernetes-dashboard-g1v7z_kube-system(5a2c09f8-83b6-11e7-9920-080027a2b9a1) Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.892840 3336 kubelet_pods.go:1187] Generating status for "kubernetes-dashboard-g1v7z_kube-system(5a2c09f8-83b6-11e7-9920-080027a2b9a1)" Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.893113 3336 status_manager.go:325] Ignoring same status for pod "kubernetes-dashboard-g1v7z_kube-system(5a2c09f8-83b6-11e7-9920-080027a2b9a1)", status: {Phase:Running Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2017-08-18 01:41:27 +0000 UTC Reason: Message:} {Type:Ready Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2017-08-18 14:36:14 +0000 UTC Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2017-08-18 01:41:27 +0000 UTC Reason: Message:}] Message: Reason: HostIP:192.168.99.100 PodIP:172.17.0.2 StartTime:2017-08-18 01:41:27 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:kubernetes-dashboard State:{Waiting:nil Running:&ContainerStateRunning{StartedAt:2017-08-18 14:36:14 +0000 UTC,} Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2017-08-18 02:45:17 +0000 UTC,FinishedAt:2017-08-18 04:12:49 +0000 UTC,ContainerID:docker://b21b27c3626c9156e86314f30c1b735b9b81673513bb5c706da9cbdaad0de365,}} Ready:true RestartCount:2 Image:gcr.io/google_containers/kubernetes-dashboard-amd64:v1.6.1 ImageID:docker-pullable://gcr.io/google_containers/kubernetes-dashboard-amd64@sha256:b537ce8988510607e95b8d40ac9824523b1f9029e6f9f90e9fccc663c355cf5d ContainerID:docker://855f3c30fefb966473b429fda6a58608bb21baddc77f9869186cf7306f11af3d}] QOSClass:BestEffort} Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.893326 3336 volume_manager.go:340] Waiting for volumes to attach and mount for pod "kubernetes-dashboard-g1v7z_kube-system(5a2c09f8-83b6-11e7-9920-080027a2b9a1)" Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.962104 3336 reconciler.go:259] operationExecutor.MountVolume started for volume "default-token-62ggj" (UniqueName: "kubernetes.io/secret/5a2c09f8-83b6-11e7-9920-080027a2b9a1-default-token-62ggj") pod "kubernetes-dashboard-g1v7z" (UID: "5a2c09f8-83b6-11e7-9920-080027a2b9a1") Volume is already mounted to pod, but remount was requested. Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.962484 3336 secret.go:186] Setting up volume default-token-62ggj for pod 5a2c09f8-83b6-11e7-9920-080027a2b9a1 at /var/lib/kubelet/pods/5a2c09f8-83b6-11e7-9920-080027a2b9a1/volumes/kubernetes.io~secret/default-token-62ggj Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.963285 3336 handler.go:160] kube-aggregator: GET "/api/v1/namespaces/kube-system/secrets/default-token-62ggj" satisfied by nonGoRestful Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.963492 3336 pathrecorder.go:247] kube-aggregator: "/api/v1/namespaces/kube-system/secrets/default-token-62ggj" satisfied by prefix /api/ Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.963647 3336 handler.go:150] kube-apiserver: GET "/api/v1/namespaces/kube-system/secrets/default-token-62ggj" satisfied by gorestful with webservice /api/v1 Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.964177 3336 wrap.go:42] GET /api/v1/namespaces/kube-system/secrets/default-token-62ggj?resourceVersion=0: (993.163µs) 200 [[localkube/v1.7.0 (linux/amd64) kubernetes/d3ada01] 127.0.0.1:57806] Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.964763 3336 secret.go:217] Received secret kube-system/default-token-62ggj containing (3) pieces of data, 1933 total bytes Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.964887 3336 atomic_writer.go:333] /var/lib/kubelet/pods/5a2c09f8-83b6-11e7-9920-080027a2b9a1/volumes/kubernetes.io~secret/default-token-62ggj: current paths: [ca.crt namespace token] Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.964897 3336 atomic_writer.go:345] /var/lib/kubelet/pods/5a2c09f8-83b6-11e7-9920-080027a2b9a1/volumes/kubernetes.io~secret/default-token-62ggj: new paths: [ca.crt namespace token] Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.964902 3336 atomic_writer.go:348] /var/lib/kubelet/pods/5a2c09f8-83b6-11e7-9920-080027a2b9a1/volumes/kubernetes.io~secret/default-token-62ggj: paths to remove: map[] Aug 18 15:30:04 minikube localkube[3336]: I0818 15:30:04.964943 3336 atomic_writer.go:142] pod kube-system/kubernetes-dashboard-g1v7z volume default-token-62ggj: no update required for target directory /var/lib/kubelet/pods/5a2c09f8-83b6-11e7-9920-080027a2b9a1/volumes/kubernetes.io~secret/default-token-62ggj Aug 18 15:30:05 minikube localkube[3336]: I0818 15:30:05.020856 3336 server.go:782] POST /stats/container/: (12.981171ms) 200 [[Go-http-client/1.1] 172.17.0.4:57574] Aug 18 15:30:05 minikube localkube[3336]: I0818 15:30:05.073110 3336 handler.go:160] kube-aggregator: GET "/apis/extensions/v1beta1/thirdpartyresources" satisfied by nonGoRestful Aug 18 15:30:05 minikube localkube[3336]: I0818 15:30:05.073140 3336 pathrecorder.go:247] kube-aggregator: "/apis/extensions/v1beta1/thirdpartyresources" satisfied by prefix /apis/extensions/v1beta1/ Aug 18 15:30:05 minikube localkube[3336]: I0818 15:30:05.073149 3336 handler.go:150] kube-apiserver: GET "/apis/extensions/v1beta1/thirdpartyresources" satisfied by gorestful with webservice /apis/extensions/v1beta1 Aug 18 15:30:05 minikube localkube[3336]: I0818 15:30:05.073808 3336 wrap.go:42] GET /apis/extensions/v1beta1/thirdpartyresources: (722.585µs) 200 [[localkube/v1.7.0 (linux/amd64) kubernetes/d3ada01] 127.0.0.1:52176] Aug 18 15:30:05 minikube localkube[3336]: I0818 15:30:05.193760 3336 volume_manager.go:369] All volumes are attached and mounted for pod "kubernetes-dashboard-g1v7z_kube-system(5a2c09f8-83b6-11e7-9920-080027a2b9a1)" Aug 18 15:30:05 minikube localkube[3336]: I0818 15:30:05.193795 3336 kuberuntime_manager.go:428] Syncing Pod "kubernetes-dashboard-g1v7z_kube-system(5a2c09f8-83b6-11e7-9920-080027a2b9a1)": &Pod{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:kubernetes-dashboard-g1v7z,GenerateName:kubernetes-dashboard-,Namespace:kube-system,SelfLink:/api/v1/namespaces/kube-system/pods/kubernetes-dashboard-g1v7z,UID:5a2c09f8-83b6-11e7-9920-080027a2b9a1,ResourceVersion:5518,Generation:0,CreationTimestamp:2017-08-18 01:41:27 +0000 UTC,DeletionTimestamp:,DeletionGracePeriodSeconds:nil,Labels:map[string]string{addonmanager.kubernetes.io/mode: Reconcile,app: kubernetes-dashboard,version: v1.6.1,},Annotations:map[string]string{kubernetes.io/config.seen: 2017-08-18T14:36:07.659020679Z,kubernetes.io/config.source: api,kubernetes.io/created-by: {"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicationController","namespace":"kube-system","name":"kubernetes-dashboard","uid":"5a2af32a-83b6-11e7-9920-080027a2b9a1","apiVersion":"v1","resourceVersion":"126"}} Aug 18 15:30:05 minikube localkube[3336]: ,},OwnerReferences:[{v1 ReplicationController kubernetes-dashboard 5a2af32a-83b6-11e7-9920-080027a2b9a1 0xc42457c168 0xc42457c169}],Finalizers:[],ClusterName:,Initializers:nil,},Spec:PodSpec{Volumes:[{default-token-62ggj {nil nil nil nil nil SecretVolumeSource{SecretName:default-token-62ggj,Items:[],DefaultMode:420,Optional:nil,} nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil nil}}],Containers:[{kubernetes-dashboard gcr.io/google_containers/kubernetes-dashboard-amd64:v1.6.1 [] [] [{ 0 9090 TCP }] [] [] {map[] map[]} [{default-token-62ggj true /var/run/secrets/kubernetes.io/serviceaccount }] Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/,Port:9090,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:30,TimeoutSeconds:30,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} nil nil /dev/termination-log File IfNotPresent nil false false false}],RestartPolicy:Always,TerminationGracePeriodSeconds:30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:minikube,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,},ImagePullSecrets:[],Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[],AutomountServiceAccountToken:nil,Tolerations:[],HostAliases:[],},Status:PodStatus{Phase:Running,Conditions:[{Initialized True 0001-01-01 00:00:00 +0000 UTC 2017-08-18 01:41:27 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2017-08-18 14:36:14 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2017-08-18 01:41:27 +0000 UTC }],Message:,Reason:,HostIP:192.168.99.100,PodIP:172.17.0.2,StartTime:2017-08-18 01:41:27 +0000 UTC,ContainerStatuses:[{kubernetes-dashboard {nil ContainerStateRunning{StartedAt:2017-08-18 14:36:14 +0000 UTC,} nil} {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message Aug 18 15:30:05 minikube localkube[3336]: :,StartedAt:2017-08-18 02:45:17 +0000 UTC,FinishedAt:2017-08-18 04:12:49 +0000 UTC,ContainerID:docker://b21b27c3626c9156e86314f30c1b735b9b81673513bb5c706da9cbdaad0de365,}} true 2 gcr.io/google_containers/kubernetes-dashboard-amd64:v1.6.1 docker-pullable://gcr.io/google_containers/kubernetes-dashboard-amd64@sha256:b537ce8988510607e95b8d40ac9824523b1f9029e6f9f90e9fccc663c355cf5d docker://855f3c30fefb966473b429fda6a58608bb21baddc77f9869186cf7306f11af3d}],QOSClass:BestEffort,InitContainerStatuses:[],},} Aug 18 15:30:05 minikube localkube[3336]: I0818 15:30:05.194145 3336 kuberuntime_manager.go:548] computePodContainerChanges got {CreateSandbox:false SandboxID:e276021a8d433918f56e9dc6e276866b80c049c508a91b2a09d229f875872a4b Attempt:2 ContainersToStart:map[] ContainersToKeep:map[{Type:docker ID:855f3c30fefb966473b429fda6a58608bb21baddc77f9869186cf7306f11af3d}:0] ContainersToKill:map[] InitFailed:false InitContainersToKeep:map[]} for pod "kubernetes-dashboard-g1v7z_kube-system(5a2c09f8-83b6-11e7-9920-080027a2b9a1)" Aug 18 15:30:05 minikube localkube[3336]: I0818 15:30:05.214783 3336 generic.go:182] GenericPLEG: Relisting Aug 18 15:30:05 minikube localkube[3336]: I0818 15:30:05.522053 3336 handler.go:160] kube-aggregator: GET "/api/v1/nodes/minikube" satisfied by nonGoRestful

Connection to 127.0.0.1 closed by remote host. 2017/08/18 08:38:18 Error getting machine logs: error ssh shell: exit status 255

$ minikube status minikube: Running localkube: Stopped kubectl: Correctly Configured: pointing to minikube-vm at 192.168.99.100

Anything else do we need to know:

I love minikube. So great to have our entire production environment duplicated for local development.

Multiply commented 7 years ago

I'm seeing this problem as well. I can ssh into the VM, but minikube logs is empty. Docker is running, but none of the containers are.

mrkevinham commented 7 years ago

Same here. My minikube keeps crashing throughout the day and I have to keep rebooting it to work.

eecue commented 7 years ago

This seems to have been fixed by using NFS peristentVolumes instead of 9p. An added bonus for doing this: https://github.com/kubernetes/minikube/issues/1889

dlorenc commented 7 years ago

Closing as you figured out the issue. I'm a big +1 on the NFS proposal.

Multiply commented 7 years ago

@dlorenc Has this been addressed somewhere? Using default settings seems to still crash.

srfrnk commented 6 years ago

Still happens... See logs below. Hangs for a few minutes then everything back to normal.

-- Logs begin at Tue 2018-09-25 12:00:34 UTC, end at Tue 2018-09-25 13:51:26 UTC. --
Sep 25 12:00:47 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Sep 25 12:00:47 minikube kubelet[2276]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 25 12:00:47 minikube kubelet[2276]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 25 12:00:47 minikube kubelet[2276]: Flag --cadvisor-port has been deprecated, The default will change to 0 (disabled) in 1.12, and the cadvisor port will be removed entirely in 1.13
Sep 25 12:00:47 minikube kubelet[2276]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 25 12:00:47 minikube kubelet[2276]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 25 12:00:47 minikube kubelet[2276]: Flag --allow-privileged has been deprecated, will be removed in a future version
Sep 25 12:00:47 minikube kubelet[2276]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 25 12:00:47 minikube kubelet[2276]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 25 12:00:47 minikube kubelet[2276]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 25 12:00:47 minikube kubelet[2276]: I0925 12:00:47.204119    2276 feature_gate.go:226] feature gates: &{{} map[]}
Sep 25 12:00:47 minikube kubelet[2276]: W0925 12:00:47.795468    2276 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
Sep 25 12:00:47 minikube kubelet[2276]: I0925 12:00:47.795532    2276 server.go:376] Version: v1.10.0
Sep 25 12:00:47 minikube kubelet[2276]: I0925 12:00:47.795584    2276 feature_gate.go:226] feature gates: &{{} map[]}
Sep 25 12:00:47 minikube kubelet[2276]: I0925 12:00:47.795660    2276 plugins.go:89] No cloud provider specified.
Sep 25 12:00:47 minikube kubelet[2276]: F0925 12:00:47.795702    2276 server.go:233] failed to run Kubelet: unable to load bootstrap kubeconfig: stat /etc/kubernetes/bootstrap-kubelet.conf: no such file or directory
Sep 25 12:00:47 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
Sep 25 12:00:47 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
Sep 25 12:00:58 minikube systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
Sep 25 12:00:58 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1.
Sep 25 12:00:58 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Sep 25 12:00:58 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Sep 25 12:00:58 minikube kubelet[2352]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 25 12:00:58 minikube kubelet[2352]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 25 12:00:58 minikube kubelet[2352]: Flag --cadvisor-port has been deprecated, The default will change to 0 (disabled) in 1.12, and the cadvisor port will be removed entirely in 1.13
Sep 25 12:00:58 minikube kubelet[2352]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 25 12:00:58 minikube kubelet[2352]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 25 12:00:58 minikube kubelet[2352]: Flag --allow-privileged has been deprecated, will be removed in a future version
Sep 25 12:00:58 minikube kubelet[2352]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 25 12:00:58 minikube kubelet[2352]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 25 12:00:58 minikube kubelet[2352]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.049747    2352 feature_gate.go:226] feature gates: &{{} map[]}
Sep 25 12:00:58 minikube kubelet[2352]: W0925 12:00:58.056056    2352 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.056094    2352 server.go:376] Version: v1.10.0
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.056120    2352 feature_gate.go:226] feature gates: &{{} map[]}
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.056171    2352 plugins.go:89] No cloud provider specified.
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.070773    2352 server.go:613] --cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.070943    2352 container_manager_linux.go:242] container manager verified user specified cgroup-root exists: /
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.070958    2352 container_manager_linux.go:247] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:docker CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>} {Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.15} GracePeriod:0s MinReclaim:<nil>}]} ExperimentalQOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s ExperimentalPodPidsLimit:-1 EnforceCPULimits:true}
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.071041    2352 container_manager_linux.go:266] Creating device plugin manager: true
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.071112    2352 state_mem.go:36] [cpumanager] initializing new in-memory state store
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.071168    2352 state_file.go:82] [cpumanager] state file: created new state file "/var/lib/kubelet/cpu_manager_state"
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.071211    2352 kubelet.go:272] Adding pod path: /etc/kubernetes/manifests
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.071230    2352 kubelet.go:297] Watching apiserver
Sep 25 12:00:58 minikube kubelet[2352]: E0925 12:00:58.072828    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:00:58 minikube kubelet[2352]: E0925 12:00:58.072873    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:00:58 minikube kubelet[2352]: E0925 12:00:58.072897    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:00:58 minikube kubelet[2352]: W0925 12:00:58.073087    2352 kubelet_network.go:139] Hairpin mode set to "promiscuous-bridge" but kubenet is not enabled, falling back to "hairpin-veth"
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.073106    2352 kubelet.go:556] Hairpin mode set to "hairpin-veth"
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.073792    2352 client.go:75] Connecting to docker on unix:///var/run/docker.sock
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.073934    2352 client.go:104] Start docker client with request timeout=2m0s
Sep 25 12:00:58 minikube kubelet[2352]: W0925 12:00:58.076318    2352 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.076970    2352 docker_service.go:244] Docker cri networking managed by kubernetes.io/no-op
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.081123    2352 docker_service.go:249] Docker Info: &{ID:FJLZ:BZMU:HVI7:DQWY:MAT2:7X3M:CEO5:6MD7:SDYX:OQY4:3PTY:ZHSU Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:0 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:[] Plugins:{Volume:[local] Network:[bridge host macvlan null overlay] Authorization:[] Log:[awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6tables:true Debug:false NFd:23 OomKillDisable:true NGoroutines:35 SystemTime:2018-09-25T12:00:58.077628576Z LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.15.0 OperatingSystem:Buildroot 2018.05 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:0xc420ca2070 NCPU:2 MemTotal:1988902912 GenericResources:[] DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:minikube Labels:[provider=kvm2] ExperimentalBuild:false ServerVersion:17.12.1-ce ClusterStore: ClusterAdvertise: Runtimes:map[runc:{Path:docker-runc Args:[]}] DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:[] Nodes:0 Managers:0 Cluster:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9b55aab90508bd389d7654c4baf173a981477d55 Expected:9b55aab90508bd389d7654c4baf173a981477d55} RuncCommit:{ID:9f9c96235cc97674e935002fc3d78361b696a69e Expected:9f9c96235cc97674e935002fc3d78361b696a69e} InitCommit:{ID:N/A Expected:} SecurityOptions:[name=seccomp,profile=default]}
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.081196    2352 docker_service.go:262] Setting cgroupDriver to cgroupfs
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.087808    2352 remote_runtime.go:43] Connecting to runtime service unix:///var/run/dockershim.sock
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.101367    2352 kuberuntime_manager.go:186] Container runtime docker initialized, version: 17.12.1-ce, apiVersion: 1.35.0
Sep 25 12:00:58 minikube kubelet[2352]: W0925 12:00:58.101524    2352 probe.go:215] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating.
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.101643    2352 csi_plugin.go:61] kubernetes.io/csi: plugin initializing...
Sep 25 12:00:58 minikube kubelet[2352]: E0925 12:00:58.108167    2352 kubelet.go:1277] Image garbage collection failed once. Stats initialization may not have completed yet: failed to get imageFs info: unable to find data for container /
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.108560    2352 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.108606    2352 status_manager.go:140] Starting to sync pod status with apiserver
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.108632    2352 kubelet.go:1777] Starting kubelet main sync loop.
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.108660    2352 kubelet.go:1794] skipping pod synchronization - [container runtime is down PLEG is not healthy: pleg was last seen active 2562047h47m16.854775807s ago; threshold is 3m0s]
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.108750    2352 server.go:129] Starting to listen on 0.0.0.0:10250
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.109125    2352 server.go:299] Adding debug handlers to kubelet server.
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.109784    2352 volume_manager.go:247] Starting Kubelet Volume Manager
Sep 25 12:00:58 minikube kubelet[2352]: E0925 12:00:58.112604    2352 event.go:209] Unable to write event: 'Post https://localhost:8443/api/v1/namespaces/default/events: dial tcp 127.0.0.1:8443: getsockopt: connection refused' (may retry after sleeping)
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.116136    2352 server.go:944] Started kubelet
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.116221    2352 desired_state_of_world_populator.go:129] Desired state populator starts to run
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.208972    2352 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.210372    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.219264    2352 kubelet_node_status.go:82] Attempting to register node minikube
Sep 25 12:00:58 minikube kubelet[2352]: E0925 12:00:58.220465    2352 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.409417    2352 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.421066    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.426813    2352 kubelet_node_status.go:82] Attempting to register node minikube
Sep 25 12:00:58 minikube kubelet[2352]: E0925 12:00:58.427935    2352 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.809895    2352 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.828303    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:00:58 minikube kubelet[2352]: I0925 12:00:58.833303    2352 kubelet_node_status.go:82] Attempting to register node minikube
Sep 25 12:00:58 minikube kubelet[2352]: E0925 12:00:58.833948    2352 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:00:59 minikube kubelet[2352]: E0925 12:00:59.074008    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:00:59 minikube kubelet[2352]: E0925 12:00:59.075603    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:00:59 minikube kubelet[2352]: E0925 12:00:59.077154    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:00:59 minikube kubelet[2352]: I0925 12:00:59.610175    2352 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
Sep 25 12:00:59 minikube kubelet[2352]: I0925 12:00:59.634202    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:00:59 minikube kubelet[2352]: I0925 12:00:59.638063    2352 kubelet_node_status.go:82] Attempting to register node minikube
Sep 25 12:00:59 minikube kubelet[2352]: E0925 12:00:59.638661    2352 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:00 minikube kubelet[2352]: E0925 12:01:00.075232    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:00 minikube kubelet[2352]: E0925 12:01:00.077482    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:00 minikube kubelet[2352]: E0925 12:01:00.078545    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:00 minikube kubelet[2352]: I0925 12:01:00.212142    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:00 minikube kubelet[2352]: I0925 12:01:00.213418    2352 cpu_manager.go:155] [cpumanager] starting with none policy
Sep 25 12:01:00 minikube kubelet[2352]: I0925 12:01:00.213462    2352 cpu_manager.go:156] [cpumanager] reconciling every 10s
Sep 25 12:01:00 minikube kubelet[2352]: I0925 12:01:00.213504    2352 policy_none.go:42] [cpumanager] none policy: Start
Sep 25 12:01:00 minikube kubelet[2352]: Starting Device Plugin manager
Sep 25 12:01:00 minikube kubelet[2352]: E0925 12:01:00.221278    2352 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found
Sep 25 12:01:01 minikube kubelet[2352]: E0925 12:01:01.077863    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:01 minikube kubelet[2352]: E0925 12:01:01.079331    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:01 minikube kubelet[2352]: E0925 12:01:01.079591    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.210739    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.224513    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "k8s-certs" (UniqueName: "kubernetes.io/host-path/f95139897976f5cdaccd4d20cad1cd20-k8s-certs") pod "kube-apiserver-minikube" (UID: "f95139897976f5cdaccd4d20cad1cd20")
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.224704    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs" (UniqueName: "kubernetes.io/host-path/f95139897976f5cdaccd4d20cad1cd20-ca-certs") pod "kube-apiserver-minikube" (UID: "f95139897976f5cdaccd4d20cad1cd20")
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.239027    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.240272    2352 kubelet_node_status.go:82] Attempting to register node minikube
Sep 25 12:01:01 minikube kubelet[2352]: E0925 12:01:01.240509    2352 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.324479    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.324596    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:01 minikube kubelet[2352]: W0925 12:01:01.339209    2352 status_manager.go:461] Failed to get status for pod "kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.344541    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.351425    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:01 minikube kubelet[2352]: W0925 12:01:01.370720    2352 status_manager.go:461] Failed to get status for pod "kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.370991    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.371728    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.378725    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.379315    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.391591    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:01 minikube kubelet[2352]: W0925 12:01:01.397371    2352 status_manager.go:461] Failed to get status for pod "kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:01 minikube kubelet[2352]: W0925 12:01:01.399517    2352 status_manager.go:461] Failed to get status for pod "kube-addon-manager-minikube_kube-system(3afaf06535cc3b85be93c31632b765da)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-addon-manager-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:01 minikube kubelet[2352]: W0925 12:01:01.399884    2352 status_manager.go:461] Failed to get status for pod "etcd-minikube_kube-system(6d5a9a3d910e32775d80cc0b490aa6d4)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/etcd-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.425491    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "addons" (UniqueName: "kubernetes.io/host-path/3afaf06535cc3b85be93c31632b765da-addons") pod "kube-addon-manager-minikube" (UID: "3afaf06535cc3b85be93c31632b765da")
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.425582    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "etcd-data" (UniqueName: "kubernetes.io/host-path/6d5a9a3d910e32775d80cc0b490aa6d4-etcd-data") pod "etcd-minikube" (UID: "6d5a9a3d910e32775d80cc0b490aa6d4")
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.425685    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "etcd-certs" (UniqueName: "kubernetes.io/host-path/6d5a9a3d910e32775d80cc0b490aa6d4-etcd-certs") pod "etcd-minikube" (UID: "6d5a9a3d910e32775d80cc0b490aa6d4")
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.425779    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "k8s-certs" (UniqueName: "kubernetes.io/host-path/d983b689a33fabc72d2e575ce92ad03e-k8s-certs") pod "kube-controller-manager-minikube" (UID: "d983b689a33fabc72d2e575ce92ad03e")
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.425876    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs" (UniqueName: "kubernetes.io/host-path/d983b689a33fabc72d2e575ce92ad03e-ca-certs") pod "kube-controller-manager-minikube" (UID: "d983b689a33fabc72d2e575ce92ad03e")
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.425965    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/31cf0ccbee286239d451edb6fb511513-kubeconfig") pod "kube-scheduler-minikube" (UID: "31cf0ccbee286239d451edb6fb511513")
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.426065    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/3afaf06535cc3b85be93c31632b765da-kubeconfig") pod "kube-addon-manager-minikube" (UID: "3afaf06535cc3b85be93c31632b765da")
Sep 25 12:01:01 minikube kubelet[2352]: I0925 12:01:01.426185    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/d983b689a33fabc72d2e575ce92ad03e-kubeconfig") pod "kube-controller-manager-minikube" (UID: "d983b689a33fabc72d2e575ce92ad03e")
Sep 25 12:01:02 minikube kubelet[2352]: E0925 12:01:02.080382    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:02 minikube kubelet[2352]: E0925 12:01:02.081664    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:02 minikube kubelet[2352]: E0925 12:01:02.082600    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:02 minikube kubelet[2352]: E0925 12:01:02.175555    2352 event.go:209] Unable to write event: 'Post https://localhost:8443/api/v1/namespaces/default/events: dial tcp 127.0.0.1:8443: getsockopt: connection refused' (may retry after sleeping)
Sep 25 12:01:03 minikube kubelet[2352]: E0925 12:01:03.081406    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:03 minikube kubelet[2352]: E0925 12:01:03.082585    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:03 minikube kubelet[2352]: E0925 12:01:03.083278    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:04 minikube kubelet[2352]: E0925 12:01:04.082587    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:04 minikube kubelet[2352]: E0925 12:01:04.085624    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:04 minikube kubelet[2352]: E0925 12:01:04.085624    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:04 minikube kubelet[2352]: I0925 12:01:04.440699    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:04 minikube kubelet[2352]: I0925 12:01:04.442780    2352 kubelet_node_status.go:82] Attempting to register node minikube
Sep 25 12:01:04 minikube kubelet[2352]: E0925 12:01:04.443169    2352 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:05 minikube kubelet[2352]: E0925 12:01:05.083838    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:05 minikube kubelet[2352]: E0925 12:01:05.086860    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:05 minikube kubelet[2352]: E0925 12:01:05.088050    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:06 minikube kubelet[2352]: E0925 12:01:06.084993    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:06 minikube kubelet[2352]: E0925 12:01:06.088249    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:06 minikube kubelet[2352]: E0925 12:01:06.089382    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:07 minikube kubelet[2352]: E0925 12:01:07.086283    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:07 minikube kubelet[2352]: E0925 12:01:07.089662    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:07 minikube kubelet[2352]: E0925 12:01:07.090622    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:08 minikube kubelet[2352]: E0925 12:01:08.087530    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:08 minikube kubelet[2352]: E0925 12:01:08.090825    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:08 minikube kubelet[2352]: E0925 12:01:08.091983    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:09 minikube kubelet[2352]: E0925 12:01:09.089338    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:09 minikube kubelet[2352]: E0925 12:01:09.092921    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:09 minikube kubelet[2352]: E0925 12:01:09.094278    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:10 minikube kubelet[2352]: E0925 12:01:10.090796    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:10 minikube kubelet[2352]: E0925 12:01:10.093867    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:10 minikube kubelet[2352]: E0925 12:01:10.095723    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:10 minikube kubelet[2352]: E0925 12:01:10.221593    2352 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found
Sep 25 12:01:10 minikube kubelet[2352]: I0925 12:01:10.843307    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:10 minikube kubelet[2352]: I0925 12:01:10.846265    2352 kubelet_node_status.go:82] Attempting to register node minikube
Sep 25 12:01:10 minikube kubelet[2352]: E0925 12:01:10.846829    2352 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:11 minikube kubelet[2352]: E0925 12:01:11.093029    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:11 minikube kubelet[2352]: E0925 12:01:11.094960    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:11 minikube kubelet[2352]: E0925 12:01:11.097218    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:11 minikube kubelet[2352]: I0925 12:01:11.276699    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:11 minikube kubelet[2352]: W0925 12:01:11.283856    2352 status_manager.go:461] Failed to get status for pod "kube-addon-manager-minikube_kube-system(3afaf06535cc3b85be93c31632b765da)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-addon-manager-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:12 minikube kubelet[2352]: E0925 12:01:12.094427    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:12 minikube kubelet[2352]: E0925 12:01:12.096917    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:12 minikube kubelet[2352]: E0925 12:01:12.098328    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:12 minikube kubelet[2352]: E0925 12:01:12.176880    2352 event.go:209] Unable to write event: 'Post https://localhost:8443/api/v1/namespaces/default/events: dial tcp 127.0.0.1:8443: getsockopt: connection refused' (may retry after sleeping)
Sep 25 12:01:12 minikube kubelet[2352]: I0925 12:01:12.290287    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:13 minikube kubelet[2352]: E0925 12:01:13.096850    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:13 minikube kubelet[2352]: E0925 12:01:13.098565    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:13 minikube kubelet[2352]: E0925 12:01:13.100230    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:14 minikube kubelet[2352]: E0925 12:01:14.098040    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:14 minikube kubelet[2352]: E0925 12:01:14.099631    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:14 minikube kubelet[2352]: E0925 12:01:14.100982    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:15 minikube kubelet[2352]: E0925 12:01:15.100736    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:15 minikube kubelet[2352]: E0925 12:01:15.102252    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:15 minikube kubelet[2352]: E0925 12:01:15.103646    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:16 minikube kubelet[2352]: E0925 12:01:16.103771    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:16 minikube kubelet[2352]: E0925 12:01:16.104952    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:16 minikube kubelet[2352]: E0925 12:01:16.106332    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:16 minikube kubelet[2352]: I0925 12:01:16.340822    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:16 minikube kubelet[2352]: W0925 12:01:16.341939    2352 status_manager.go:461] Failed to get status for pod "kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:17 minikube kubelet[2352]: E0925 12:01:17.104835    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:17 minikube kubelet[2352]: E0925 12:01:17.106810    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:17 minikube kubelet[2352]: E0925 12:01:17.107837    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:17 minikube kubelet[2352]: I0925 12:01:17.343137    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:17 minikube kubelet[2352]: I0925 12:01:17.847193    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:17 minikube kubelet[2352]: I0925 12:01:17.854368    2352 kubelet_node_status.go:82] Attempting to register node minikube
Sep 25 12:01:17 minikube kubelet[2352]: E0925 12:01:17.855459    2352 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:18 minikube kubelet[2352]: E0925 12:01:18.108759    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:18 minikube kubelet[2352]: E0925 12:01:18.109142    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:18 minikube kubelet[2352]: E0925 12:01:18.109691    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:19 minikube kubelet[2352]: E0925 12:01:19.117573    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:19 minikube kubelet[2352]: E0925 12:01:19.117969    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:19 minikube kubelet[2352]: E0925 12:01:19.118021    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:20 minikube kubelet[2352]: E0925 12:01:20.117924    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:20 minikube kubelet[2352]: E0925 12:01:20.120459    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:20 minikube kubelet[2352]: E0925 12:01:20.120516    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:20 minikube kubelet[2352]: E0925 12:01:20.239639    2352 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found
Sep 25 12:01:21 minikube kubelet[2352]: E0925 12:01:21.118232    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:21 minikube kubelet[2352]: E0925 12:01:21.120751    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:21 minikube kubelet[2352]: E0925 12:01:21.122796    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:22 minikube kubelet[2352]: E0925 12:01:22.119519    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:22 minikube kubelet[2352]: E0925 12:01:22.121806    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:22 minikube kubelet[2352]: E0925 12:01:22.123702    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 12:01:22 minikube kubelet[2352]: E0925 12:01:22.178487    2352 event.go:209] Unable to write event: 'Post https://localhost:8443/api/v1/namespaces/default/events: dial tcp 127.0.0.1:8443: getsockopt: connection refused' (may retry after sleeping)
Sep 25 12:01:23 minikube kubelet[2352]: I0925 12:01:23.381240    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:24 minikube kubelet[2352]: I0925 12:01:24.383658    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:24 minikube kubelet[2352]: I0925 12:01:24.855641    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:24 minikube kubelet[2352]: I0925 12:01:24.856910    2352 kubelet_node_status.go:82] Attempting to register node minikube
Sep 25 12:01:30 minikube kubelet[2352]: E0925 12:01:30.249269    2352 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found
Sep 25 12:01:33 minikube kubelet[2352]: I0925 12:01:33.599949    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:33 minikube kubelet[2352]: E0925 12:01:33.613399    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dabbcae9f3", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"Starting", Message:"Starting kubelet.", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8668a5f3, ext:95781874, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8668a5f3, ext:95781874, loc:(*time.Location)(0x5b98020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:33 minikube kubelet[2352]: E0925 12:01:33.668801    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac2721180", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node minikube status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d0fcd80, ext:207399894, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d0fcd80, ext:207399894, loc:(*time.Location)(0x5b98020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:33 minikube kubelet[2352]: I0925 12:01:33.671300    2352 reconciler.go:154] Reconciler: start to sync state
Sep 25 12:01:33 minikube kubelet[2352]: E0925 12:01:33.729474    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac2727c77", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d103877, ext:207427273, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d103877, ext:207427273, loc:(*time.Location)(0x5b98020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:33 minikube kubelet[2352]: E0925 12:01:33.789909    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac272d815", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d109415, ext:207450730, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d109415, ext:207450730, loc:(*time.Location)(0x5b98020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:33 minikube kubelet[2352]: E0925 12:01:33.851641    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac273355e", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d10f15e, ext:207474606, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d10f15e, ext:207474606, loc:(*time.Location)(0x5b98020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:33 minikube kubelet[2352]: E0925 12:01:33.918471    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac2727c77", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d103877, ext:207427273, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be996f6f73, ext:414993866, loc:(*time.Location)(0x5b98020)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:33 minikube kubelet[2352]: E0925 12:01:33.976310    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac2721180", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node minikube status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d0fcd80, ext:207399894, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be996f3821, ext:414979703, loc:(*time.Location)(0x5b98020)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:34 minikube kubelet[2352]: E0925 12:01:34.043056    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac272d815", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d109415, ext:207450730, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be9970082e, ext:415032965, loc:(*time.Location)(0x5b98020)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:34 minikube kubelet[2352]: E0925 12:01:34.107588    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac273355e", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d10f15e, ext:207474606, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be99702b93, ext:415042021, loc:(*time.Location)(0x5b98020)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:34 minikube kubelet[2352]: E0925 12:01:34.466898    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac2721180", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node minikube status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d0fcd80, ext:207399894, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6beb1aa42ea, ext:821502271, loc:(*time.Location)(0x5b98020)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:34 minikube kubelet[2352]: I0925 12:01:34.602415    2352 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Sep 25 12:01:34 minikube kubelet[2352]: E0925 12:01:34.872735    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac2727c77", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d103877, ext:207427273, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6beb1aa78ac, ext:821516034, loc:(*time.Location)(0x5b98020)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:35 minikube kubelet[2352]: E0925 12:01:35.275319    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac272d815", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d109415, ext:207450730, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6beb1aa9869, ext:821524158, loc:(*time.Location)(0x5b98020)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:35 minikube kubelet[2352]: E0925 12:01:35.669075    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac273355e", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d10f15e, ext:207474606, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6beb1aab3a4, ext:821531131, loc:(*time.Location)(0x5b98020)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:36 minikube kubelet[2352]: E0925 12:01:36.067706    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac2721180", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node minikube status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d0fcd80, ext:207399894, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6bee60765d9, ext:1626279441, loc:(*time.Location)(0x5b98020)}}, Count:4, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:36 minikube kubelet[2352]: E0925 12:01:36.465421    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac2727c77", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d103877, ext:207427273, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6bee6078971, ext:1626288546, loc:(*time.Location)(0x5b98020)}}, Count:4, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:36 minikube kubelet[2352]: E0925 12:01:36.866248    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac272d815", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d109415, ext:207450730, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6bee607a054, ext:1626294406, loc:(*time.Location)(0x5b98020)}}, Count:4, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:37 minikube kubelet[2352]: E0925 12:01:37.265593    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1557a2dac273355e", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6be8d10f15e, ext:207474606, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2a6bee607b524, ext:1626299733, loc:(*time.Location)(0x5b98020)}}, Count:4, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Sep 25 12:01:38 minikube kubelet[2352]: I0925 12:01:38.074901    2352 kubelet_node_status.go:85] Successfully registered node minikube
Sep 25 12:01:38 minikube kubelet[2352]: E0925 12:01:38.637783    2352 remote_runtime.go:278] ContainerStatus "b77a4b5801cd7e270299ee2276c5c5f5f62557fe211b9bd7ffa8813e2ff2b9a5" from runtime service failed: rpc error: code = Unknown desc = Error: No such container: b77a4b5801cd7e270299ee2276c5c5f5f62557fe211b9bd7ffa8813e2ff2b9a5
Sep 25 12:01:38 minikube kubelet[2352]: E0925 12:01:38.637839    2352 kuberuntime_container.go:385] ContainerStatus for b77a4b5801cd7e270299ee2276c5c5f5f62557fe211b9bd7ffa8813e2ff2b9a5 error: rpc error: code = Unknown desc = Error: No such container: b77a4b5801cd7e270299ee2276c5c5f5f62557fe211b9bd7ffa8813e2ff2b9a5
Sep 25 12:01:38 minikube kubelet[2352]: E0925 12:01:38.637850    2352 kuberuntime_manager.go:873] getPodContainerStatuses for pod "kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)" failed: rpc error: code = Unknown desc = Error: No such container: b77a4b5801cd7e270299ee2276c5c5f5f62557fe211b9bd7ffa8813e2ff2b9a5
Sep 25 12:01:38 minikube kubelet[2352]: E0925 12:01:38.637865    2352 generic.go:241] PLEG: Ignoring events for pod kube-controller-manager-minikube/kube-system: rpc error: code = Unknown desc = Error: No such container: b77a4b5801cd7e270299ee2276c5c5f5f62557fe211b9bd7ffa8813e2ff2b9a5
Sep 25 12:01:51 minikube kubelet[2352]: I0925 12:01:51.198062    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-proxy" (UniqueName: "kubernetes.io/configmap/c979849d-c0ba-11e8-9240-242a6da44cca-kube-proxy") pod "kube-proxy-bl47m" (UID: "c979849d-c0ba-11e8-9240-242a6da44cca")
Sep 25 12:01:51 minikube kubelet[2352]: I0925 12:01:51.198110    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-dns-token-jgxf6" (UniqueName: "kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6") pod "kube-dns-86f4d74b45-f42gd" (UID: "c97cc72e-c0ba-11e8-9240-242a6da44cca")
Sep 25 12:01:51 minikube kubelet[2352]: I0925 12:01:51.198127    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-proxy-token-mz589" (UniqueName: "kubernetes.io/secret/c979849d-c0ba-11e8-9240-242a6da44cca-kube-proxy-token-mz589") pod "kube-proxy-bl47m" (UID: "c979849d-c0ba-11e8-9240-242a6da44cca")
Sep 25 12:01:51 minikube kubelet[2352]: I0925 12:01:51.198137    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "xtables-lock" (UniqueName: "kubernetes.io/host-path/c979849d-c0ba-11e8-9240-242a6da44cca-xtables-lock") pod "kube-proxy-bl47m" (UID: "c979849d-c0ba-11e8-9240-242a6da44cca")
Sep 25 12:01:51 minikube kubelet[2352]: I0925 12:01:51.198150    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "lib-modules" (UniqueName: "kubernetes.io/host-path/c979849d-c0ba-11e8-9240-242a6da44cca-lib-modules") pod "kube-proxy-bl47m" (UID: "c979849d-c0ba-11e8-9240-242a6da44cca")
Sep 25 12:01:51 minikube kubelet[2352]: I0925 12:01:51.198161    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-dns-config" (UniqueName: "kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config") pod "kube-dns-86f4d74b45-f42gd" (UID: "c97cc72e-c0ba-11e8-9240-242a6da44cca")
Sep 25 12:01:51 minikube kubelet[2352]: W0925 12:01:51.767564    2352 pod_container_deletor.go:77] Container "e98b2e07441434d901b1ee2344ae75e911d83c16d41c0e1ee4e016e85bff2ef1" not found in pod's containers
Sep 25 12:01:51 minikube kubelet[2352]: W0925 12:01:51.845405    2352 pod_container_deletor.go:77] Container "86b974d47653700f6ecf1981854cce85ad9c5735f33969dcdb7c31d75a5cba81" not found in pod's containers
Sep 25 12:01:53 minikube kubelet[2352]: I0925 12:01:53.304378    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "default-token-n6wzf" (UniqueName: "kubernetes.io/secret/cab3df8f-c0ba-11e8-9240-242a6da44cca-default-token-n6wzf") pod "kubernetes-dashboard-5498ccf677-mplc7" (UID: "cab3df8f-c0ba-11e8-9240-242a6da44cca")
Sep 25 12:01:53 minikube kubelet[2352]: W0925 12:01:53.968042    2352 pod_container_deletor.go:77] Container "dd8b9831f887f90dc65a5e1ccabec2c56f1333811c23e4503e20153ba7c969ae" not found in pod's containers
Sep 25 12:01:54 minikube kubelet[2352]: I0925 12:01:54.408462    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "tmp" (UniqueName: "kubernetes.io/host-path/cb5d9db7-c0ba-11e8-9240-242a6da44cca-tmp") pod "storage-provisioner" (UID: "cb5d9db7-c0ba-11e8-9240-242a6da44cca")
Sep 25 12:01:54 minikube kubelet[2352]: I0925 12:01:54.408769    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "storage-provisioner-token-dvrkz" (UniqueName: "kubernetes.io/secret/cb5d9db7-c0ba-11e8-9240-242a6da44cca-storage-provisioner-token-dvrkz") pod "storage-provisioner" (UID: "cb5d9db7-c0ba-11e8-9240-242a6da44cca")
Sep 25 12:01:55 minikube kubelet[2352]: W0925 12:01:55.094554    2352 pod_container_deletor.go:77] Container "a7994292bc07816832954a88a258e1f97a9b81350843694df8e9355095de7761" not found in pod's containers
Sep 25 12:05:59 minikube kubelet[2352]: I0925 12:05:59.399693    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "zookeeper-configs" (UniqueName: "kubernetes.io/empty-dir/5d61c29c-c0bb-11e8-9240-242a6da44cca-zookeeper-configs") pod "zookeeper-0" (UID: "5d61c29c-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:05:59 minikube kubelet[2352]: I0925 12:05:59.399882    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "zookeeper-configmap" (UniqueName: "kubernetes.io/configmap/5d61c29c-c0bb-11e8-9240-242a6da44cca-zookeeper-configmap") pod "zookeeper-0" (UID: "5d61c29c-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:05:59 minikube kubelet[2352]: I0925 12:05:59.399985    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "default-token-rlxcj" (UniqueName: "kubernetes.io/secret/5d61c29c-c0bb-11e8-9240-242a6da44cca-default-token-rlxcj") pod "zookeeper-0" (UID: "5d61c29c-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:05:59 minikube kubelet[2352]: I0925 12:05:59.400132    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "zookeeper-data" (UniqueName: "kubernetes.io/empty-dir/5d61c29c-c0bb-11e8-9240-242a6da44cca-zookeeper-data") pod "zookeeper-0" (UID: "5d61c29c-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:05:59 minikube kubelet[2352]: W0925 12:05:59.536237    2352 container.go:406] Failed to get RecentStats("/system.slice/run-r7c0d303cf55144c0bb609d16f27cd9c5.scope") while determining the next housekeeping: unable to find data for container /system.slice/run-r7c0d303cf55144c0bb609d16f27cd9c5.scope
Sep 25 12:06:00 minikube kubelet[2352]: W0925 12:06:00.132541    2352 pod_container_deletor.go:77] Container "c6fbea34de7863a9c47778caff340eab2f60de3d81a2ee70bd2d3a8d5ee59f26" not found in pod's containers
Sep 25 12:06:07 minikube kubelet[2352]: I0925 12:06:07.576891    2352 kuberuntime_manager.go:513] Container {Name:zookeeper Image:davnetwork/dav-zookeeper:latest Command:[./bin/zookeeper-server-start.sh /etc/kafka/zookeeper.properties] Args:[] WorkingDir: Ports:[{Name:client HostPort:0 ContainerPort:2181 Protocol:TCP HostIP:} {Name:peer HostPort:0 ContainerPort:2888 Protocol:TCP HostIP:} {Name:leader-election HostPort:0 ContainerPort:3888 Protocol:TCP HostIP:}] EnvFrom:[] Env:[{Name:KAFKA_LOG4J_OPTS Value:-Dlog4j.configuration=file:/etc/kafka/log4j.properties ValueFrom:nil}] Resources:{Limits:map[cpu:{i:{value:1 scale:0} d:{Dec:<nil>} s:1 Format:DecimalSI} memory:{i:{value:1073741824 scale:0} d:{Dec:<nil>} s:1Gi Format:BinarySI}] Requests:map[cpu:{i:{value:10 scale:-3} d:{Dec:<nil>} s:10m Format:DecimalSI} memory:{i:{value:52428800 scale:0} d:{Dec:<nil>} s:50Mi Format:BinarySI}]} VolumeMounts:[{Name:zookeeper-configs ReadOnly:false MountPath:/etc/kafka SubPath: MountPropagation:<nil>} {Name:zookeeper-data ReadOnly:false MountPath:/var/lib/zookeeper/data SubPath: MountPropagation:<nil>} {Name:default-token-rlxcj ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:nil ReadinessProbe:&Probe{Handler:Handler{Exec:&ExecAction{Command:[/bin/sh -c [ "imok" = "$(echo ruok | nc -w 1 -q 1 127.0.0.1 2181)" ]],},HTTPGet:nil,TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:Always SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 12:06:24 minikube kubelet[2352]: I0925 12:06:24.801790    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "zookeeper-configmap" (UniqueName: "kubernetes.io/configmap/6c7eb6f2-c0bb-11e8-9240-242a6da44cca-zookeeper-configmap") pod "zookeeper-1" (UID: "6c7eb6f2-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:06:24 minikube kubelet[2352]: I0925 12:06:24.802745    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "zookeeper-data" (UniqueName: "kubernetes.io/empty-dir/6c7eb6f2-c0bb-11e8-9240-242a6da44cca-zookeeper-data") pod "zookeeper-1" (UID: "6c7eb6f2-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:06:24 minikube kubelet[2352]: I0925 12:06:24.802952    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "zookeeper-configs" (UniqueName: "kubernetes.io/empty-dir/6c7eb6f2-c0bb-11e8-9240-242a6da44cca-zookeeper-configs") pod "zookeeper-1" (UID: "6c7eb6f2-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:06:24 minikube kubelet[2352]: I0925 12:06:24.803216    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "default-token-rlxcj" (UniqueName: "kubernetes.io/secret/6c7eb6f2-c0bb-11e8-9240-242a6da44cca-default-token-rlxcj") pod "zookeeper-1" (UID: "6c7eb6f2-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:06:27 minikube kubelet[2352]: W0925 12:06:27.656446    2352 container.go:393] Failed to create summary reader for "/kubepods/burstable/pod6c7eb6f2-c0bb-11e8-9240-242a6da44cca/e038341838c80bd2d5d6143ecb3ff91be8813ea9d34fdde4e1cabc2f04356a94": none of the resources are being tracked.
Sep 25 12:06:27 minikube kubelet[2352]: I0925 12:06:27.967445    2352 kuberuntime_manager.go:513] Container {Name:zookeeper Image:davnetwork/dav-zookeeper:latest Command:[./bin/zookeeper-server-start.sh /etc/kafka/zookeeper.properties] Args:[] WorkingDir: Ports:[{Name:client HostPort:0 ContainerPort:2181 Protocol:TCP HostIP:} {Name:peer HostPort:0 ContainerPort:2888 Protocol:TCP HostIP:} {Name:leader-election HostPort:0 ContainerPort:3888 Protocol:TCP HostIP:}] EnvFrom:[] Env:[{Name:KAFKA_LOG4J_OPTS Value:-Dlog4j.configuration=file:/etc/kafka/log4j.properties ValueFrom:nil}] Resources:{Limits:map[cpu:{i:{value:1 scale:0} d:{Dec:<nil>} s:1 Format:DecimalSI} memory:{i:{value:1073741824 scale:0} d:{Dec:<nil>} s:1Gi Format:BinarySI}] Requests:map[cpu:{i:{value:10 scale:-3} d:{Dec:<nil>} s:10m Format:DecimalSI} memory:{i:{value:52428800 scale:0} d:{Dec:<nil>} s:50Mi Format:BinarySI}]} VolumeMounts:[{Name:zookeeper-configs ReadOnly:false MountPath:/etc/kafka SubPath: MountPropagation:<nil>} {Name:zookeeper-data ReadOnly:false MountPath:/var/lib/zookeeper/data SubPath: MountPropagation:<nil>} {Name:default-token-rlxcj ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:nil ReadinessProbe:&Probe{Handler:Handler{Exec:&ExecAction{Command:[/bin/sh -c [ "imok" = "$(echo ruok | nc -w 1 -q 1 127.0.0.1 2181)" ]],},HTTPGet:nil,TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:Always SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 12:06:31 minikube kubelet[2352]: I0925 12:06:31.937580    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "zookeeper-configmap" (UniqueName: "kubernetes.io/configmap/70c01a6c-c0bb-11e8-9240-242a6da44cca-zookeeper-configmap") pod "zookeeper-2" (UID: "70c01a6c-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:06:31 minikube kubelet[2352]: I0925 12:06:31.939068    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "zookeeper-data" (UniqueName: "kubernetes.io/empty-dir/70c01a6c-c0bb-11e8-9240-242a6da44cca-zookeeper-data") pod "zookeeper-2" (UID: "70c01a6c-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:06:31 minikube kubelet[2352]: I0925 12:06:31.939450    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "zookeeper-configs" (UniqueName: "kubernetes.io/empty-dir/70c01a6c-c0bb-11e8-9240-242a6da44cca-zookeeper-configs") pod "zookeeper-2" (UID: "70c01a6c-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:06:31 minikube kubelet[2352]: I0925 12:06:31.939977    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "default-token-rlxcj" (UniqueName: "kubernetes.io/secret/70c01a6c-c0bb-11e8-9240-242a6da44cca-default-token-rlxcj") pod "zookeeper-2" (UID: "70c01a6c-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:06:33 minikube kubelet[2352]: I0925 12:06:33.646910    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "cassandra-data" (UniqueName: "kubernetes.io/empty-dir/71d168c3-c0bb-11e8-9240-242a6da44cca-cassandra-data") pod "davnn-678886d777-xn6m6" (UID: "71d168c3-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:06:33 minikube kubelet[2352]: I0925 12:06:33.648591    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kafka-config" (UniqueName: "kubernetes.io/empty-dir/71d168c3-c0bb-11e8-9240-242a6da44cca-kafka-config") pod "davnn-678886d777-xn6m6" (UID: "71d168c3-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:06:33 minikube kubelet[2352]: I0925 12:06:33.648819    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kafka-data" (UniqueName: "kubernetes.io/empty-dir/71d168c3-c0bb-11e8-9240-242a6da44cca-kafka-data") pod "davnn-678886d777-xn6m6" (UID: "71d168c3-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:06:33 minikube kubelet[2352]: I0925 12:06:33.649001    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "nginx-configmap" (UniqueName: "kubernetes.io/configmap/71d168c3-c0bb-11e8-9240-242a6da44cca-nginx-configmap") pod "davnn-678886d777-xn6m6" (UID: "71d168c3-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:06:33 minikube kubelet[2352]: I0925 12:06:33.649247    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "default-token-rlxcj" (UniqueName: "kubernetes.io/secret/71d168c3-c0bb-11e8-9240-242a6da44cca-default-token-rlxcj") pod "davnn-678886d777-xn6m6" (UID: "71d168c3-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:06:33 minikube kubelet[2352]: I0925 12:06:33.649433    2352 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kafka-configmap" (UniqueName: "kubernetes.io/configmap/71d168c3-c0bb-11e8-9240-242a6da44cca-kafka-configmap") pod "davnn-678886d777-xn6m6" (UID: "71d168c3-c0bb-11e8-9240-242a6da44cca")
Sep 25 12:06:35 minikube kubelet[2352]: I0925 12:06:35.184517    2352 kuberuntime_manager.go:513] Container {Name:zookeeper Image:davnetwork/dav-zookeeper:latest Command:[./bin/zookeeper-server-start.sh /etc/kafka/zookeeper.properties] Args:[] WorkingDir: Ports:[{Name:client HostPort:0 ContainerPort:2181 Protocol:TCP HostIP:} {Name:peer HostPort:0 ContainerPort:2888 Protocol:TCP HostIP:} {Name:leader-election HostPort:0 ContainerPort:3888 Protocol:TCP HostIP:}] EnvFrom:[] Env:[{Name:KAFKA_LOG4J_OPTS Value:-Dlog4j.configuration=file:/etc/kafka/log4j.properties ValueFrom:nil}] Resources:{Limits:map[cpu:{i:{value:1 scale:0} d:{Dec:<nil>} s:1 Format:DecimalSI} memory:{i:{value:1073741824 scale:0} d:{Dec:<nil>} s:1Gi Format:BinarySI}] Requests:map[memory:{i:{value:52428800 scale:0} d:{Dec:<nil>} s:50Mi Format:BinarySI} cpu:{i:{value:10 scale:-3} d:{Dec:<nil>} s:10m Format:DecimalSI}]} VolumeMounts:[{Name:zookeeper-configs ReadOnly:false MountPath:/etc/kafka SubPath: MountPropagation:<nil>} {Name:zookeeper-data ReadOnly:false MountPath:/var/lib/zookeeper/data SubPath: MountPropagation:<nil>} {Name:default-token-rlxcj ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:nil ReadinessProbe:&Probe{Handler:Handler{Exec:&ExecAction{Command:[/bin/sh -c [ "imok" = "$(echo ruok | nc -w 1 -q 1 127.0.0.1 2181)" ]],},HTTPGet:nil,TCPSocket:nil,},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:Always SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 12:06:38 minikube kubelet[2352]: I0925 12:06:38.342555    2352 kuberuntime_manager.go:513] Container {Name:nginx Image:davnetwork/dav-nginx:180923-0908 Command:[/bin/bash] Args:[-c envsubst < /etc/nginx/templates/app.template > /etc/nginx/conf.d/default.conf && exec nginx -g 'daemon off;'] WorkingDir: Ports:[{Name: HostPort:0 ContainerPort:80 Protocol:TCP HostIP:}] EnvFrom:[] Env:[{Name:WEB_REVERSE_PROXY_PORT Value:3005 ValueFrom:nil} {Name:NGINX_PORT Value:80 ValueFrom:nil}] Resources:{Limits:map[cpu:{i:{value:1 scale:0} d:{Dec:<nil>} s:1 Format:DecimalSI} memory:{i:{value:1073741824 scale:0} d:{Dec:<nil>} s:1Gi Format:BinarySI}] Requests:map[cpu:{i:{value:100 scale:-3} d:{Dec:<nil>} s:100m Format:DecimalSI} memory:{i:{value:104857600 scale:0} d:{Dec:<nil>} s:100Mi Format:BinarySI}]} VolumeMounts:[{Name:nginx-configmap ReadOnly:false MountPath:/etc/nginx/templates SubPath: MountPropagation:<nil>} {Name:default-token-rlxcj ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:nil ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 12:06:38 minikube kubelet[2352]: I0925 12:06:38.342905    2352 kuberuntime_manager.go:513] Container {Name:api Image:davnetwork/dav-api:180923-0908 Command:[/bin/bash] Args:[-c nodemon --watch 'src/**/*.ts' --ignore 'src/**/*.spec.ts' --exec 'ts-node' src/index.ts --inspect 9229] WorkingDir: Ports:[{Name: HostPort:0 ContainerPort:3005 Protocol:TCP HostIP:} {Name: HostPort:0 ContainerPort:9229 Protocol:TCP HostIP:}] EnvFrom:[] Env:[{Name:CASSANDRA_KEYSPACE Value:davnn ValueFrom:nil} {Name:CASSANDRA_ENDPOINTS Value:localhost ValueFrom:nil} {Name:KAFKA_HOST Value:localhost:9092 ValueFrom:nil}] Resources:{Limits:map[cpu:{i:{value:1 scale:0} d:{Dec:<nil>} s:1 Format:DecimalSI} memory:{i:{value:1073741824 scale:0} d:{Dec:<nil>} s:1Gi Format:BinarySI}] Requests:map[memory:{i:{value:104857600 scale:0} d:{Dec:<nil>} s:100Mi Format:BinarySI} cpu:{i:{value:100 scale:-3} d:{Dec:<nil>} s:100m Format:DecimalSI}]} VolumeMounts:[{Name:default-token-rlxcj ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:nil ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 12:06:38 minikube kubelet[2352]: I0925 12:06:38.343385    2352 kuberuntime_manager.go:513] Container {Name:kafka Image:davnetwork/dav-kafka:180923-0908 Command:[./bin/kafka-server-start.sh /etc/kafka/server.properties] Args:[] WorkingDir: Ports:[{Name:inside HostPort:0 ContainerPort:9092 Protocol:TCP HostIP:} {Name:outside HostPort:0 ContainerPort:9094 Protocol:TCP HostIP:} {Name:jmx HostPort:0 ContainerPort:5555 Protocol:TCP HostIP:}] EnvFrom:[] Env:[{Name:KAFKA_LOG4J_OPTS Value:-Dlog4j.configuration=file:/etc/kafka/log4j.properties ValueFrom:nil} {Name:JMX_PORT Value:5555 ValueFrom:nil}] Resources:{Limits:map[cpu:{i:{value:1 scale:0} d:{Dec:<nil>} s:1 Format:DecimalSI} memory:{i:{value:1073741824 scale:0} d:{Dec:<nil>} s:1Gi Format:BinarySI}] Requests:map[cpu:{i:{value:100 scale:-3} d:{Dec:<nil>} s:100m Format:DecimalSI} memory:{i:{value:104857600 scale:0} d:{Dec:<nil>} s:100Mi Format:BinarySI}]} VolumeMounts:[{Name:kafka-config ReadOnly:false MountPath:/etc/kafka SubPath: MountPropagation:<nil>} {Name:kafka-data ReadOnly:false MountPath:/var/lib/kafka/data SubPath: MountPropagation:<nil>} {Name:default-token-rlxcj ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:nil ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:nil,TCPSocket:&TCPSocketAction{Port:9092,Host:,},},InitialDelaySeconds:0,TimeoutSeconds:1,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 12:06:38 minikube kubelet[2352]: I0925 12:06:38.344155    2352 kuberuntime_manager.go:513] Container {Name:cassandra Image:davnetwork/dav-cassandra:180923-0908 Command:[] Args:[] WorkingDir: Ports:[{Name:intra-node HostPort:0 ContainerPort:7000 Protocol:TCP HostIP:} {Name:tls-intra-node HostPort:0 ContainerPort:7001 Protocol:TCP HostIP:} {Name:jmx HostPort:0 ContainerPort:7199 Protocol:TCP HostIP:} {Name:cql HostPort:0 ContainerPort:9042 Protocol:TCP HostIP:}] EnvFrom:[] Env:[{Name:MAX_HEAP_SIZE Value:512M ValueFrom:nil} {Name:HEAP_NEWSIZE Value:100M ValueFrom:nil} {Name:CASSANDRA_CLUSTER_NAME Value:ride-hailing ValueFrom:nil} {Name:CASSANDRA_DC Value:DC1 ValueFrom:nil} {Name:CASSANDRA_RACK Value:Rack1 ValueFrom:nil} {Name:POD_IP Value: ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:status.podIP,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,}}] Resources:{Limits:map[cpu:{i:{value:1 scale:0} d:{Dec:<nil>} s:1 Format:DecimalSI} memory:{i:{value:1073741824 scale:0} d:{Dec:<nil>} s:1Gi Format:BinarySI}] Requests:map[cpu:{i:{value:100 scale:-3} d:{Dec:<nil>} s:100m Format:DecimalSI} memory:{i:{value:536870912 scale:0} d:{Dec:<nil>} s: Format:BinarySI}]} VolumeMounts:[{Name:cassandra-data ReadOnly:false MountPath:/cassandra_data SubPath: MountPropagation:<nil>} {Name:default-token-rlxcj ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:nil ReadinessProbe:&Probe{Handler:Handler{Exec:&ExecAction{Command:[/bin/bash -c /ready-probe.sh],},HTTPGet:nil,TCPSocket:nil,},InitialDelaySeconds:15,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} Lifecycle:&Lifecycle{PostStart:nil,PreStop:&Handler{Exec:&ExecAction{Command:[/bin/sh -c nodetool drain],},HTTPGet:nil,TCPSocket:nil,},} TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[IPC_LOCK],Drop:[],},Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,} Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 12:11:09 minikube kubelet[2352]: I0925 12:11:09.833459    2352 kuberuntime_manager.go:513] Container {Name:kubernetes-dashboard Image:k8s.gcr.io/kubernetes-dashboard-amd64:v1.8.1 Command:[] Args:[] WorkingDir: Ports:[{Name: HostPort:0 ContainerPort:9090 Protocol:TCP HostIP:}] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:default-token-n6wzf ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/,Port:9090,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:30,TimeoutSeconds:30,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 12:11:09 minikube kubelet[2352]: I0925 12:11:09.835016    2352 kuberuntime_manager.go:757] checking backoff for container "kubernetes-dashboard" in pod "kubernetes-dashboard-5498ccf677-mplc7_kube-system(cab3df8f-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:38:17 minikube kubelet[2352]: E0925 13:38:17.670545    2352 httpstream.go:143] (conn=&{0xc4211e31e0 [] {0 0} 0x12a51c0}, request=14) timed out waiting for streams
Sep 25 13:43:20 minikube kubelet[2352]: E0925 13:43:20.354431    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?resourceVersion=0&timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:43:30 minikube kubelet[2352]: E0925 13:43:30.354719    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:43:40 minikube kubelet[2352]: E0925 13:43:40.362200    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:43:50 minikube kubelet[2352]: E0925 13:43:50.362565    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:44:00 minikube kubelet[2352]: E0925 13:44:00.362888    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:44:00 minikube kubelet[2352]: E0925 13:44:00.363220    2352 kubelet_node_status.go:366] Unable to update node status: update node status exceeds retry count
Sep 25 13:44:20 minikube kubelet[2352]: E0925 13:44:20.377821    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?resourceVersion=0&timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:44:30 minikube kubelet[2352]: E0925 13:44:30.378071    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:44:39 minikube kubelet[2352]: E0925 13:44:39.209614    2352 httpstream.go:143] (conn=&{0xc420bd7340 [] {0 0} 0x12a51c0}, request=26) timed out waiting for streams
Sep 25 13:44:40 minikube kubelet[2352]: E0925 13:44:40.378953    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:44:45 minikube kubelet[2352]: W0925 13:44:45.502000    2352 prober.go:103] No ref for container "docker://1f962730547b15ffe4ef91e094577f7d02cf53021ee5ebd9da198e080bbf6e11" (kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca):kubedns)
Sep 25 13:44:50 minikube kubelet[2352]: E0925 13:44:50.379494    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:44:55 minikube kubelet[2352]: W0925 13:44:55.501923    2352 prober.go:103] No ref for container "docker://1f962730547b15ffe4ef91e094577f7d02cf53021ee5ebd9da198e080bbf6e11" (kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca):kubedns)
Sep 25 13:45:00 minikube kubelet[2352]: E0925 13:45:00.381212    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:45:00 minikube kubelet[2352]: E0925 13:45:00.381238    2352 kubelet_node_status.go:366] Unable to update node status: update node status exceeds retry count
Sep 25 13:45:04 minikube kubelet[2352]: E0925 13:45:04.802262    2352 event.go:209] Unable to write event: 'Post https://localhost:8443/api/v1/namespaces/kube-system/events: read tcp 127.0.0.1:46224->127.0.0.1:8443: read: connection reset by peer; some request body already written' (may retry after sleeping)
Sep 25 13:45:04 minikube kubelet[2352]: E0925 13:45:04.802344    2352 reflector.go:322] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to watch *v1.Service: Get https://localhost:8443/api/v1/services?resourceVersion=678&timeoutSeconds=462&watch=true: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:45:04 minikube kubelet[2352]: E0925 13:45:04.802374    2352 reflector.go:322] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to watch *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&resourceVersion=7232&timeoutSeconds=350&watch=true: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:45:04 minikube kubelet[2352]: W0925 13:45:04.802435    2352 reflector.go:341] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: watch of *v1.Pod ended with: very short watch: k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Unexpected watch close - watch lasted less than a second and no items received
Sep 25 13:45:05 minikube kubelet[2352]: I0925 13:45:05.477449    2352 kuberuntime_manager.go:757] checking backoff for container "kubernetes-dashboard" in pod "kubernetes-dashboard-5498ccf677-mplc7_kube-system(cab3df8f-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:45:05 minikube kubelet[2352]: W0925 13:45:05.502005    2352 prober.go:103] No ref for container "docker://1f962730547b15ffe4ef91e094577f7d02cf53021ee5ebd9da198e080bbf6e11" (kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca):kubedns)
Sep 25 13:45:05 minikube kubelet[2352]: E0925 13:45:05.802866    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:45:05 minikube kubelet[2352]: W0925 13:45:05.803746    2352 status_manager.go:461] Failed to get status for pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-dns-86f4d74b45-f42gd: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:45:06 minikube kubelet[2352]: I0925 13:45:06.061497    2352 kuberuntime_manager.go:513] Container {Name:kube-controller-manager Image:k8s.gcr.io/kube-controller-manager-amd64:v1.10.0 Command:[kube-controller-manager --address=127.0.0.1 --leader-elect=true --kubeconfig=/etc/kubernetes/controller-manager.conf --cluster-signing-cert-file=/var/lib/localkube/certs/ca.crt --cluster-signing-key-file=/var/lib/localkube/certs/ca.key --use-service-account-credentials=true --controllers=*,bootstrapsigner,tokencleaner --root-ca-file=/var/lib/localkube/certs/ca.crt --service-account-private-key-file=/var/lib/localkube/certs/sa.key] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:200 scale:-3} d:{Dec:<nil>} s:200m Format:DecimalSI}]} VolumeMounts:[{Name:k8s-certs ReadOnly:true MountPath:/var/lib/localkube/certs/ SubPath: MountPropagation:<nil>} {Name:ca-certs ReadOnly:true MountPath:/etc/ssl/certs SubPath: MountPropagation:<nil>} {Name:kubeconfig ReadOnly:true MountPath:/etc/kubernetes/controller-manager.conf SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10252,Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:15,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:45:06 minikube kubelet[2352]: I0925 13:45:06.062359    2352 kuberuntime_manager.go:757] checking backoff for container "kube-controller-manager" in pod "kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)"
Sep 25 13:45:06 minikube kubelet[2352]: I0925 13:45:06.313428    2352 kuberuntime_manager.go:513] Container {Name:kube-scheduler Image:k8s.gcr.io/kube-scheduler-amd64:v1.10.0 Command:[kube-scheduler --address=127.0.0.1 --leader-elect=true --kubeconfig=/etc/kubernetes/scheduler.conf] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:100 scale:-3} d:{Dec:<nil>} s:100m Format:DecimalSI}]} VolumeMounts:[{Name:kubeconfig ReadOnly:true MountPath:/etc/kubernetes/scheduler.conf SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10251,Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:15,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:45:06 minikube kubelet[2352]: I0925 13:45:06.313500    2352 kuberuntime_manager.go:757] checking backoff for container "kube-scheduler" in pod "kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"
Sep 25 13:45:12 minikube kubelet[2352]: E0925 13:45:12.802655    2352 exec.go:127] Exec session 328ec983a7d1bab57804ae0d727f7d9201a90e1ad7a3abce0b5e5ff3f175dbe2 in container 3c908237b1387928f327878054b6622055769b643007cf0a62f1698f0cab0574 terminated but process still running!
Sep 25 13:45:15 minikube kubelet[2352]: W0925 13:45:15.501984    2352 prober.go:103] No ref for container "docker://1f962730547b15ffe4ef91e094577f7d02cf53021ee5ebd9da198e080bbf6e11" (kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca):kubedns)
Sep 25 13:45:31 minikube kubelet[2352]: E0925 13:45:31.439228    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?resourceVersion=0&timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:45:41 minikube kubelet[2352]: E0925 13:45:41.448351    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:45:51 minikube kubelet[2352]: E0925 13:45:51.450247    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:46:01 minikube kubelet[2352]: E0925 13:46:01.452390    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:46:11 minikube kubelet[2352]: E0925 13:46:11.452776    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:46:11 minikube kubelet[2352]: E0925 13:46:11.453210    2352 kubelet_node_status.go:366] Unable to update node status: update node status exceeds retry count
Sep 25 13:46:11 minikube kubelet[2352]: I0925 13:46:11.617142    2352 kuberuntime_manager.go:757] checking backoff for container "sidecar" in pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:46:31 minikube kubelet[2352]: E0925 13:46:31.453675    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?resourceVersion=0&timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:46:41 minikube kubelet[2352]: E0925 13:46:41.454045    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:46:50 minikube kubelet[2352]: W0925 13:46:50.631928    2352 status_manager.go:476] Failed to update status for pod "kube-controller-manager-minikube_kube-system(c29f04b6-c0ba-11e8-9240-242a6da44cca)": Put https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube/status: read tcp 127.0.0.1:40590->127.0.0.1:8443: read: connection reset by peer; some request body already written
Sep 25 13:46:50 minikube kubelet[2352]: E0925 13:46:50.632651    2352 event.go:209] Unable to write event: 'Post https://localhost:8443/api/v1/namespaces/kube-system/events: read tcp 127.0.0.1:40590->127.0.0.1:8443: read: connection reset by peer; some request body already written' (may retry after sleeping)
Sep 25 13:46:50 minikube kubelet[2352]: W0925 13:46:50.633664    2352 status_manager.go:461] Failed to get status for pod "kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:46:50 minikube kubelet[2352]: E0925 13:46:50.633866    2352 reflector.go:322] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to watch *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&resourceVersion=7242&timeoutSeconds=519&watch=true: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:46:50 minikube kubelet[2352]: E0925 13:46:50.633908    2352 reflector.go:322] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to watch *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&resourceVersion=7235&timeoutSeconds=581&watch=true: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:46:50 minikube kubelet[2352]: W0925 13:46:50.633956    2352 status_manager.go:461] Failed to get status for pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-dns-86f4d74b45-f42gd: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:46:50 minikube kubelet[2352]: E0925 13:46:50.634364    2352 reflector.go:322] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to watch *v1.Service: Get https://localhost:8443/api/v1/services?resourceVersion=7234&timeoutSeconds=451&watch=true: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:46:50 minikube kubelet[2352]: W0925 13:46:50.636274    2352 status_manager.go:461] Failed to get status for pod "kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:46:50 minikube kubelet[2352]: W0925 13:46:50.637117    2352 status_manager.go:461] Failed to get status for pod "kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:46:50 minikube kubelet[2352]: W0925 13:46:50.649451    2352 status_manager.go:461] Failed to get status for pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-dns-86f4d74b45-f42gd: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:46:50 minikube kubelet[2352]: W0925 13:46:50.654361    2352 status_manager.go:461] Failed to get status for pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-dns-86f4d74b45-f42gd: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:46:50 minikube kubelet[2352]: I0925 13:46:50.808935    2352 kuberuntime_manager.go:757] checking backoff for container "kube-apiserver" in pod "kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)"
Sep 25 13:46:51 minikube kubelet[2352]: I0925 13:46:51.749853    2352 kuberuntime_manager.go:757] checking backoff for container "kubernetes-dashboard" in pod "kubernetes-dashboard-5498ccf677-mplc7_kube-system(cab3df8f-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:46:57 minikube kubelet[2352]: E0925 13:46:57.271775    2352 secret.go:204] Couldn't get secret kube-system/default-token-n6wzf: secrets "default-token-n6wzf" is forbidden: User "system:node:minikube" cannot get secrets in the namespace "kube-system": no path found to object
Sep 25 13:46:57 minikube kubelet[2352]: E0925 13:46:57.280335    2352 secret.go:204] Couldn't get secret kube-system/kube-dns-token-jgxf6: secrets "kube-dns-token-jgxf6" is forbidden: User "system:node:minikube" cannot get secrets in the namespace "kube-system": no path found to object
Sep 25 13:46:57 minikube kubelet[2352]: E0925 13:46:57.280393    2352 configmap.go:205] Couldn't get configMap kube-system/kube-dns: configmaps "kube-dns" is forbidden: User "system:node:minikube" cannot get configmaps in the namespace "kube-system": no path found to object
Sep 25 13:46:57 minikube kubelet[2352]: E0925 13:46:57.328348    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/secret/cab3df8f-c0ba-11e8-9240-242a6da44cca-default-token-n6wzf\" (\"cab3df8f-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:46:57.776673638 +0000 UTC m=+6359.764933996 (durationBeforeRetry 500ms). Error: "MountVolume.SetUp failed for volume \"default-token-n6wzf\" (UniqueName: \"kubernetes.io/secret/cab3df8f-c0ba-11e8-9240-242a6da44cca-default-token-n6wzf\") pod \"kubernetes-dashboard-5498ccf677-mplc7\" (UID: \"cab3df8f-c0ba-11e8-9240-242a6da44cca\") : secrets \"default-token-n6wzf\" is forbidden: User \"system:node:minikube\" cannot get secrets in the namespace \"kube-system\": no path found to object"
Sep 25 13:46:57 minikube kubelet[2352]: E0925 13:46:57.328559    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:46:57.828475521 +0000 UTC m=+6359.816735884 (durationBeforeRetry 500ms). Error: "MountVolume.SetUp failed for volume \"kube-dns-token-jgxf6\" (UniqueName: \"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : secrets \"kube-dns-token-jgxf6\" is forbidden: User \"system:node:minikube\" cannot get secrets in the namespace \"kube-system\": no path found to object"
Sep 25 13:46:57 minikube kubelet[2352]: E0925 13:46:57.341752    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:46:57.828574863 +0000 UTC m=+6359.816835220 (durationBeforeRetry 500ms). Error: "MountVolume.SetUp failed for volume \"kube-dns-config\" (UniqueName: \"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : configmaps \"kube-dns\" is forbidden: User \"system:node:minikube\" cannot get configmaps in the namespace \"kube-system\": no path found to object"
Sep 25 13:47:21 minikube kubelet[2352]: E0925 13:47:21.942462    2352 kubelet_node_status.go:374] Error updating node status, will retry: failed to patch status "{\"status\":{\"$setElementOrder/conditions\":[{\"type\":\"OutOfDisk\"},{\"type\":\"MemoryPressure\"},{\"type\":\"DiskPressure\"},{\"type\":\"PIDPressure\"},{\"type\":\"Ready\"}],\"conditions\":[{\"lastHeartbeatTime\":\"2018-09-25T13:47:11Z\",\"type\":\"OutOfDisk\"},{\"lastHeartbeatTime\":\"2018-09-25T13:47:11Z\",\"type\":\"MemoryPressure\"},{\"lastHeartbeatTime\":\"2018-09-25T13:47:11Z\",\"type\":\"DiskPressure\"},{\"lastHeartbeatTime\":\"2018-09-25T13:47:11Z\",\"type\":\"PIDPressure\"},{\"lastHeartbeatTime\":\"2018-09-25T13:47:11Z\",\"type\":\"Ready\"}]}}" for node "minikube": Patch https://localhost:8443/api/v1/nodes/minikube/status?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:47:24 minikube kubelet[2352]: I0925 13:47:24.075001    2352 kuberuntime_manager.go:757] checking backoff for container "kubedns" in pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:47:25 minikube kubelet[2352]: W0925 13:47:25.501927    2352 prober.go:103] No ref for container "docker://6a0f5ab0f179db327c0d1529a3040b75463f283ca34df552de75784e5a6c711f" (kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca):kubedns)
Sep 25 13:47:31 minikube kubelet[2352]: E0925 13:47:31.942789    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:47:41 minikube kubelet[2352]: E0925 13:47:41.943036    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:47:48 minikube kubelet[2352]: E0925 13:47:48.762902    2352 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-dns-86f4d74b45-f42gd.1557a870001c9a46", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"kube-system", Name:"kube-dns-86f4d74b45-f42gd", UID:"c97cc72e-c0ba-11e8-9240-242a6da44cca", APIVersion:"v1", ResourceVersion:"300", FieldPath:"spec.containers{sidecar}"}, Reason:"Unhealthy", Message:"Liveness probe failed: Get http://172.17.0.2:10054/metrics: net/http: request canceled (Client.Timeout exceeded while awaiting headers)", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbee2acbd2d6b1246, ext:6138750252103, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbee2acbd2d6b1246, ext:6138750252103, loc:(*time.Location)(0x5b98020)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Timeout: request did not complete within allowed duration' (will not retry!)
Sep 25 13:47:51 minikube kubelet[2352]: E0925 13:47:51.950435    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:48:01 minikube kubelet[2352]: E0925 13:48:01.950611    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:48:01 minikube kubelet[2352]: E0925 13:48:01.950639    2352 kubelet_node_status.go:366] Unable to update node status: update node status exceeds retry count
Sep 25 13:48:03 minikube kubelet[2352]: I0925 13:48:03.617394    2352 kuberuntime_manager.go:757] checking backoff for container "dnsmasq" in pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:48:21 minikube kubelet[2352]: E0925 13:48:21.950997    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?resourceVersion=0&timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:48:31 minikube kubelet[2352]: E0925 13:48:31.951225    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:48:41 minikube kubelet[2352]: E0925 13:48:41.951586    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:48:44 minikube kubelet[2352]: I0925 13:48:44.279227    2352 kuberuntime_manager.go:513] Container {Name:kubedns Image:k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.8 Command:[] Args:[--domain=cluster.local. --dns-port=10053 --config-dir=/kube-dns-config --v=2] WorkingDir: Ports:[{Name:dns-local HostPort:0 ContainerPort:10053 Protocol:UDP HostIP:} {Name:dns-tcp-local HostPort:0 ContainerPort:10053 Protocol:TCP HostIP:} {Name:metrics HostPort:0 ContainerPort:10055 Protocol:TCP HostIP:}] EnvFrom:[] Env:[{Name:PROMETHEUS_PORT Value:10055 ValueFrom:nil}] Resources:{Limits:map[memory:{i:{value:178257920 scale:0} d:{Dec:<nil>} s:170Mi Format:BinarySI}] Requests:map[cpu:{i:{value:100 scale:-3} d:{Dec:<nil>} s:100m Format:DecimalSI} memory:{i:{value:73400320 scale:0} d:{Dec:<nil>} s:70Mi Format:BinarySI}]} VolumeMounts:[{Name:kube-dns-config ReadOnly:false MountPath:/kube-dns-config SubPath: MountPropagation:<nil>} {Name:kube-dns-token-jgxf6 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthcheck/kubedns,Port:10054,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:60,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:5,} ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readiness,Port:8081,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:3,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:48:44 minikube kubelet[2352]: I0925 13:48:44.279462    2352 kuberuntime_manager.go:757] checking backoff for container "kubedns" in pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:48:44 minikube kubelet[2352]: I0925 13:48:44.279544    2352 kuberuntime_manager.go:767] Back-off 10s restarting failed container=kubedns pod=kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)
Sep 25 13:48:44 minikube kubelet[2352]: E0925 13:48:44.279579    2352 pod_workers.go:186] Error syncing pod c97cc72e-c0ba-11e8-9240-242a6da44cca ("kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)"), skipping: failed to "StartContainer" for "kubedns" with CrashLoopBackOff: "Back-off 10s restarting failed container=kubedns pod=kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:48:46 minikube kubelet[2352]: I0925 13:48:46.776270    2352 kuberuntime_manager.go:513] Container {Name:kubedns Image:k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.8 Command:[] Args:[--domain=cluster.local. --dns-port=10053 --config-dir=/kube-dns-config --v=2] WorkingDir: Ports:[{Name:dns-local HostPort:0 ContainerPort:10053 Protocol:UDP HostIP:} {Name:dns-tcp-local HostPort:0 ContainerPort:10053 Protocol:TCP HostIP:} {Name:metrics HostPort:0 ContainerPort:10055 Protocol:TCP HostIP:}] EnvFrom:[] Env:[{Name:PROMETHEUS_PORT Value:10055 ValueFrom:nil}] Resources:{Limits:map[memory:{i:{value:178257920 scale:0} d:{Dec:<nil>} s:170Mi Format:BinarySI}] Requests:map[cpu:{i:{value:100 scale:-3} d:{Dec:<nil>} s:100m Format:DecimalSI} memory:{i:{value:73400320 scale:0} d:{Dec:<nil>} s:70Mi Format:BinarySI}]} VolumeMounts:[{Name:kube-dns-config ReadOnly:false MountPath:/kube-dns-config SubPath: MountPropagation:<nil>} {Name:kube-dns-token-jgxf6 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthcheck/kubedns,Port:10054,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:60,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:5,} ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readiness,Port:8081,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:3,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:48:46 minikube kubelet[2352]: I0925 13:48:46.790229    2352 kuberuntime_manager.go:513] Container {Name:sidecar Image:k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.8 Command:[] Args:[--v=2 --logtostderr --probe=kubedns,127.0.0.1:10053,kubernetes.default.svc.cluster.local,5,SRV --probe=dnsmasq,127.0.0.1:53,kubernetes.default.svc.cluster.local,5,SRV] WorkingDir: Ports:[{Name:metrics HostPort:0 ContainerPort:10054 Protocol:TCP HostIP:}] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:10 scale:-3} d:{Dec:<nil>} s:10m Format:DecimalSI} memory:{i:{value:20971520 scale:0} d:{Dec:<nil>} s:20Mi Format:BinarySI}]} VolumeMounts:[{Name:kube-dns-token-jgxf6 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/metrics,Port:10054,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:60,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:5,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:48:46 minikube kubelet[2352]: I0925 13:48:46.790330    2352 kuberuntime_manager.go:757] checking backoff for container "kubedns" in pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:48:46 minikube kubelet[2352]: I0925 13:48:46.790412    2352 kuberuntime_manager.go:767] Back-off 10s restarting failed container=kubedns pod=kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)
Sep 25 13:48:46 minikube kubelet[2352]: I0925 13:48:46.790419    2352 kuberuntime_manager.go:757] checking backoff for container "sidecar" in pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:48:46 minikube kubelet[2352]: I0925 13:48:46.790454    2352 kuberuntime_manager.go:767] Back-off 10s restarting failed container=sidecar pod=kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)
Sep 25 13:48:46 minikube kubelet[2352]: E0925 13:48:46.790475    2352 pod_workers.go:186] Error syncing pod c97cc72e-c0ba-11e8-9240-242a6da44cca ("kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)"), skipping: [failed to "StartContainer" for "kubedns" with CrashLoopBackOff: "Back-off 10s restarting failed container=kubedns pod=kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:48:46 minikube kubelet[2352]: , failed to "StartContainer" for "sidecar" with CrashLoopBackOff: "Back-off 10s restarting failed container=sidecar pod=kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:48:46 minikube kubelet[2352]: ]
Sep 25 13:49:08 minikube kubelet[2352]: E0925 13:49:08.726300    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:49:08 minikube kubelet[2352]: E0925 13:49:08.804435    2352 remote_runtime.go:332] ExecSync 918340b760c507ebc413c2aa25060e0cffa5ce0e9cad59623ab1b24ad755b5c3 '/bin/bash -c /ready-probe.sh' from runtime service failed: rpc error: code = DeadlineExceeded desc = context deadline exceeded
Sep 25 13:49:09 minikube kubelet[2352]: I0925 13:49:09.338865    2352 kuberuntime_manager.go:513] Container {Name:kubedns Image:k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.8 Command:[] Args:[--domain=cluster.local. --dns-port=10053 --config-dir=/kube-dns-config --v=2] WorkingDir: Ports:[{Name:dns-local HostPort:0 ContainerPort:10053 Protocol:UDP HostIP:} {Name:dns-tcp-local HostPort:0 ContainerPort:10053 Protocol:TCP HostIP:} {Name:metrics HostPort:0 ContainerPort:10055 Protocol:TCP HostIP:}] EnvFrom:[] Env:[{Name:PROMETHEUS_PORT Value:10055 ValueFrom:nil}] Resources:{Limits:map[memory:{i:{value:178257920 scale:0} d:{Dec:<nil>} s:170Mi Format:BinarySI}] Requests:map[cpu:{i:{value:100 scale:-3} d:{Dec:<nil>} s:100m Format:DecimalSI} memory:{i:{value:73400320 scale:0} d:{Dec:<nil>} s:70Mi Format:BinarySI}]} VolumeMounts:[{Name:kube-dns-config ReadOnly:false MountPath:/kube-dns-config SubPath: MountPropagation:<nil>} {Name:kube-dns-token-jgxf6 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthcheck/kubedns,Port:10054,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:60,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:5,} ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readiness,Port:8081,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:3,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:49:09 minikube kubelet[2352]: I0925 13:49:09.338974    2352 kuberuntime_manager.go:513] Container {Name:sidecar Image:k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.8 Command:[] Args:[--v=2 --logtostderr --probe=kubedns,127.0.0.1:10053,kubernetes.default.svc.cluster.local,5,SRV --probe=dnsmasq,127.0.0.1:53,kubernetes.default.svc.cluster.local,5,SRV] WorkingDir: Ports:[{Name:metrics HostPort:0 ContainerPort:10054 Protocol:TCP HostIP:}] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[memory:{i:{value:20971520 scale:0} d:{Dec:<nil>} s:20Mi Format:BinarySI} cpu:{i:{value:10 scale:-3} d:{Dec:<nil>} s:10m Format:DecimalSI}]} VolumeMounts:[{Name:kube-dns-token-jgxf6 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/metrics,Port:10054,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:60,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:5,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:49:09 minikube kubelet[2352]: I0925 13:49:09.339123    2352 kuberuntime_manager.go:757] checking backoff for container "kubedns" in pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:49:11 minikube kubelet[2352]: E0925 13:49:11.746251    2352 remote_runtime.go:332] ExecSync 65dc2454e922204720f4a41ccea037a4ffd84bfd708fabb3cd18bceecc0bb37e '/bin/sh -c [ "imok" = "$(echo ruok | nc -w 1 -q 1 127.0.0.1 2181)" ]' from runtime service failed: rpc error: code = DeadlineExceeded desc = context deadline exceeded
Sep 25 13:49:13 minikube kubelet[2352]: E0925 13:49:13.496493    2352 remote_runtime.go:332] ExecSync 9605c4db8f28059d55c5c5e4aae95701e2945ba52eb9233b01fb27a67491dcf9 '/bin/sh -c [ "imok" = "$(echo ruok | nc -w 1 -q 1 127.0.0.1 2181)" ]' from runtime service failed: rpc error: code = DeadlineExceeded desc = context deadline exceeded
Sep 25 13:49:14 minikube kubelet[2352]: E0925 13:49:14.482146    2352 remote_runtime.go:332] ExecSync 92872ab645d0789af8ad11bacda6e4de5dfd5abebcb704f24060a5bc7f39c50b '/bin/sh -c [ "imok" = "$(echo ruok | nc -w 1 -q 1 127.0.0.1 2181)" ]' from runtime service failed: rpc error: code = DeadlineExceeded desc = context deadline exceeded
Sep 25 13:49:18 minikube kubelet[2352]: E0925 13:49:18.552800    2352 request.go:785] Unexpected error when reading response body: &net.OpError{Op:"read", Net:"tcp", Source:(*net.TCPAddr)(0xc4212495f0), Addr:(*net.TCPAddr)(0xc421249620), Err:(*os.SyscallError)(0xc4212e2080)}
Sep 25 13:49:18 minikube kubelet[2352]: E0925 13:49:18.562399    2352 event.go:209] Unable to write event: 'Post https://localhost:8443/api/v1/namespaces/kube-system/events: read tcp 127.0.0.1:41262->127.0.0.1:8443: read: connection reset by peer; some request body already written' (may retry after sleeping)
Sep 25 13:49:18 minikube kubelet[2352]: E0925 13:49:18.564756    2352 reflector.go:322] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to watch *v1.Service: Get https://localhost:8443/api/v1/services?resourceVersion=7242&timeoutSeconds=577&watch=true: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:49:18 minikube kubelet[2352]: E0925 13:49:18.564932    2352 reflector.go:322] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to watch *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&resourceVersion=7246&timeoutSeconds=301&watch=true: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:49:18 minikube kubelet[2352]: E0925 13:49:18.564969    2352 reflector.go:322] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to watch *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&resourceVersion=7249&timeoutSeconds=355&watch=true: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:49:18 minikube kubelet[2352]: I0925 13:49:18.815036    2352 kuberuntime_manager.go:757] checking backoff for container "kubernetes-dashboard" in pod "kubernetes-dashboard-5498ccf677-mplc7_kube-system(cab3df8f-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:49:19 minikube kubelet[2352]: I0925 13:49:19.004039    2352 kuberuntime_manager.go:757] checking backoff for container "sidecar" in pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:49:19 minikube kubelet[2352]: I0925 13:49:19.127602    2352 kuberuntime_manager.go:757] checking backoff for container "kube-apiserver" in pod "kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)"
Sep 25 13:49:19 minikube kubelet[2352]: E0925 13:49:19.562733    2352 secret.go:204] Couldn't get secret kube-system/kube-dns-token-jgxf6: Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/kube-dns-token-jgxf6: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:49:19 minikube kubelet[2352]: E0925 13:49:19.562804    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:49:20.062784448 +0000 UTC m=+6502.051044799 (durationBeforeRetry 500ms). Error: "MountVolume.SetUp failed for volume \"kube-dns-token-jgxf6\" (UniqueName: \"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/kube-dns-token-jgxf6: dial tcp 127.0.0.1:8443: getsockopt: connection refused"
Sep 25 13:49:19 minikube kubelet[2352]: E0925 13:49:19.562852    2352 configmap.go:205] Couldn't get configMap kube-system/kube-dns: Get https://localhost:8443/api/v1/namespaces/kube-system/configmaps/kube-dns: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:49:19 minikube kubelet[2352]: E0925 13:49:19.562900    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:49:20.062887408 +0000 UTC m=+6502.051147760 (durationBeforeRetry 500ms). Error: "MountVolume.SetUp failed for volume \"kube-dns-config\" (UniqueName: \"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : Get https://localhost:8443/api/v1/namespaces/kube-system/configmaps/kube-dns: dial tcp 127.0.0.1:8443: getsockopt: connection refused"
Sep 25 13:49:19 minikube kubelet[2352]: W0925 13:49:19.566099    2352 status_manager.go:461] Failed to get status for pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-dns-86f4d74b45-f42gd: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:49:19 minikube kubelet[2352]: E0925 13:49:19.566507    2352 secret.go:204] Couldn't get secret kube-system/default-token-n6wzf: Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/default-token-n6wzf: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:49:19 minikube kubelet[2352]: E0925 13:49:19.566551    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:49:19 minikube kubelet[2352]: E0925 13:49:19.566558    2352 kubelet_node_status.go:366] Unable to update node status: update node status exceeds retry count
Sep 25 13:49:19 minikube kubelet[2352]: E0925 13:49:19.566566    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/secret/cab3df8f-c0ba-11e8-9240-242a6da44cca-default-token-n6wzf\" (\"cab3df8f-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:49:20.066548368 +0000 UTC m=+6502.054808721 (durationBeforeRetry 500ms). Error: "MountVolume.SetUp failed for volume \"default-token-n6wzf\" (UniqueName: \"kubernetes.io/secret/cab3df8f-c0ba-11e8-9240-242a6da44cca-default-token-n6wzf\") pod \"kubernetes-dashboard-5498ccf677-mplc7\" (UID: \"cab3df8f-c0ba-11e8-9240-242a6da44cca\") : Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/default-token-n6wzf: dial tcp 127.0.0.1:8443: getsockopt: connection refused"
Sep 25 13:49:19 minikube kubelet[2352]: E0925 13:49:19.566609    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:49:19 minikube kubelet[2352]: E0925 13:49:19.804067    2352 remote_runtime.go:332] ExecSync 250ef305e2fe48c8803aeb9f03682c0db38902fc3caf3f6f3f7b3a15f8cd3645 '/bin/sh -ec ETCDCTL_API=3 etcdctl --endpoints=127.0.0.1:2379 --cacert=/var/lib/localkube/certs//etcd/ca.crt --cert=/var/lib/localkube/certs//etcd/healthcheck-client.crt --key=/var/lib/localkube/certs//etcd/healthcheck-client.key get foo' from runtime service failed: rpc error: code = DeadlineExceeded desc = context deadline exceeded
Sep 25 13:49:20 minikube kubelet[2352]: I0925 13:49:20.531963    2352 kuberuntime_manager.go:513] Container {Name:kube-scheduler Image:k8s.gcr.io/kube-scheduler-amd64:v1.10.0 Command:[kube-scheduler --address=127.0.0.1 --leader-elect=true --kubeconfig=/etc/kubernetes/scheduler.conf] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:100 scale:-3} d:{Dec:<nil>} s:100m Format:DecimalSI}]} VolumeMounts:[{Name:kubeconfig ReadOnly:true MountPath:/etc/kubernetes/scheduler.conf SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10251,Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:15,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:49:20 minikube kubelet[2352]: I0925 13:49:20.532055    2352 kuberuntime_manager.go:757] checking backoff for container "kube-scheduler" in pod "kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"
Sep 25 13:49:20 minikube kubelet[2352]: I0925 13:49:20.532184    2352 kuberuntime_manager.go:767] Back-off 10s restarting failed container=kube-scheduler pod=kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)
Sep 25 13:49:20 minikube kubelet[2352]: E0925 13:49:20.532203    2352 pod_workers.go:186] Error syncing pod 31cf0ccbee286239d451edb6fb511513 ("kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"), skipping: failed to "StartContainer" for "kube-scheduler" with CrashLoopBackOff: "Back-off 10s restarting failed container=kube-scheduler pod=kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"
Sep 25 13:49:25 minikube kubelet[2352]: E0925 13:49:25.734148    2352 secret.go:204] Couldn't get secret kube-system/default-token-n6wzf: secrets "default-token-n6wzf" is forbidden: User "system:node:minikube" cannot get secrets in the namespace "kube-system": no path found to object
Sep 25 13:49:25 minikube kubelet[2352]: E0925 13:49:25.734219    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/secret/cab3df8f-c0ba-11e8-9240-242a6da44cca-default-token-n6wzf\" (\"cab3df8f-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:49:26.734197223 +0000 UTC m=+6508.722457580 (durationBeforeRetry 1s). Error: "MountVolume.SetUp failed for volume \"default-token-n6wzf\" (UniqueName: \"kubernetes.io/secret/cab3df8f-c0ba-11e8-9240-242a6da44cca-default-token-n6wzf\") pod \"kubernetes-dashboard-5498ccf677-mplc7\" (UID: \"cab3df8f-c0ba-11e8-9240-242a6da44cca\") : secrets \"default-token-n6wzf\" is forbidden: User \"system:node:minikube\" cannot get secrets in the namespace \"kube-system\": no path found to object"
Sep 25 13:49:25 minikube kubelet[2352]: E0925 13:49:25.756312    2352 secret.go:204] Couldn't get secret kube-system/kube-dns-token-jgxf6: secrets "kube-dns-token-jgxf6" is forbidden: User "system:node:minikube" cannot get secrets in the namespace "kube-system": no path found to object
Sep 25 13:49:25 minikube kubelet[2352]: E0925 13:49:25.756363    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:49:26.756346653 +0000 UTC m=+6508.744607004 (durationBeforeRetry 1s). Error: "MountVolume.SetUp failed for volume \"kube-dns-token-jgxf6\" (UniqueName: \"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : secrets \"kube-dns-token-jgxf6\" is forbidden: User \"system:node:minikube\" cannot get secrets in the namespace \"kube-system\": no path found to object"
Sep 25 13:49:25 minikube kubelet[2352]: E0925 13:49:25.769392    2352 configmap.go:205] Couldn't get configMap kube-system/kube-dns: configmaps "kube-dns" is forbidden: User "system:node:minikube" cannot get configmaps in the namespace "kube-system": no path found to object
Sep 25 13:49:25 minikube kubelet[2352]: E0925 13:49:25.769519    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:49:26.769499897 +0000 UTC m=+6508.757760249 (durationBeforeRetry 1s). Error: "MountVolume.SetUp failed for volume \"kube-dns-config\" (UniqueName: \"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : configmaps \"kube-dns\" is forbidden: User \"system:node:minikube\" cannot get configmaps in the namespace \"kube-system\": no path found to object"
Sep 25 13:49:26 minikube kubelet[2352]: I0925 13:49:26.223836    2352 kuberuntime_manager.go:513] Container {Name:kube-scheduler Image:k8s.gcr.io/kube-scheduler-amd64:v1.10.0 Command:[kube-scheduler --address=127.0.0.1 --leader-elect=true --kubeconfig=/etc/kubernetes/scheduler.conf] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:100 scale:-3} d:{Dec:<nil>} s:100m Format:DecimalSI}]} VolumeMounts:[{Name:kubeconfig ReadOnly:true MountPath:/etc/kubernetes/scheduler.conf SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10251,Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:15,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:49:26 minikube kubelet[2352]: I0925 13:49:26.228239    2352 kuberuntime_manager.go:757] checking backoff for container "kube-scheduler" in pod "kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"
Sep 25 13:49:26 minikube kubelet[2352]: I0925 13:49:26.228331    2352 kuberuntime_manager.go:767] Back-off 10s restarting failed container=kube-scheduler pod=kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)
Sep 25 13:49:26 minikube kubelet[2352]: E0925 13:49:26.228348    2352 pod_workers.go:186] Error syncing pod 31cf0ccbee286239d451edb6fb511513 ("kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"), skipping: failed to "StartContainer" for "kube-scheduler" with CrashLoopBackOff: "Back-off 10s restarting failed container=kube-scheduler pod=kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"
Sep 25 13:49:38 minikube kubelet[2352]: I0925 13:49:38.414144    2352 kuberuntime_manager.go:513] Container {Name:kube-scheduler Image:k8s.gcr.io/kube-scheduler-amd64:v1.10.0 Command:[kube-scheduler --address=127.0.0.1 --leader-elect=true --kubeconfig=/etc/kubernetes/scheduler.conf] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:100 scale:-3} d:{Dec:<nil>} s:100m Format:DecimalSI}]} VolumeMounts:[{Name:kubeconfig ReadOnly:true MountPath:/etc/kubernetes/scheduler.conf SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10251,Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:15,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:49:38 minikube kubelet[2352]: I0925 13:49:38.414449    2352 kuberuntime_manager.go:757] checking backoff for container "kube-scheduler" in pod "kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"
Sep 25 13:50:29 minikube kubelet[2352]: E0925 13:50:29.275727    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?resourceVersion=0&timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:50:39 minikube kubelet[2352]: E0925 13:50:39.317440    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:50:49 minikube kubelet[2352]: E0925 13:50:49.340364    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:50:59 minikube kubelet[2352]: E0925 13:50:59.343011    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
Sep 25 13:51:01 minikube kubelet[2352]: E0925 13:51:01.654923    2352 reflector.go:322] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to watch *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&resourceVersion=7355&timeoutSeconds=543&watch=true: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:01 minikube kubelet[2352]: E0925 13:51:01.661520    2352 event.go:209] Unable to write event: 'Patch https://localhost:8443/api/v1/namespaces/kube-system/events/kube-controller-manager-minikube.1557a87319670e7b: read tcp 127.0.0.1:41946->127.0.0.1:8443: read: connection reset by peer; some request body already written' (may retry after sleeping)
Sep 25 13:51:01 minikube kubelet[2352]: E0925 13:51:01.672191    2352 reflector.go:322] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to watch *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&resourceVersion=7295&timeoutSeconds=304&watch=true: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:01 minikube kubelet[2352]: E0925 13:51:01.672241    2352 reflector.go:322] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to watch *v1.Service: Get https://localhost:8443/api/v1/services?resourceVersion=7253&timeoutSeconds=525&watch=true: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:02 minikube kubelet[2352]: E0925 13:51:02.311616    2352 event.go:209] Unable to write event: 'Patch https://localhost:8443/api/v1/namespaces/kube-system/events/kube-controller-manager-minikube.1557a87319670e7b: dial tcp 127.0.0.1:8443: getsockopt: connection refused' (may retry after sleeping)
Sep 25 13:51:02 minikube kubelet[2352]: W0925 13:51:02.621072    2352 status_manager.go:461] Failed to get status for pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-dns-86f4d74b45-f42gd: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:02 minikube kubelet[2352]: W0925 13:51:02.621870    2352 status_manager.go:461] Failed to get status for pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-dns-86f4d74b45-f42gd: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:02 minikube kubelet[2352]: E0925 13:51:02.656498    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:02 minikube kubelet[2352]: E0925 13:51:02.662644    2352 configmap.go:205] Couldn't get configMap kube-system/kube-dns: Get https://localhost:8443/api/v1/namespaces/kube-system/configmaps/kube-dns: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:02 minikube kubelet[2352]: E0925 13:51:02.662778    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:02 minikube kubelet[2352]: E0925 13:51:02.662789    2352 kubelet_node_status.go:366] Unable to update node status: update node status exceeds retry count
Sep 25 13:51:02 minikube kubelet[2352]: E0925 13:51:02.662911    2352 secret.go:204] Couldn't get secret kube-system/kube-dns-token-jgxf6: Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/kube-dns-token-jgxf6: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:02 minikube kubelet[2352]: E0925 13:51:02.662961    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:51:03.162941421 +0000 UTC m=+6605.151201773 (durationBeforeRetry 500ms). Error: "MountVolume.SetUp failed for volume \"kube-dns-token-jgxf6\" (UniqueName: \"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/kube-dns-token-jgxf6: dial tcp 127.0.0.1:8443: getsockopt: connection refused"
Sep 25 13:51:02 minikube kubelet[2352]: E0925 13:51:02.663102    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:51:03.163067728 +0000 UTC m=+6605.151328087 (durationBeforeRetry 500ms). Error: "MountVolume.SetUp failed for volume \"kube-dns-config\" (UniqueName: \"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : Get https://localhost:8443/api/v1/namespaces/kube-system/configmaps/kube-dns: dial tcp 127.0.0.1:8443: getsockopt: connection refused"
Sep 25 13:51:03 minikube kubelet[2352]: I0925 13:51:03.013233    2352 kuberuntime_manager.go:513] Container {Name:kube-apiserver Image:k8s.gcr.io/kube-apiserver-amd64:v1.10.0 Command:[kube-apiserver --admission-control=Initializers,NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota --requestheader-allowed-names=front-proxy-client --service-cluster-ip-range=10.96.0.0/12 --service-account-key-file=/var/lib/localkube/certs/sa.pub --tls-private-key-file=/var/lib/localkube/certs/apiserver.key --requestheader-client-ca-file=/var/lib/localkube/certs/front-proxy-ca.crt --enable-bootstrap-token-auth=true --allow-privileged=true --requestheader-group-headers=X-Remote-Group --kubelet-client-key=/var/lib/localkube/certs/apiserver-kubelet-client.key --proxy-client-key-file=/var/lib/localkube/certs/front-proxy-client.key --requestheader-username-headers=X-Remote-User --advertise-address=192.168.39.215 --client-ca-file=/var/lib/localkube/certs/ca.crt --proxy-client-cert-file=/var/lib/localkube/certs/front-proxy-client.crt --insecure-port=0 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --tls-cert-file=/var/lib/localkube/certs/apiserver.crt --kubelet-client-certificate=/var/lib/localkube/certs/apiserver-kubelet-client.crt --secure-port=8443 --authorization-mode=Node,RBAC --etcd-servers=https://127.0.0.1:2379 --etcd-cafile=/var/lib/localkube/certs/etcd/ca.crt --etcd-certfile=/var/lib/localkube/certs/apiserver-etcd-client.crt --etcd-keyfile=/var/lib/localkube/certs/apiserver-etcd-client.key] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:250 scale:-3} d:{Dec:<nil>} s:250m Format:DecimalSI}]} VolumeMounts:[{Name:k8s-certs ReadOnly:true MountPath:/var/lib/localkube/certs/ SubPath: MountPropagation:<nil>} {Name:ca-certs ReadOnly:true MountPath:/etc/ssl/certs SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:8443,Host:192.168.39.215,Scheme:HTTPS,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:15,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:51:03 minikube kubelet[2352]: I0925 13:51:03.013323    2352 kuberuntime_manager.go:757] checking backoff for container "kube-apiserver" in pod "kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)"
Sep 25 13:51:03 minikube kubelet[2352]: I0925 13:51:03.013396    2352 kuberuntime_manager.go:767] Back-off 20s restarting failed container=kube-apiserver pod=kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)
Sep 25 13:51:03 minikube kubelet[2352]: E0925 13:51:03.013426    2352 pod_workers.go:186] Error syncing pod f95139897976f5cdaccd4d20cad1cd20 ("kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)"), skipping: failed to "StartContainer" for "kube-apiserver" with CrashLoopBackOff: "Back-off 20s restarting failed container=kube-apiserver pod=kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)"
Sep 25 13:51:03 minikube kubelet[2352]: I0925 13:51:03.038214    2352 kuberuntime_manager.go:513] Container {Name:kube-scheduler Image:k8s.gcr.io/kube-scheduler-amd64:v1.10.0 Command:[kube-scheduler --address=127.0.0.1 --leader-elect=true --kubeconfig=/etc/kubernetes/scheduler.conf] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:100 scale:-3} d:{Dec:<nil>} s:100m Format:DecimalSI}]} VolumeMounts:[{Name:kubeconfig ReadOnly:true MountPath:/etc/kubernetes/scheduler.conf SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10251,Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:15,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:51:03 minikube kubelet[2352]: I0925 13:51:03.038307    2352 kuberuntime_manager.go:757] checking backoff for container "kube-scheduler" in pod "kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"
Sep 25 13:51:03 minikube kubelet[2352]: I0925 13:51:03.038390    2352 kuberuntime_manager.go:767] Back-off 20s restarting failed container=kube-scheduler pod=kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)
Sep 25 13:51:03 minikube kubelet[2352]: E0925 13:51:03.038408    2352 pod_workers.go:186] Error syncing pod 31cf0ccbee286239d451edb6fb511513 ("kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"), skipping: failed to "StartContainer" for "kube-scheduler" with CrashLoopBackOff: "Back-off 20s restarting failed container=kube-scheduler pod=kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"
Sep 25 13:51:03 minikube kubelet[2352]: I0925 13:51:03.052985    2352 kuberuntime_manager.go:513] Container {Name:kube-controller-manager Image:k8s.gcr.io/kube-controller-manager-amd64:v1.10.0 Command:[kube-controller-manager --address=127.0.0.1 --leader-elect=true --kubeconfig=/etc/kubernetes/controller-manager.conf --cluster-signing-cert-file=/var/lib/localkube/certs/ca.crt --cluster-signing-key-file=/var/lib/localkube/certs/ca.key --use-service-account-credentials=true --controllers=*,bootstrapsigner,tokencleaner --root-ca-file=/var/lib/localkube/certs/ca.crt --service-account-private-key-file=/var/lib/localkube/certs/sa.key] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:200 scale:-3} d:{Dec:<nil>} s:200m Format:DecimalSI}]} VolumeMounts:[{Name:k8s-certs ReadOnly:true MountPath:/var/lib/localkube/certs/ SubPath: MountPropagation:<nil>} {Name:ca-certs ReadOnly:true MountPath:/etc/ssl/certs SubPath: MountPropagation:<nil>} {Name:kubeconfig ReadOnly:true MountPath:/etc/kubernetes/controller-manager.conf SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10252,Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:15,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:51:03 minikube kubelet[2352]: I0925 13:51:03.053108    2352 kuberuntime_manager.go:757] checking backoff for container "kube-controller-manager" in pod "kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)"
Sep 25 13:51:03 minikube kubelet[2352]: I0925 13:51:03.053184    2352 kuberuntime_manager.go:767] Back-off 10s restarting failed container=kube-controller-manager pod=kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)
Sep 25 13:51:03 minikube kubelet[2352]: E0925 13:51:03.053204    2352 pod_workers.go:186] Error syncing pod d983b689a33fabc72d2e575ce92ad03e ("kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)"), skipping: failed to "StartContainer" for "kube-controller-manager" with CrashLoopBackOff: "Back-off 10s restarting failed container=kube-controller-manager pod=kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)"
Sep 25 13:51:03 minikube kubelet[2352]: E0925 13:51:03.623223    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:03 minikube kubelet[2352]: E0925 13:51:03.821271    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:04 minikube kubelet[2352]: W0925 13:51:04.021322    2352 status_manager.go:461] Failed to get status for pod "kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:04 minikube kubelet[2352]: I0925 13:51:04.091999    2352 kuberuntime_manager.go:513] Container {Name:kube-apiserver Image:k8s.gcr.io/kube-apiserver-amd64:v1.10.0 Command:[kube-apiserver --admission-control=Initializers,NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota --requestheader-allowed-names=front-proxy-client --service-cluster-ip-range=10.96.0.0/12 --service-account-key-file=/var/lib/localkube/certs/sa.pub --tls-private-key-file=/var/lib/localkube/certs/apiserver.key --requestheader-client-ca-file=/var/lib/localkube/certs/front-proxy-ca.crt --enable-bootstrap-token-auth=true --allow-privileged=true --requestheader-group-headers=X-Remote-Group --kubelet-client-key=/var/lib/localkube/certs/apiserver-kubelet-client.key --proxy-client-key-file=/var/lib/localkube/certs/front-proxy-client.key --requestheader-username-headers=X-Remote-User --advertise-address=192.168.39.215 --client-ca-file=/var/lib/localkube/certs/ca.crt --proxy-client-cert-file=/var/lib/localkube/certs/front-proxy-client.crt --insecure-port=0 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --tls-cert-file=/var/lib/localkube/certs/apiserver.crt --kubelet-client-certificate=/var/lib/localkube/certs/apiserver-kubelet-client.crt --secure-port=8443 --authorization-mode=Node,RBAC --etcd-servers=https://127.0.0.1:2379 --etcd-cafile=/var/lib/localkube/certs/etcd/ca.crt --etcd-certfile=/var/lib/localkube/certs/apiserver-etcd-client.crt --etcd-keyfile=/var/lib/localkube/certs/apiserver-etcd-client.key] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:250 scale:-3} d:{Dec:<nil>} s:250m Format:DecimalSI}]} VolumeMounts:[{Name:k8s-certs ReadOnly:true MountPath:/var/lib/localkube/certs/ SubPath: MountPropagation:<nil>} {Name:ca-certs ReadOnly:true MountPath:/etc/ssl/certs SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:8443,Host:192.168.39.215,Scheme:HTTPS,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:15,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:51:04 minikube kubelet[2352]: I0925 13:51:04.092097    2352 kuberuntime_manager.go:757] checking backoff for container "kube-apiserver" in pod "kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)"
Sep 25 13:51:04 minikube kubelet[2352]: I0925 13:51:04.092179    2352 kuberuntime_manager.go:767] Back-off 20s restarting failed container=kube-apiserver pod=kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)
Sep 25 13:51:04 minikube kubelet[2352]: E0925 13:51:04.092196    2352 pod_workers.go:186] Error syncing pod f95139897976f5cdaccd4d20cad1cd20 ("kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)"), skipping: failed to "StartContainer" for "kube-apiserver" with CrashLoopBackOff: "Back-off 20s restarting failed container=kube-apiserver pod=kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)"
Sep 25 13:51:04 minikube kubelet[2352]: E0925 13:51:04.421249    2352 configmap.go:205] Couldn't get configMap kube-system/kube-dns: Get https://localhost:8443/api/v1/namespaces/kube-system/configmaps/kube-dns: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:04 minikube kubelet[2352]: E0925 13:51:04.421341    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:51:05.4213187 +0000 UTC m=+6607.409579056 (durationBeforeRetry 1s). Error: "MountVolume.SetUp failed for volume \"kube-dns-config\" (UniqueName: \"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : Get https://localhost:8443/api/v1/namespaces/kube-system/configmaps/kube-dns: dial tcp 127.0.0.1:8443: getsockopt: connection refused"
Sep 25 13:51:04 minikube kubelet[2352]: E0925 13:51:04.621460    2352 secret.go:204] Couldn't get secret kube-system/kube-dns-token-jgxf6: Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/kube-dns-token-jgxf6: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:04 minikube kubelet[2352]: E0925 13:51:04.621653    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:51:05.621616928 +0000 UTC m=+6607.609877279 (durationBeforeRetry 1s). Error: "MountVolume.SetUp failed for volume \"kube-dns-token-jgxf6\" (UniqueName: \"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/kube-dns-token-jgxf6: dial tcp 127.0.0.1:8443: getsockopt: connection refused"
Sep 25 13:51:05 minikube kubelet[2352]: E0925 13:51:05.021363    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:05 minikube kubelet[2352]: W0925 13:51:05.221389    2352 status_manager.go:461] Failed to get status for pod "kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:05 minikube kubelet[2352]: I0925 13:51:05.235666    2352 kuberuntime_manager.go:513] Container {Name:kube-controller-manager Image:k8s.gcr.io/kube-controller-manager-amd64:v1.10.0 Command:[kube-controller-manager --address=127.0.0.1 --leader-elect=true --kubeconfig=/etc/kubernetes/controller-manager.conf --cluster-signing-cert-file=/var/lib/localkube/certs/ca.crt --cluster-signing-key-file=/var/lib/localkube/certs/ca.key --use-service-account-credentials=true --controllers=*,bootstrapsigner,tokencleaner --root-ca-file=/var/lib/localkube/certs/ca.crt --service-account-private-key-file=/var/lib/localkube/certs/sa.key] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:200 scale:-3} d:{Dec:<nil>} s:200m Format:DecimalSI}]} VolumeMounts:[{Name:k8s-certs ReadOnly:true MountPath:/var/lib/localkube/certs/ SubPath: MountPropagation:<nil>} {Name:ca-certs ReadOnly:true MountPath:/etc/ssl/certs SubPath: MountPropagation:<nil>} {Name:kubeconfig ReadOnly:true MountPath:/etc/kubernetes/controller-manager.conf SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10252,Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:15,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:51:05 minikube kubelet[2352]: I0925 13:51:05.235800    2352 kuberuntime_manager.go:757] checking backoff for container "kube-controller-manager" in pod "kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)"
Sep 25 13:51:05 minikube kubelet[2352]: I0925 13:51:05.235932    2352 kuberuntime_manager.go:767] Back-off 10s restarting failed container=kube-controller-manager pod=kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)
Sep 25 13:51:05 minikube kubelet[2352]: E0925 13:51:05.235973    2352 pod_workers.go:186] Error syncing pod d983b689a33fabc72d2e575ce92ad03e ("kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)"), skipping: failed to "StartContainer" for "kube-controller-manager" with CrashLoopBackOff: "Back-off 10s restarting failed container=kube-controller-manager pod=kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)"
Sep 25 13:51:05 minikube kubelet[2352]: E0925 13:51:05.621500    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:05 minikube kubelet[2352]: E0925 13:51:05.821327    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:06 minikube kubelet[2352]: W0925 13:51:06.222040    2352 status_manager.go:461] Failed to get status for pod "kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:06 minikube kubelet[2352]: I0925 13:51:06.223931    2352 kuberuntime_manager.go:513] Container {Name:kube-scheduler Image:k8s.gcr.io/kube-scheduler-amd64:v1.10.0 Command:[kube-scheduler --address=127.0.0.1 --leader-elect=true --kubeconfig=/etc/kubernetes/scheduler.conf] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:100 scale:-3} d:{Dec:<nil>} s:100m Format:DecimalSI}]} VolumeMounts:[{Name:kubeconfig ReadOnly:true MountPath:/etc/kubernetes/scheduler.conf SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10251,Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:15,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:51:06 minikube kubelet[2352]: I0925 13:51:06.228431    2352 kuberuntime_manager.go:757] checking backoff for container "kube-scheduler" in pod "kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"
Sep 25 13:51:06 minikube kubelet[2352]: I0925 13:51:06.228682    2352 kuberuntime_manager.go:767] Back-off 20s restarting failed container=kube-scheduler pod=kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)
Sep 25 13:51:06 minikube kubelet[2352]: E0925 13:51:06.228744    2352 pod_workers.go:186] Error syncing pod 31cf0ccbee286239d451edb6fb511513 ("kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"), skipping: failed to "StartContainer" for "kube-scheduler" with CrashLoopBackOff: "Back-off 20s restarting failed container=kube-scheduler pod=kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"
Sep 25 13:51:06 minikube kubelet[2352]: E0925 13:51:06.421327    2352 configmap.go:205] Couldn't get configMap kube-system/kube-dns: Get https://localhost:8443/api/v1/namespaces/kube-system/configmaps/kube-dns: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:06 minikube kubelet[2352]: E0925 13:51:06.421412    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:51:08.421390861 +0000 UTC m=+6610.409651212 (durationBeforeRetry 2s). Error: "MountVolume.SetUp failed for volume \"kube-dns-config\" (UniqueName: \"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : Get https://localhost:8443/api/v1/namespaces/kube-system/configmaps/kube-dns: dial tcp 127.0.0.1:8443: getsockopt: connection refused"
Sep 25 13:51:06 minikube kubelet[2352]: E0925 13:51:06.622930    2352 secret.go:204] Couldn't get secret kube-system/kube-dns-token-jgxf6: Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/kube-dns-token-jgxf6: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:06 minikube kubelet[2352]: E0925 13:51:06.624184    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:51:08.623989897 +0000 UTC m=+6610.612250503 (durationBeforeRetry 2s). Error: "MountVolume.SetUp failed for volume \"kube-dns-token-jgxf6\" (UniqueName: \"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/kube-dns-token-jgxf6: dial tcp 127.0.0.1:8443: getsockopt: connection refused"
Sep 25 13:51:06 minikube kubelet[2352]: E0925 13:51:06.822355    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:07 minikube kubelet[2352]: W0925 13:51:07.022390    2352 status_manager.go:461] Failed to get status for pod "kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:07 minikube kubelet[2352]: E0925 13:51:07.221377    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:07 minikube kubelet[2352]: E0925 13:51:07.421892    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:07 minikube kubelet[2352]: W0925 13:51:07.622957    2352 status_manager.go:461] Failed to get status for pod "kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:07 minikube kubelet[2352]: W0925 13:51:07.822006    2352 status_manager.go:461] Failed to get status for pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-dns-86f4d74b45-f42gd: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:08 minikube kubelet[2352]: W0925 13:51:08.022458    2352 status_manager.go:461] Failed to get status for pod "kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:08 minikube kubelet[2352]: E0925 13:51:08.222243    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:08 minikube kubelet[2352]: W0925 13:51:08.422329    2352 status_manager.go:461] Failed to get status for pod "kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:08 minikube kubelet[2352]: E0925 13:51:08.622524    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:08 minikube kubelet[2352]: E0925 13:51:08.822020    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:09 minikube kubelet[2352]: W0925 13:51:09.021934    2352 status_manager.go:461] Failed to get status for pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-dns-86f4d74b45-f42gd: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:09 minikube kubelet[2352]: E0925 13:51:09.221457    2352 configmap.go:205] Couldn't get configMap kube-system/kube-dns: Get https://localhost:8443/api/v1/namespaces/kube-system/configmaps/kube-dns: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:09 minikube kubelet[2352]: E0925 13:51:09.221580    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:51:13.221546017 +0000 UTC m=+6615.209806401 (durationBeforeRetry 4s). Error: "MountVolume.SetUp failed for volume \"kube-dns-config\" (UniqueName: \"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : Get https://localhost:8443/api/v1/namespaces/kube-system/configmaps/kube-dns: dial tcp 127.0.0.1:8443: getsockopt: connection refused"
Sep 25 13:51:09 minikube kubelet[2352]: E0925 13:51:09.422052    2352 secret.go:204] Couldn't get secret kube-system/kube-dns-token-jgxf6: Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/kube-dns-token-jgxf6: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:09 minikube kubelet[2352]: E0925 13:51:09.422418    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:51:13.422309975 +0000 UTC m=+6615.410570436 (durationBeforeRetry 4s). Error: "MountVolume.SetUp failed for volume \"kube-dns-token-jgxf6\" (UniqueName: \"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/kube-dns-token-jgxf6: dial tcp 127.0.0.1:8443: getsockopt: connection refused"
Sep 25 13:51:09 minikube kubelet[2352]: W0925 13:51:09.621289    2352 status_manager.go:461] Failed to get status for pod "kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:09 minikube kubelet[2352]: E0925 13:51:09.822488    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:10 minikube kubelet[2352]: W0925 13:51:10.022212    2352 status_manager.go:461] Failed to get status for pod "kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:10 minikube kubelet[2352]: E0925 13:51:10.222335    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:10 minikube kubelet[2352]: E0925 13:51:10.421877    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:10 minikube kubelet[2352]: E0925 13:51:10.824210    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:11 minikube kubelet[2352]: E0925 13:51:11.224409    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:11 minikube kubelet[2352]: E0925 13:51:11.424319    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:11 minikube kubelet[2352]: E0925 13:51:11.826173    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:12 minikube kubelet[2352]: E0925 13:51:12.226701    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:12 minikube kubelet[2352]: E0925 13:51:12.312398    2352 event.go:209] Unable to write event: 'Patch https://localhost:8443/api/v1/namespaces/kube-system/events/kube-controller-manager-minikube.1557a87319670e7b: dial tcp 127.0.0.1:8443: getsockopt: connection refused' (may retry after sleeping)
Sep 25 13:51:12 minikube kubelet[2352]: E0925 13:51:12.426855    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:12 minikube kubelet[2352]: E0925 13:51:12.664390    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?resourceVersion=0&timeout=10s: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:12 minikube kubelet[2352]: E0925 13:51:12.665144    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:12 minikube kubelet[2352]: E0925 13:51:12.665828    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:12 minikube kubelet[2352]: E0925 13:51:12.666513    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:12 minikube kubelet[2352]: E0925 13:51:12.667129    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:12 minikube kubelet[2352]: E0925 13:51:12.667393    2352 kubelet_node_status.go:366] Unable to update node status: update node status exceeds retry count
Sep 25 13:51:12 minikube kubelet[2352]: E0925 13:51:12.836453    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:13 minikube kubelet[2352]: E0925 13:51:13.227577    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:13 minikube kubelet[2352]: E0925 13:51:13.246215    2352 configmap.go:205] Couldn't get configMap kube-system/kube-dns: Get https://localhost:8443/api/v1/namespaces/kube-system/configmaps/kube-dns: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:13 minikube kubelet[2352]: E0925 13:51:13.246296    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:51:21.246271676 +0000 UTC m=+6623.234532039 (durationBeforeRetry 8s). Error: "MountVolume.SetUp failed for volume \"kube-dns-config\" (UniqueName: \"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : Get https://localhost:8443/api/v1/namespaces/kube-system/configmaps/kube-dns: dial tcp 127.0.0.1:8443: getsockopt: connection refused"
Sep 25 13:51:13 minikube kubelet[2352]: E0925 13:51:13.428611    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:13 minikube kubelet[2352]: E0925 13:51:13.447752    2352 secret.go:204] Couldn't get secret kube-system/kube-dns-token-jgxf6: Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/kube-dns-token-jgxf6: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:13 minikube kubelet[2352]: E0925 13:51:13.448216    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:51:21.448138483 +0000 UTC m=+6623.436398934 (durationBeforeRetry 8s). Error: "MountVolume.SetUp failed for volume \"kube-dns-token-jgxf6\" (UniqueName: \"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/kube-dns-token-jgxf6: dial tcp 127.0.0.1:8443: getsockopt: connection refused"
Sep 25 13:51:13 minikube kubelet[2352]: E0925 13:51:13.840074    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:13 minikube kubelet[2352]: I0925 13:51:13.855435    2352 kuberuntime_manager.go:757] checking backoff for container "kubedns" in pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)"
Sep 25 13:51:14 minikube kubelet[2352]: W0925 13:51:14.138719    2352 status_manager.go:461] Failed to get status for pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-dns-86f4d74b45-f42gd: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:14 minikube kubelet[2352]: E0925 13:51:14.228072    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:14 minikube kubelet[2352]: E0925 13:51:14.429707    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:14 minikube kubelet[2352]: E0925 13:51:14.840632    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:15 minikube kubelet[2352]: E0925 13:51:15.229048    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:15 minikube kubelet[2352]: E0925 13:51:15.431066    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:15 minikube kubelet[2352]: E0925 13:51:15.842627    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:16 minikube kubelet[2352]: E0925 13:51:16.229590    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:16 minikube kubelet[2352]: E0925 13:51:16.432599    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:16 minikube kubelet[2352]: E0925 13:51:16.844277    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:17 minikube kubelet[2352]: E0925 13:51:17.231026    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:17 minikube kubelet[2352]: E0925 13:51:17.433508    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:17 minikube kubelet[2352]: E0925 13:51:17.847597    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:18 minikube kubelet[2352]: W0925 13:51:18.110990    2352 status_manager.go:461] Failed to get status for pod "kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:18 minikube kubelet[2352]: W0925 13:51:18.111642    2352 status_manager.go:461] Failed to get status for pod "kube-dns-86f4d74b45-f42gd_kube-system(c97cc72e-c0ba-11e8-9240-242a6da44cca)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-dns-86f4d74b45-f42gd: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:18 minikube kubelet[2352]: W0925 13:51:18.114801    2352 status_manager.go:461] Failed to get status for pod "kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:18 minikube kubelet[2352]: W0925 13:51:18.116408    2352 status_manager.go:461] Failed to get status for pod "kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:18 minikube kubelet[2352]: E0925 13:51:18.233427    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:18 minikube kubelet[2352]: I0925 13:51:18.413410    2352 kuberuntime_manager.go:513] Container {Name:kube-controller-manager Image:k8s.gcr.io/kube-controller-manager-amd64:v1.10.0 Command:[kube-controller-manager --address=127.0.0.1 --leader-elect=true --kubeconfig=/etc/kubernetes/controller-manager.conf --cluster-signing-cert-file=/var/lib/localkube/certs/ca.crt --cluster-signing-key-file=/var/lib/localkube/certs/ca.key --use-service-account-credentials=true --controllers=*,bootstrapsigner,tokencleaner --root-ca-file=/var/lib/localkube/certs/ca.crt --service-account-private-key-file=/var/lib/localkube/certs/sa.key] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:200 scale:-3} d:{Dec:<nil>} s:200m Format:DecimalSI}]} VolumeMounts:[{Name:k8s-certs ReadOnly:true MountPath:/var/lib/localkube/certs/ SubPath: MountPropagation:<nil>} {Name:ca-certs ReadOnly:true MountPath:/etc/ssl/certs SubPath: MountPropagation:<nil>} {Name:kubeconfig ReadOnly:true MountPath:/etc/kubernetes/controller-manager.conf SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10252,Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:15,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:51:18 minikube kubelet[2352]: I0925 13:51:18.413705    2352 kuberuntime_manager.go:757] checking backoff for container "kube-controller-manager" in pod "kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)"
Sep 25 13:51:18 minikube kubelet[2352]: I0925 13:51:18.419411    2352 kuberuntime_manager.go:513] Container {Name:kube-apiserver Image:k8s.gcr.io/kube-apiserver-amd64:v1.10.0 Command:[kube-apiserver --admission-control=Initializers,NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota --requestheader-allowed-names=front-proxy-client --service-cluster-ip-range=10.96.0.0/12 --service-account-key-file=/var/lib/localkube/certs/sa.pub --tls-private-key-file=/var/lib/localkube/certs/apiserver.key --requestheader-client-ca-file=/var/lib/localkube/certs/front-proxy-ca.crt --enable-bootstrap-token-auth=true --allow-privileged=true --requestheader-group-headers=X-Remote-Group --kubelet-client-key=/var/lib/localkube/certs/apiserver-kubelet-client.key --proxy-client-key-file=/var/lib/localkube/certs/front-proxy-client.key --requestheader-username-headers=X-Remote-User --advertise-address=192.168.39.215 --client-ca-file=/var/lib/localkube/certs/ca.crt --proxy-client-cert-file=/var/lib/localkube/certs/front-proxy-client.crt --insecure-port=0 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --requestheader-extra-headers-prefix=X-Remote-Extra- --tls-cert-file=/var/lib/localkube/certs/apiserver.crt --kubelet-client-certificate=/var/lib/localkube/certs/apiserver-kubelet-client.crt --secure-port=8443 --authorization-mode=Node,RBAC --etcd-servers=https://127.0.0.1:2379 --etcd-cafile=/var/lib/localkube/certs/etcd/ca.crt --etcd-certfile=/var/lib/localkube/certs/apiserver-etcd-client.crt --etcd-keyfile=/var/lib/localkube/certs/apiserver-etcd-client.key] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:250 scale:-3} d:{Dec:<nil>} s:250m Format:DecimalSI}]} VolumeMounts:[{Name:k8s-certs ReadOnly:true MountPath:/var/lib/localkube/certs/ SubPath: MountPropagation:<nil>} {Name:ca-certs ReadOnly:true MountPath:/etc/ssl/certs SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:8443,Host:192.168.39.215,Scheme:HTTPS,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:15,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:51:18 minikube kubelet[2352]: I0925 13:51:18.419648    2352 kuberuntime_manager.go:757] checking backoff for container "kube-apiserver" in pod "kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)"
Sep 25 13:51:18 minikube kubelet[2352]: I0925 13:51:18.419928    2352 kuberuntime_manager.go:767] Back-off 20s restarting failed container=kube-apiserver pod=kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)
Sep 25 13:51:18 minikube kubelet[2352]: E0925 13:51:18.419990    2352 pod_workers.go:186] Error syncing pod f95139897976f5cdaccd4d20cad1cd20 ("kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)"), skipping: failed to "StartContainer" for "kube-apiserver" with CrashLoopBackOff: "Back-off 20s restarting failed container=kube-apiserver pod=kube-apiserver-minikube_kube-system(f95139897976f5cdaccd4d20cad1cd20)"
Sep 25 13:51:18 minikube kubelet[2352]: E0925 13:51:18.440709    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:18 minikube kubelet[2352]: E0925 13:51:18.849034    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:19 minikube kubelet[2352]: E0925 13:51:19.238581    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:19 minikube kubelet[2352]: W0925 13:51:19.279890    2352 status_manager.go:461] Failed to get status for pod "kube-controller-manager-minikube_kube-system(d983b689a33fabc72d2e575ce92ad03e)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:19 minikube kubelet[2352]: I0925 13:51:19.410625    2352 kuberuntime_manager.go:513] Container {Name:kube-scheduler Image:k8s.gcr.io/kube-scheduler-amd64:v1.10.0 Command:[kube-scheduler --address=127.0.0.1 --leader-elect=true --kubeconfig=/etc/kubernetes/scheduler.conf] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:100 scale:-3} d:{Dec:<nil>} s:100m Format:DecimalSI}]} VolumeMounts:[{Name:kubeconfig ReadOnly:true MountPath:/etc/kubernetes/scheduler.conf SubPath: MountPropagation:<nil>}] VolumeDevices:[] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthz,Port:10251,Host:127.0.0.1,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:15,TimeoutSeconds:15,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:8,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.
Sep 25 13:51:19 minikube kubelet[2352]: I0925 13:51:19.411052    2352 kuberuntime_manager.go:757] checking backoff for container "kube-scheduler" in pod "kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"
Sep 25 13:51:19 minikube kubelet[2352]: I0925 13:51:19.411515    2352 kuberuntime_manager.go:767] Back-off 20s restarting failed container=kube-scheduler pod=kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)
Sep 25 13:51:19 minikube kubelet[2352]: E0925 13:51:19.411614    2352 pod_workers.go:186] Error syncing pod 31cf0ccbee286239d451edb6fb511513 ("kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"), skipping: failed to "StartContainer" for "kube-scheduler" with CrashLoopBackOff: "Back-off 20s restarting failed container=kube-scheduler pod=kube-scheduler-minikube_kube-system(31cf0ccbee286239d451edb6fb511513)"
Sep 25 13:51:19 minikube kubelet[2352]: E0925 13:51:19.442192    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:19 minikube kubelet[2352]: E0925 13:51:19.850715    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:20 minikube kubelet[2352]: E0925 13:51:20.239951    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:20 minikube kubelet[2352]: E0925 13:51:20.443869    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:20 minikube kubelet[2352]: E0925 13:51:20.851830    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:21 minikube kubelet[2352]: E0925 13:51:21.241720    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:21 minikube kubelet[2352]: E0925 13:51:21.312906    2352 configmap.go:205] Couldn't get configMap kube-system/kube-dns: Get https://localhost:8443/api/v1/namespaces/kube-system/configmaps/kube-dns: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:21 minikube kubelet[2352]: E0925 13:51:21.313793    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:51:37.313692376 +0000 UTC m=+6639.301952808 (durationBeforeRetry 16s). Error: "MountVolume.SetUp failed for volume \"kube-dns-config\" (UniqueName: \"kubernetes.io/configmap/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-config\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : Get https://localhost:8443/api/v1/namespaces/kube-system/configmaps/kube-dns: dial tcp 127.0.0.1:8443: getsockopt: connection refused"
Sep 25 13:51:21 minikube kubelet[2352]: E0925 13:51:21.445843    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:21 minikube kubelet[2352]: E0925 13:51:21.514564    2352 secret.go:204] Couldn't get secret kube-system/kube-dns-token-jgxf6: Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/kube-dns-token-jgxf6: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:21 minikube kubelet[2352]: E0925 13:51:21.514812    2352 nestedpendingoperations.go:267] Operation for "\"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\" (\"c97cc72e-c0ba-11e8-9240-242a6da44cca\")" failed. No retries permitted until 2018-09-25 13:51:37.514733932 +0000 UTC m=+6639.502994371 (durationBeforeRetry 16s). Error: "MountVolume.SetUp failed for volume \"kube-dns-token-jgxf6\" (UniqueName: \"kubernetes.io/secret/c97cc72e-c0ba-11e8-9240-242a6da44cca-kube-dns-token-jgxf6\") pod \"kube-dns-86f4d74b45-f42gd\" (UID: \"c97cc72e-c0ba-11e8-9240-242a6da44cca\") : Get https://localhost:8443/api/v1/namespaces/kube-system/secrets/kube-dns-token-jgxf6: dial tcp 127.0.0.1:8443: getsockopt: connection refused"
Sep 25 13:51:21 minikube kubelet[2352]: E0925 13:51:21.859613    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:22 minikube kubelet[2352]: E0925 13:51:22.244336    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:22 minikube kubelet[2352]: E0925 13:51:22.313548    2352 event.go:209] Unable to write event: 'Patch https://localhost:8443/api/v1/namespaces/kube-system/events/kube-controller-manager-minikube.1557a87319670e7b: dial tcp 127.0.0.1:8443: getsockopt: connection refused' (may retry after sleeping)
Sep 25 13:51:22 minikube kubelet[2352]: E0925 13:51:22.447042    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:22 minikube kubelet[2352]: E0925 13:51:22.667916    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?resourceVersion=0&timeout=10s: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:22 minikube kubelet[2352]: E0925 13:51:22.668033    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:22 minikube kubelet[2352]: E0925 13:51:22.668232    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:22 minikube kubelet[2352]: E0925 13:51:22.668337    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:22 minikube kubelet[2352]: E0925 13:51:22.668516    2352 kubelet_node_status.go:374] Error updating node status, will retry: error getting node "minikube": Get https://localhost:8443/api/v1/nodes/minikube?timeout=10s: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:22 minikube kubelet[2352]: E0925 13:51:22.668522    2352 kubelet_node_status.go:366] Unable to update node status: update node status exceeds retry count
Sep 25 13:51:22 minikube kubelet[2352]: E0925 13:51:22.860671    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:23 minikube kubelet[2352]: E0925 13:51:23.245234    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:23 minikube kubelet[2352]: E0925 13:51:23.447971    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:23 minikube kubelet[2352]: E0925 13:51:23.861177    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:24 minikube kubelet[2352]: E0925 13:51:24.247431    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:24 minikube kubelet[2352]: E0925 13:51:24.448729    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:24 minikube kubelet[2352]: E0925 13:51:24.862548    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:25 minikube kubelet[2352]: E0925 13:51:25.248946    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:25 minikube kubelet[2352]: E0925 13:51:25.450202    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:25 minikube kubelet[2352]: E0925 13:51:25.863971    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:26 minikube kubelet[2352]: E0925 13:51:26.249774    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:26 minikube kubelet[2352]: E0925 13:51:26.452354    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Sep 25 13:51:26 minikube kubelet[2352]: E0925 13:51:26.865267    2352 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused