search

kubernetes / minikube

Run Kubernetes locally
https://minikube.sigs.k8s.io/
Apache License 2.0
29.45k stars 4.88k forks source link

Adding corporate certs does not allow for external requests #2618

Closed erip closed 6 years ago

erip commented 6 years ago

Environment:

What happened:

# start minikube
$ minikube start --vm-driver=xhyve --docker-env HTTP_PROXY="$http_proxy" --docker-env HTTPS_PROXY="$https_proxy"
$
$
# add corporate certs to minikube VM
$ minikube ssh
                         _             _
            _         _ ( )           ( )
  ___ ___  (_)  ___  (_)| |/')  _   _ | |_      __
/' _ ` _ `\| |/' _ `\| || , <  ( ) ( )| '_`\  /'__`\
| ( ) ( ) || || ( ) || || |\`\ | (_) || |_) )(  ___/
(_) (_) (_)(_)(_) (_)(_)(_) (_)`\___/'(_,__/'`\____)

$ sudo su
$ cd /tmp
$ wget www.example.com/root.crt
$ cat root.crt >> /etc/ssl/certs/ca-certificates.crt
$ cp *.crt /etc/ssl/certs/
$ systemctl restart docker.service
$ exit
$
$
# try to run echo pod
$ kubectl run hello-minikube --image=k8s.gcr.io/echoserver:1.4 --port=8080
error: failed to discover supported resources: Get https://xxx.xxx.xx.x:8443/apis/extensions/v1beta1: Gateway Timeout

What you expected to happen:

A successful creation of a deployment.

How to reproduce it (as minimally and precisely as possible):

Difficult since it's environment-specific...

Output of minikube logs (if applicable):

-- Logs begin at Tue 2018-03-20 11:51:47 UTC, end at Tue 2018-03-20 12:06:25 UTC. --
Mar 20 11:51:57 minikube systemd[1]: Starting Localkube...
Mar 20 11:51:57 minikube localkube[2848]: listening for peers on http://localhost:2380
Mar 20 11:51:57 minikube localkube[2848]: listening for client requests on localhost:2379
Mar 20 11:51:57 minikube localkube[2848]: name = default
Mar 20 11:51:57 minikube localkube[2848]: data dir = /var/lib/localkube/etcd
Mar 20 11:51:57 minikube localkube[2848]: member dir = /var/lib/localkube/etcd/member
Mar 20 11:51:57 minikube localkube[2848]: heartbeat = 100ms
Mar 20 11:51:57 minikube localkube[2848]: election = 1000ms
Mar 20 11:51:57 minikube localkube[2848]: snapshot count = 10000
Mar 20 11:51:57 minikube localkube[2848]: advertise client URLs = http://localhost:2379
Mar 20 11:51:57 minikube localkube[2848]: initial advertise peer URLs = http://localhost:2380
Mar 20 11:51:57 minikube localkube[2848]: initial cluster = default=http://localhost:2380
Mar 20 11:51:57 minikube localkube[2848]: starting member 8e9e05c52164694d in cluster cdf818194e3a8c32
Mar 20 11:51:57 minikube localkube[2848]: 8e9e05c52164694d became follower at term 0
Mar 20 11:51:57 minikube localkube[2848]: newRaft 8e9e05c52164694d [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
Mar 20 11:51:57 minikube localkube[2848]: 8e9e05c52164694d became follower at term 1
Mar 20 11:51:57 minikube localkube[2848]: starting server... [version: 3.1.10, cluster version: to_be_decided]
Mar 20 11:51:57 minikube localkube[2848]: added member 8e9e05c52164694d [http://localhost:2380] to cluster cdf818194e3a8c32
Mar 20 11:51:58 minikube localkube[2848]: 8e9e05c52164694d is starting a new election at term 1
Mar 20 11:51:58 minikube localkube[2848]: 8e9e05c52164694d became candidate at term 2
Mar 20 11:51:58 minikube localkube[2848]: 8e9e05c52164694d received MsgVoteResp from 8e9e05c52164694d at term 2
Mar 20 11:51:58 minikube localkube[2848]: 8e9e05c52164694d became leader at term 2
Mar 20 11:51:58 minikube localkube[2848]: raft.node: 8e9e05c52164694d elected leader 8e9e05c52164694d at term 2
Mar 20 11:51:58 minikube localkube[2848]: published {Name:default ClientURLs:[http://localhost:2379]} to cluster cdf818194e3a8c32
Mar 20 11:51:58 minikube localkube[2848]: I0320 11:51:58.221582    2848 etcd.go:58] Etcd server is ready
Mar 20 11:51:58 minikube localkube[2848]: localkube host ip address: xxx.xxx.xx.x
Mar 20 11:51:58 minikube localkube[2848]: Starting apiserver...
Mar 20 11:51:58 minikube localkube[2848]: Waiting for apiserver to be healthy...
Mar 20 11:51:58 minikube localkube[2848]: I0320 11:51:58.223037    2848 server.go:121] Version: v1.9.0
Mar 20 11:51:58 minikube localkube[2848]: W0320 11:51:58.223352    2848 authentication.go:378] AnonymousAuth is not allowed with the AllowAll authorizer.  Resetting AnonymousAuth to false. You should use a different authorizer
Mar 20 11:51:58 minikube localkube[2848]: setting up the initial cluster version to 3.1
Mar 20 11:51:58 minikube localkube[2848]: ready to serve client requests
Mar 20 11:51:58 minikube localkube[2848]: serving insecure client requests on 127.0.0.1:2379, this is strongly discouraged!
Mar 20 11:51:58 minikube localkube[2848]: set the initial cluster version to 3.1
Mar 20 11:51:58 minikube localkube[2848]: enabled capabilities for version 3.1
Mar 20 11:51:58 minikube localkube[2848]: I0320 11:51:58.819923    2848 master.go:225] Using reconciler: master-count
Mar 20 11:51:59 minikube localkube[2848]: I0320 11:51:59.240439    2848 ready.go:30] Performing healthcheck on https://localhost:8443/healthz
Mar 20 11:51:59 minikube localkube[2848]: [restful] 2018/03/20 11:51:59 log.go:33: [restful/swagger] listing is available at https://xxx.xxx.xx.x:8443/swaggerapi
Mar 20 11:51:59 minikube localkube[2848]: [restful] 2018/03/20 11:51:59 log.go:33: [restful/swagger] https://xxx.xxx.xx.x:8443/swaggerui/ is mapped to folder /swagger-ui/
Mar 20 11:52:00 minikube localkube[2848]: [restful] 2018/03/20 11:52:00 log.go:33: [restful/swagger] listing is available at https://xxx.xxx.xx.x:8443/swaggerapi
Mar 20 11:52:00 minikube localkube[2848]: [restful] 2018/03/20 11:52:00 log.go:33: [restful/swagger] https://xxx.xxx.xx.x:8443/swaggerui/ is mapped to folder /swagger-ui/
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.335802    2848 serve.go:89] Serving securely on [::]:8443
Mar 20 11:52:04 minikube systemd[1]: Started Localkube.
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.337294    2848 controller.go:84] Starting OpenAPI AggregationController
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.337702    2848 available_controller.go:262] Starting AvailableConditionController
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.337732    2848 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.337755    2848 apiservice_controller.go:112] Starting APIServiceRegistrationController
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.337759    2848 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.338432    2848 crd_finalizer.go:242] Starting CRDFinalizer
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.339546    2848 crdregistration_controller.go:110] Starting crd-autoregister controller
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.339572    2848 controller_utils.go:1019] Waiting for caches to sync for crd-autoregister controller
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.339787    2848 customresource_discovery_controller.go:152] Starting DiscoveryController
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.339804    2848 naming_controller.go:274] Starting NamingConditionController
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.372344    2848 ready.go:49] Got healthcheck response: [+]ping ok
Mar 20 11:52:04 minikube localkube[2848]: [+]etcd ok
Mar 20 11:52:04 minikube localkube[2848]: [+]poststarthook/generic-apiserver-start-informers ok
Mar 20 11:52:04 minikube localkube[2848]: [+]poststarthook/start-apiextensions-informers ok
Mar 20 11:52:04 minikube localkube[2848]: [+]poststarthook/start-apiextensions-controllers ok
Mar 20 11:52:04 minikube localkube[2848]: [-]poststarthook/bootstrap-controller failed: reason withheld
Mar 20 11:52:04 minikube localkube[2848]: [-]poststarthook/ca-registration failed: reason withheld
Mar 20 11:52:04 minikube localkube[2848]: [+]poststarthook/start-kube-apiserver-informers ok
Mar 20 11:52:04 minikube localkube[2848]: [+]poststarthook/start-kube-aggregator-informers ok
Mar 20 11:52:04 minikube localkube[2848]: [+]poststarthook/apiservice-registration-controller ok
Mar 20 11:52:04 minikube localkube[2848]: [+]poststarthook/apiservice-status-available-controller ok
Mar 20 11:52:04 minikube localkube[2848]: [+]poststarthook/apiservice-openapi-controller ok
Mar 20 11:52:04 minikube localkube[2848]: [+]poststarthook/kube-apiserver-autoregistration ok
Mar 20 11:52:04 minikube localkube[2848]: [-]autoregister-completion failed: reason withheld
Mar 20 11:52:04 minikube localkube[2848]: healthz check failed
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.438863    2848 cache.go:39] Caches are synced for AvailableConditionController controller
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.439409    2848 cache.go:39] Caches are synced for APIServiceRegistrationController controller
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.439931    2848 controller_utils.go:1026] Caches are synced for crd-autoregister controller
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.440295    2848 autoregister_controller.go:136] Starting autoregister controller
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.440487    2848 cache.go:32] Waiting for caches to sync for autoregister controller
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.491297    2848 controller.go:538] quota admission added evaluator for: { endpoints}
Mar 20 11:52:04 minikube localkube[2848]: I0320 11:52:04.541098    2848 cache.go:39] Caches are synced for autoregister controller
Mar 20 11:52:05 minikube localkube[2848]: I0320 11:52:05.222787    2848 ready.go:30] Performing healthcheck on https://localhost:8443/healthz
Mar 20 11:52:05 minikube localkube[2848]: I0320 11:52:05.235461    2848 ready.go:49] Got healthcheck response: [+]ping ok
Mar 20 11:52:05 minikube localkube[2848]: [+]etcd ok
Mar 20 11:52:05 minikube localkube[2848]: [+]poststarthook/generic-apiserver-start-informers ok
Mar 20 11:52:05 minikube localkube[2848]: [+]poststarthook/start-apiextensions-informers ok
Mar 20 11:52:05 minikube localkube[2848]: [+]poststarthook/start-apiextensions-controllers ok
Mar 20 11:52:05 minikube localkube[2848]: [+]poststarthook/bootstrap-controller ok
Mar 20 11:52:05 minikube localkube[2848]: [-]poststarthook/ca-registration failed: reason withheld
Mar 20 11:52:05 minikube localkube[2848]: [+]poststarthook/start-kube-apiserver-informers ok
Mar 20 11:52:05 minikube localkube[2848]: [+]poststarthook/start-kube-aggregator-informers ok
Mar 20 11:52:05 minikube localkube[2848]: [+]poststarthook/apiservice-registration-controller ok
Mar 20 11:52:05 minikube localkube[2848]: [+]poststarthook/apiservice-status-available-controller ok
Mar 20 11:52:05 minikube localkube[2848]: [+]poststarthook/apiservice-openapi-controller ok
Mar 20 11:52:05 minikube localkube[2848]: [+]poststarthook/kube-apiserver-autoregistration ok
Mar 20 11:52:05 minikube localkube[2848]: [-]autoregister-completion failed: reason withheld
Mar 20 11:52:05 minikube localkube[2848]: healthz check failed
Mar 20 11:52:05 minikube localkube[2848]: I0320 11:52:05.570906    2848 trace.go:76] Trace[939502414]: "Create /apis/apiregistration.k8s.io/v1beta1/apiservices" (started: 2018-03-20 11:52:04.542676878 +0000 UTC m=+7.000489910) (total time: 1.028191831s):
Mar 20 11:52:05 minikube localkube[2848]: Trace[939502414]: [1.028118002s] [1.027465078s] Object stored in database
Mar 20 11:52:05 minikube localkube[2848]: I0320 11:52:05.571793    2848 trace.go:76] Trace[2008199006]: "Create /apis/apiregistration.k8s.io/v1beta1/apiservices" (started: 2018-03-20 11:52:04.542743297 +0000 UTC m=+7.000556329) (total time: 1.029034926s):
Mar 20 11:52:05 minikube localkube[2848]: Trace[2008199006]: [1.028551005s] [1.028283459s] Object stored in database
Mar 20 11:52:05 minikube localkube[2848]: I0320 11:52:05.570942    2848 trace.go:76] Trace[2008419697]: "Create /apis/apiregistration.k8s.io/v1beta1/apiservices" (started: 2018-03-20 11:52:04.542512606 +0000 UTC m=+7.000325638) (total time: 1.028378203s):
Mar 20 11:52:05 minikube localkube[2848]: Trace[2008419697]: [1.028279768s] [1.028109402s] Object stored in database
Mar 20 11:52:05 minikube localkube[2848]: I0320 11:52:05.571206    2848 trace.go:76] Trace[1202812379]: "Create /apis/apiregistration.k8s.io/v1beta1/apiservices" (started: 2018-03-20 11:52:04.542512583 +0000 UTC m=+7.000325614) (total time: 1.028678163s):
Mar 20 11:52:05 minikube localkube[2848]: Trace[1202812379]: [1.028634048s] [1.028214773s] Object stored in database
Mar 20 11:52:05 minikube localkube[2848]: I0320 11:52:05.571270    2848 trace.go:76] Trace[723101692]: "Create /apis/apiregistration.k8s.io/v1beta1/apiservices" (started: 2018-03-20 11:52:04.542604508 +0000 UTC m=+7.000417540) (total time: 1.02865545s):
Mar 20 11:52:05 minikube localkube[2848]: Trace[723101692]: [1.028630712s] [1.028104901s] Object stored in database
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.223165    2848 ready.go:30] Performing healthcheck on https://localhost:8443/healthz
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.235741    2848 ready.go:49] Got healthcheck response: ok
Mar 20 11:52:06 minikube localkube[2848]: apiserver is ready!
Mar 20 11:52:06 minikube localkube[2848]: Starting controller-manager...
Mar 20 11:52:06 minikube localkube[2848]: Waiting for controller-manager to be healthy...
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.236296    2848 controllermanager.go:108] Version: v1.9.0
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.242273    2848 leaderelection.go:174] attempting to acquire leader lease...
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.253348    2848 leaderelection.go:184] successfully acquired lease kube-system/kube-controller-manager
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.257005    2848 event.go:218] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"kube-controller-manager", UID:"1cc7735e-2c35-11e8-8472-ca19a2bc1d78", APIVersion:"v1", ResourceVersion:"40", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' minikube became leader
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.409747    2848 plugins.go:101] No cloud provider specified.
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.415413    2848 controller_utils.go:1019] Waiting for caches to sync for tokens controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.420608    2848 controllermanager.go:493] Started "endpoint"
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.421052    2848 endpoints_controller.go:153] Starting endpoint controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.421168    2848 controller_utils.go:1019] Waiting for caches to sync for endpoint controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.422845    2848 controllermanager.go:493] Started "deployment"
Mar 20 11:52:06 minikube localkube[2848]: W0320 11:52:06.423010    2848 controllermanager.go:477] "bootstrapsigner" is disabled
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.422992    2848 deployment_controller.go:153] Starting deployment controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.423361    2848 controller_utils.go:1019] Waiting for caches to sync for deployment controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.425146    2848 controllermanager.go:493] Started "persistentvolume-binder"
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.425406    2848 pv_controller_base.go:264] Starting persistent volume controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.425511    2848 controller_utils.go:1019] Waiting for caches to sync for persistent volume controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.427087    2848 controllermanager.go:493] Started "replicationcontroller"
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.427376    2848 replica_set.go:183] Starting replicationcontroller controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.427480    2848 controller_utils.go:1019] Waiting for caches to sync for ReplicationController controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.516819    2848 controller_utils.go:1026] Caches are synced for tokens controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.529459    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {apps replicasets}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.529518    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {batch jobs}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.529541    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {rbac.authorization.k8s.io rolebindings}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.529604    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {extensions replicasets}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.529623    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {policy poddisruptionbudgets}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.529642    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for { limitranges}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.529688    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {apps statefulsets}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.529713    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for { serviceaccounts}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.529733    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {autoscaling horizontalpodautoscalers}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.529752    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {batch cronjobs}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.529769    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {networking.k8s.io networkpolicies}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.529849    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {extensions deployments}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.529948    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for { podtemplates}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.529978    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {extensions ingresses}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.530005    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {events.k8s.io events}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.530088    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for { endpoints}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.530125    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {apps daemonsets}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.530198    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {apps controllerrevisions}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.530234    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {settings.k8s.io podpresets}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.530318    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {extensions daemonsets}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.530345    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {apps deployments}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.530372    2848 resource_quota_monitor.go:215] QuotaMonitor created object count evaluator for {rbac.authorization.k8s.io roles}
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.530483    2848 controllermanager.go:493] Started "resourcequota"
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.530929    2848 resource_quota_controller.go:274] Starting resource quota controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.530944    2848 controller_utils.go:1019] Waiting for caches to sync for resource quota controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.530963    2848 resource_quota_monitor.go:288] QuotaMonitor running
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.533490    2848 controllermanager.go:493] Started "ttl"
Mar 20 11:52:06 minikube localkube[2848]: W0320 11:52:06.533572    2848 controllermanager.go:490] Skipping "persistentvolume-expander"
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.533679    2848 ttl_controller.go:116] Starting TTL controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.533689    2848 controller_utils.go:1019] Waiting for caches to sync for TTL controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.535386    2848 controllermanager.go:493] Started "podgc"
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.535629    2848 gc_controller.go:76] Starting GC controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.535651    2848 controller_utils.go:1019] Waiting for caches to sync for GC controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.537911    2848 controllermanager.go:493] Started "statefulset"
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.538074    2848 stateful_set.go:150] Starting stateful set controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.538090    2848 controller_utils.go:1019] Waiting for caches to sync for stateful set controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.539743    2848 controllermanager.go:493] Started "cronjob"
Mar 20 11:52:06 minikube localkube[2848]: W0320 11:52:06.539803    2848 controllermanager.go:490] Skipping "pvc-protection"
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.539915    2848 cronjob_controller.go:103] Starting CronJob Manager
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.543427    2848 controllermanager.go:493] Started "serviceaccount"
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.543759    2848 serviceaccounts_controller.go:115] Starting service account controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.543902    2848 controller_utils.go:1019] Waiting for caches to sync for service account controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.545367    2848 controllermanager.go:493] Started "daemonset"
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.545402    2848 core.go:132] Will not configure cloud provider routes for allocate-node-cidrs: false, configure-cloud-routes: true.
Mar 20 11:52:06 minikube localkube[2848]: W0320 11:52:06.545410    2848 controllermanager.go:490] Skipping "route"
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.545859    2848 daemon_controller.go:232] Starting daemon sets controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.545991    2848 controller_utils.go:1019] Waiting for caches to sync for daemon sets controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.547160    2848 controllermanager.go:493] Started "csrapproving"
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.547355    2848 certificate_controller.go:113] Starting certificate controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.547368    2848 controller_utils.go:1019] Waiting for caches to sync for certificate controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.548967    2848 controllermanager.go:493] Started "csrcleaner"
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.549220    2848 cleaner.go:81] Starting CSR cleaner controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.550668    2848 node_controller.go:246] Sending events to api server.
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.550796    2848 taint_controller.go:158] Sending events to api server.
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.550847    2848 controllermanager.go:493] Started "node"
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.551272    2848 node_controller.go:558] Starting node controller
Mar 20 11:52:06 minikube localkube[2848]: I0320 11:52:06.551291    2848 controller_utils.go:1019] Waiting for caches to sync for node controller
Mar 20 11:52:07 minikube localkube[2848]: controller-manager is ready!
Mar 20 11:52:07 minikube localkube[2848]: Starting scheduler...
Mar 20 11:52:07 minikube localkube[2848]: Waiting for scheduler to be healthy...
Mar 20 11:52:07 minikube localkube[2848]: W0320 11:52:07.236557    2848 server.go:383] unable to register configz: register config "componentconfig" twice
Mar 20 11:52:07 minikube localkube[2848]: I0320 11:52:07.243932    2848 server.go:551] Version: v1.9.0
Mar 20 11:52:07 minikube localkube[2848]: I0320 11:52:07.244255    2848 server.go:570] starting healthz server on 0.0.0.0:10251
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.046261    2848 controller_utils.go:1019] Waiting for caches to sync for scheduler controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.147054    2848 controller_utils.go:1026] Caches are synced for scheduler controller
Mar 20 11:52:08 minikube localkube[2848]: scheduler is ready!
Mar 20 11:52:08 minikube localkube[2848]: Starting kubelet...
Mar 20 11:52:08 minikube localkube[2848]: Waiting for kubelet to be healthy...
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.236966    2848 server.go:182] Version: v1.9.0
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.237062    2848 feature_gate.go:220] feature gates: &{{} map[]}
Mar 20 11:52:08 minikube localkube[2848]: W0320 11:52:08.237226    2848 server.go:280] --require-kubeconfig is deprecated. Set --kubeconfig without using --require-kubeconfig.
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.254901    2848 controllermanager.go:493] Started "garbagecollector"
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.259741    2848 garbagecollector.go:136] Starting garbage collector controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.259776    2848 controller_utils.go:1019] Waiting for caches to sync for garbage collector controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.259800    2848 graph_builder.go:321] GraphBuilder running
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.356684    2848 controllermanager.go:493] Started "horizontalpodautoscaling"
Mar 20 11:52:08 minikube localkube[2848]: W0320 11:52:08.356942    2848 controllermanager.go:490] Skipping "csrsigning"
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.358874    2848 controllermanager.go:493] Started "replicaset"
Mar 20 11:52:08 minikube localkube[2848]: E0320 11:52:08.361717    2848 core.go:73] Failed to start service controller: WARNING: no cloud provider provided, services of type LoadBalancer will fail
Mar 20 11:52:08 minikube localkube[2848]: W0320 11:52:08.361931    2848 controllermanager.go:490] Skipping "service"
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.363760    2848 controllermanager.go:493] Started "clusterrole-aggregation"
Mar 20 11:52:08 minikube localkube[2848]: W0320 11:52:08.365584    2848 probe.go:215] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating.
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.367554    2848 controllermanager.go:493] Started "attachdetach"
Mar 20 11:52:08 minikube localkube[2848]: W0320 11:52:08.367692    2848 controllermanager.go:477] "tokencleaner" is disabled
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.370102    2848 horizontal.go:128] Starting HPA controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.370294    2848 controller_utils.go:1019] Waiting for caches to sync for HPA controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.370454    2848 replica_set.go:183] Starting replicaset controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.370558    2848 controller_utils.go:1019] Waiting for caches to sync for ReplicaSet controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.370718    2848 clusterroleaggregation_controller.go:148] Starting ClusterRoleAggregator
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.370824    2848 controller_utils.go:1019] Waiting for caches to sync for ClusterRoleAggregator controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.387620    2848 attach_detach_controller.go:258] Starting attach detach controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.388307    2848 controller_utils.go:1019] Waiting for caches to sync for attach detach controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.408766    2848 controllermanager.go:493] Started "namespace"
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.411356    2848 controllermanager.go:493] Started "job"
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.413159    2848 controllermanager.go:493] Started "disruption"
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.413492    2848 controller_utils.go:1019] Waiting for caches to sync for resource quota controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.413554    2848 namespace_controller.go:186] Starting namespace controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.413570    2848 controller_utils.go:1019] Waiting for caches to sync for namespace controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.413604    2848 job_controller.go:138] Starting job controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.413607    2848 controller_utils.go:1019] Waiting for caches to sync for job controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.413932    2848 disruption.go:288] Starting disruption controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.414026    2848 controller_utils.go:1019] Waiting for caches to sync for disruption controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.540731    2848 controller_utils.go:1026] Caches are synced for TTL controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.546195    2848 controller_utils.go:1026] Caches are synced for service account controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.547542    2848 controller.go:538] quota admission added evaluator for: { serviceaccounts}
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.547945    2848 controller_utils.go:1026] Caches are synced for certificate controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.571243    2848 controller_utils.go:1026] Caches are synced for ClusterRoleAggregator controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.571526    2848 controller_utils.go:1026] Caches are synced for HPA controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.620989    2848 controller_utils.go:1026] Caches are synced for namespace controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.625606    2848 plugins.go:101] No cloud provider specified.
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.670134    2848 server.go:428] --cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.670351    2848 container_manager_linux.go:242] container manager verified user specified cgroup-root exists: /
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.670382    2848 container_manager_linux.go:247] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:docker CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>} {Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.15} GracePeriod:0s MinReclaim:<nil>}]} ExperimentalQOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s}
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.670504    2848 container_manager_linux.go:266] Creating device plugin manager: false
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.670633    2848 kubelet.go:290] Adding manifest path: /etc/kubernetes/manifests
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.672752    2848 kubelet.go:313] Watching apiserver
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.673209    2848 controller_utils.go:1026] Caches are synced for ReplicaSet controller
Mar 20 11:52:08 minikube localkube[2848]: W0320 11:52:08.679789    2848 kubelet_network.go:139] Hairpin mode set to "promiscuous-bridge" but kubenet is not enabled, falling back to "hairpin-veth"
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.679827    2848 kubelet.go:571] Hairpin mode set to "hairpin-veth"
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.681166    2848 client.go:80] Connecting to docker on unix:///var/run/docker.sock
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.681196    2848 client.go:109] Start docker client with request timeout=2m0s
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.687118    2848 docker_service.go:232] Docker cri networking managed by kubernetes.io/no-op
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.705142    2848 docker_service.go:237] Docker Info: &{ID:MPL7:YPG6:YLXQ:ARCE:GL47:CV4U:57MS:JJ6J:D3EB:5SLH:L7ON:JNCV Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:7 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:[] Plugins:{Volume:[local] Network:[bridge host macvlan null overlay] Authorization:[] Log:[awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6tables:true Debug:false NFd:21 OomKillDisable:true NGoroutines:27 SystemTime:2018-03-20T11:52:08.688904162Z LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.64 OperatingSystem:Buildroot 2017.11 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:0xc421ba3420 NCPU:2 MemTotal:2097278976 GenericResources:[] DockerRootDir:/var/lib/docker HTTPProxy:http://www.example.com:80 HTTPSProxy:http://www.example.com:80 NoProxy: Name:minikube Labels:[provider=xhyve] ExperimentalBuild:false ServerVersion:17.09.0-ce ClusterStore: ClusterAdvertise: Runtimes:map[runc:{Path:docker-runc Args:[]}] DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:[] Nodes:0 Managers:0 Cluster:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:06b9cb35161009dcb7123345749fef02f7cea8e0 Expected:06b9cb35161009dcb7123345749fef02f7cea8e0} RuncCommit:{ID:3f2f8b84a77f73d38244dd690525642a72156c64 Expected:3f2f8b84a77f73d38244dd690525642a72156c64} InitCommit:{ID:N/A Expected:} SecurityOptions:[name=seccomp,profile=default]}
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.706238    2848 docker_service.go:250] Setting cgroupDriver to cgroupfs
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.717686    2848 remote_runtime.go:43] Connecting to runtime service unix:///var/run/dockershim.sock
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.718128    2848 controller_utils.go:1026] Caches are synced for job controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.718172    2848 controller_utils.go:1026] Caches are synced for disruption controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.718178    2848 disruption.go:296] Sending events to api server.
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.721856    2848 controller_utils.go:1026] Caches are synced for endpoint controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.730295    2848 kuberuntime_manager.go:186] Container runtime docker initialized, version: 17.09.0-ce, apiVersion: 1.32.0
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.730600    2848 kuberuntime_manager.go:918] updating runtime config through cri with podcidr 10.180.1.0/24
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.730789    2848 controller_utils.go:1026] Caches are synced for ReplicationController controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.730903    2848 controller_utils.go:1026] Caches are synced for deployment controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.731102    2848 docker_service.go:343] docker cri received runtime config &RuntimeConfig{NetworkConfig:&NetworkConfig{PodCidr:10.180.1.0/24,},}
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.731379    2848 kubelet_network.go:196] Setting Pod CIDR:  -> 10.180.1.0/24
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.750984    2848 controller_utils.go:1026] Caches are synced for GC controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.752436    2848 server.go:755] Started kubelet
Mar 20 11:52:08 minikube localkube[2848]: E0320 11:52:08.752862    2848 kubelet.go:1275] Image garbage collection failed once. Stats initialization may not have completed yet: failed to get imageFs info: unable to find data for container /
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.753371    2848 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.754082    2848 server.go:129] Starting to listen on 0.0.0.0:10250
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.754845    2848 server.go:299] Adding debug handlers to kubelet server.
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.779247    2848 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.779562    2848 status_manager.go:140] Starting to sync pod status with apiserver
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.779720    2848 kubelet.go:1767] Starting kubelet main sync loop.
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.780010    2848 kubelet.go:1778] skipping pod synchronization - [container runtime is down PLEG is not healthy: pleg was last seen active 2562047h47m16.854775807s ago; threshold is 3m0s]
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.779566    2848 volume_manager.go:247] Starting Kubelet Volume Manager
Mar 20 11:52:08 minikube localkube[2848]: E0320 11:52:08.779434    2848 container_manager_linux.go:583] [ContainerManager]: Fail to get rootfs information unable to find data for container /
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.879797    2848 kubelet_node_status.go:273] Setting node annotation to enable volume controller attach/detach
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.882292    2848 kubelet_node_status.go:82] Attempting to register node minikube
Mar 20 11:52:08 minikube localkube[2848]: E0320 11:52:08.894727    2848 actual_state_of_world.go:491] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true because nodeName="minikube"  does not exist
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.896802    2848 kubelet_node_status.go:85] Successfully registered node minikube
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.897436    2848 kuberuntime_manager.go:918] updating runtime config through cri with podcidr
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.897541    2848 docker_service.go:343] docker cri received runtime config &RuntimeConfig{NetworkConfig:&NetworkConfig{PodCidr:,},}
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.897619    2848 kubelet_network.go:196] Setting Pod CIDR: 10.180.1.0/24 ->
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.947125    2848 controller_utils.go:1026] Caches are synced for daemon sets controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.951933    2848 controller_utils.go:1026] Caches are synced for node controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.952101    2848 node_controller.go:611] Initializing eviction metric for zone:
Mar 20 11:52:08 minikube localkube[2848]: W0320 11:52:08.952140    2848 node_controller.go:964] Missing timestamp for Node minikube. Assuming now as a timestamp.
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.952162    2848 node_controller.go:830] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.952395    2848 event.go:218] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"1e58e531-2c35-11e8-8472-ca19a2bc1d78", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RegisteredNode' Node minikube event: Registered Node minikube in Controller
Mar 20 11:52:08 minikube localkube[2848]: I0320 11:52:08.953752    2848 taint_controller.go:181] Starting NoExecuteTaintManager
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.013745    2848 controller_utils.go:1026] Caches are synced for resource quota controller
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.025923    2848 controller_utils.go:1026] Caches are synced for persistent volume controller
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.031331    2848 controller_utils.go:1026] Caches are synced for resource quota controller
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.038279    2848 controller_utils.go:1026] Caches are synced for stateful set controller
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.060112    2848 controller_utils.go:1026] Caches are synced for garbage collector controller
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.060171    2848 garbagecollector.go:145] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.088665    2848 controller_utils.go:1026] Caches are synced for attach detach controller
Mar 20 11:52:09 minikube localkube[2848]: kubelet is ready!
Mar 20 11:52:09 minikube localkube[2848]: Starting proxy...
Mar 20 11:52:09 minikube localkube[2848]: Waiting for proxy to be healthy...
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.248402    2848 server_others.go:138] Using iptables Proxier.
Mar 20 11:52:09 minikube localkube[2848]: W0320 11:52:09.256636    2848 proxier.go:468] clusterCIDR not specified, unable to distinguish between internal and external traffic
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.256734    2848 server_others.go:171] Tearing down inactive rules.
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.273164    2848 server.go:430] Version: v1.9.0
Mar 20 11:52:09 minikube localkube[2848]: E0320 11:52:09.273597    2848 healthcheck.go:317] Failed to start node healthz on 0: listen tcp: address 0: missing port in address
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.273638    2848 config.go:202] Starting service config controller
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.273645    2848 controller_utils.go:1019] Waiting for caches to sync for service config controller
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.273662    2848 config.go:102] Starting endpoints config controller
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.273667    2848 controller_utils.go:1019] Waiting for caches to sync for endpoints config controller
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.373999    2848 controller_utils.go:1026] Caches are synced for endpoints config controller
Mar 20 11:52:09 minikube localkube[2848]: I0320 11:52:09.374124    2848 controller_utils.go:1026] Caches are synced for service config controller
Mar 20 11:52:09 minikube localkube[2848]: E0320 11:52:09.781402    2848 container_manager_linux.go:583] [ContainerManager]: Fail to get rootfs information unable to find data for container /
Mar 20 11:52:10 minikube localkube[2848]: proxy is ready!
Mar 20 11:52:10 minikube localkube[2848]: E0320 11:52:10.781705    2848 container_manager_linux.go:583] [ContainerManager]: Fail to get rootfs information unable to find data for container /
Mar 20 11:52:11 minikube localkube[2848]: I0320 11:52:11.453192    2848 controller_utils.go:1019] Waiting for caches to sync for garbage collector controller
Mar 20 11:52:11 minikube localkube[2848]: I0320 11:52:11.554161    2848 controller_utils.go:1026] Caches are synced for garbage collector controller
Mar 20 11:52:13 minikube localkube[2848]: I0320 11:52:13.881230    2848 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "addons" (UniqueName: "kubernetes.io/host-path/c4c3188325a93a2d7fb1714e1abf1259-addons") pod "kube-addon-manager-minikube" (UID: "c4c3188325a93a2d7fb1714e1abf1259")
Mar 20 11:52:13 minikube localkube[2848]: I0320 11:52:13.881541    2848 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/c4c3188325a93a2d7fb1714e1abf1259-kubeconfig") pod "kube-addon-manager-minikube" (UID: "c4c3188325a93a2d7fb1714e1abf1259")
Mar 20 11:52:14 minikube localkube[2848]: E0320 11:52:14.164004    2848 remote_runtime.go:92] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:52:14 minikube localkube[2848]: E0320 11:52:14.164128    2848 kuberuntime_sandbox.go:54] CreatePodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:52:14 minikube localkube[2848]: E0320 11:52:14.164140    2848 kuberuntime_manager.go:647] createPodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:52:14 minikube localkube[2848]: E0320 11:52:14.164202    2848 pod_workers.go:186] Error syncing pod c4c3188325a93a2d7fb1714e1abf1259 ("kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)"), skipping: failed to "CreatePodSandbox" for "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" with CreatePodSandboxError: "CreatePodSandbox for pod \"kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)\" failed: rpc error: code = Unknown desc = failed pulling image \"gcr.io/google_containers/pause-amd64:3.0\": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority"
Mar 20 11:52:15 minikube localkube[2848]: E0320 11:52:15.153329    2848 remote_runtime.go:92] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:52:15 minikube localkube[2848]: E0320 11:52:15.153535    2848 kuberuntime_sandbox.go:54] CreatePodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:52:15 minikube localkube[2848]: E0320 11:52:15.153669    2848 kuberuntime_manager.go:647] createPodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:52:15 minikube localkube[2848]: E0320 11:52:15.153872    2848 pod_workers.go:186] Error syncing pod c4c3188325a93a2d7fb1714e1abf1259 ("kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)"), skipping: failed to "CreatePodSandbox" for "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" with CreatePodSandboxError: "CreatePodSandbox for pod \"kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)\" failed: rpc error: code = Unknown desc = failed pulling image \"gcr.io/google_containers/pause-amd64:3.0\": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority"
Mar 20 11:52:18 minikube localkube[2848]: I0320 11:52:18.952950    2848 node_controller.go:857] Controller detected that some Nodes are Ready. Exiting master disruption mode.
Mar 20 11:52:29 minikube localkube[2848]: E0320 11:52:29.121572    2848 remote_runtime.go:92] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:52:29 minikube localkube[2848]: E0320 11:52:29.121627    2848 kuberuntime_sandbox.go:54] CreatePodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:52:29 minikube localkube[2848]: E0320 11:52:29.121647    2848 kuberuntime_manager.go:647] createPodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:52:29 minikube localkube[2848]: E0320 11:52:29.121758    2848 pod_workers.go:186] Error syncing pod c4c3188325a93a2d7fb1714e1abf1259 ("kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)"), skipping: failed to "CreatePodSandbox" for "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" with CreatePodSandboxError: "CreatePodSandbox for pod \"kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)\" failed: rpc error: code = Unknown desc = failed pulling image \"gcr.io/google_containers/pause-amd64:3.0\": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority"
Mar 20 11:52:30 minikube localkube[2848]: W0320 11:52:30.902906    2848 conversion.go:110] Could not get instant cpu stats: different number of cpus
Mar 20 11:52:42 minikube localkube[2848]: E0320 11:52:42.120883    2848 remote_runtime.go:92] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:52:42 minikube localkube[2848]: E0320 11:52:42.120956    2848 kuberuntime_sandbox.go:54] CreatePodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:52:42 minikube localkube[2848]: E0320 11:52:42.120975    2848 kuberuntime_manager.go:647] createPodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:52:42 minikube localkube[2848]: E0320 11:52:42.121073    2848 pod_workers.go:186] Error syncing pod c4c3188325a93a2d7fb1714e1abf1259 ("kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)"), skipping: failed to "CreatePodSandbox" for "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" with CreatePodSandboxError: "CreatePodSandbox for pod \"kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)\" failed: rpc error: code = Unknown desc = failed pulling image \"gcr.io/google_containers/pause-amd64:3.0\": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority"
Mar 20 11:52:57 minikube localkube[2848]: E0320 11:52:57.124614    2848 remote_runtime.go:92] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:52:57 minikube localkube[2848]: E0320 11:52:57.124679    2848 kuberuntime_sandbox.go:54] CreatePodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:52:57 minikube localkube[2848]: E0320 11:52:57.124693    2848 kuberuntime_manager.go:647] createPodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:52:57 minikube localkube[2848]: E0320 11:52:57.124769    2848 pod_workers.go:186] Error syncing pod c4c3188325a93a2d7fb1714e1abf1259 ("kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)"), skipping: failed to "CreatePodSandbox" for "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" with CreatePodSandboxError: "CreatePodSandbox for pod \"kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)\" failed: rpc error: code = Unknown desc = failed pulling image \"gcr.io/google_containers/pause-amd64:3.0\": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority"
Mar 20 11:53:09 minikube localkube[2848]: E0320 11:53:09.123842    2848 remote_runtime.go:92] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:53:09 minikube localkube[2848]: E0320 11:53:09.123920    2848 kuberuntime_sandbox.go:54] CreatePodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:53:09 minikube localkube[2848]: E0320 11:53:09.123935    2848 kuberuntime_manager.go:647] createPodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:53:09 minikube localkube[2848]: E0320 11:53:09.124015    2848 pod_workers.go:186] Error syncing pod c4c3188325a93a2d7fb1714e1abf1259 ("kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)"), skipping: failed to "CreatePodSandbox" for "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" with CreatePodSandboxError: "CreatePodSandbox for pod \"kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)\" failed: rpc error: code = Unknown desc = failed pulling image \"gcr.io/google_containers/pause-amd64:3.0\": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority"
Mar 20 11:53:09 minikube localkube[2848]: E0320 11:53:09.274513    2848 healthcheck.go:317] Failed to start node healthz on 0: listen tcp: address 0: missing port in address
Mar 20 11:53:25 minikube localkube[2848]: E0320 11:53:25.121650    2848 remote_runtime.go:92] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:53:25 minikube localkube[2848]: E0320 11:53:25.121731    2848 kuberuntime_sandbox.go:54] CreatePodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:53:25 minikube localkube[2848]: E0320 11:53:25.121748    2848 kuberuntime_manager.go:647] createPodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:53:25 minikube localkube[2848]: E0320 11:53:25.121808    2848 pod_workers.go:186] Error syncing pod c4c3188325a93a2d7fb1714e1abf1259 ("kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)"), skipping: failed to "CreatePodSandbox" for "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" with CreatePodSandboxError: "CreatePodSandbox for pod \"kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)\" failed: rpc error: code = Unknown desc = failed pulling image \"gcr.io/google_containers/pause-amd64:3.0\": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority"
Mar 20 11:53:41 minikube localkube[2848]: E0320 11:53:41.124713    2848 remote_runtime.go:92] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:53:41 minikube localkube[2848]: E0320 11:53:41.124793    2848 kuberuntime_sandbox.go:54] CreatePodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:53:41 minikube localkube[2848]: E0320 11:53:41.124826    2848 kuberuntime_manager.go:647] createPodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:53:41 minikube localkube[2848]: E0320 11:53:41.124904    2848 pod_workers.go:186] Error syncing pod c4c3188325a93a2d7fb1714e1abf1259 ("kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)"), skipping: failed to "CreatePodSandbox" for "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" with CreatePodSandboxError: "CreatePodSandbox for pod \"kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)\" failed: rpc error: code = Unknown desc = failed pulling image \"gcr.io/google_containers/pause-amd64:3.0\": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority"
Mar 20 11:53:56 minikube localkube[2848]: E0320 11:53:56.122952    2848 remote_runtime.go:92] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:53:56 minikube localkube[2848]: E0320 11:53:56.123015    2848 kuberuntime_sandbox.go:54] CreatePodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:53:56 minikube localkube[2848]: E0320 11:53:56.123028    2848 kuberuntime_manager.go:647] createPodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:53:56 minikube localkube[2848]: E0320 11:53:56.123134    2848 pod_workers.go:186] Error syncing pod c4c3188325a93a2d7fb1714e1abf1259 ("kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)"), skipping: failed to "CreatePodSandbox" for "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" with CreatePodSandboxError: "CreatePodSandbox for pod \"kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)\" failed: rpc error: code = Unknown desc = failed pulling image \"gcr.io/google_containers/pause-amd64:3.0\": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority"
Mar 20 11:54:09 minikube localkube[2848]: E0320 11:54:09.274950    2848 healthcheck.go:317] Failed to start node healthz on 0: listen tcp: address 0: missing port in address
Mar 20 11:54:10 minikube localkube[2848]: E0320 11:54:10.122217    2848 remote_runtime.go:92] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:54:10 minikube localkube[2848]: E0320 11:54:10.122542    2848 kuberuntime_sandbox.go:54] CreatePodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:54:10 minikube localkube[2848]: E0320 11:54:10.122750    2848 kuberuntime_manager.go:647] createPodSandbox for pod "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" failed: rpc error: code = Unknown desc = failed pulling image "gcr.io/google_containers/pause-amd64:3.0": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority
Mar 20 11:54:10 minikube localkube[2848]: E0320 11:54:10.123009    2848 pod_workers.go:186] Error syncing pod c4c3188325a93a2d7fb1714e1abf1259 ("kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)"), skipping: failed to "CreatePodSandbox" for "kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)" with CreatePodSandboxError: "CreatePodSandbox for pod \"kube-addon-manager-minikube_kube-system(c4c3188325a93a2d7fb1714e1abf1259)\" failed: rpc error: code = Unknown desc = failed pulling image \"gcr.io/google_containers/pause-amd64:3.0\": Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority"
Mar 20 11:54:26 minikube localkube[2848]: W0320 11:54:26.483423    2848 pod_container_deletor.go:77] Container "96617a2c5a6eaeda6971d988d9410e1099b8d895f4cc2cb2cd9aa6452f4bc64d" not found in pod's containers
Mar 20 11:54:27 minikube localkube[2848]: I0320 11:54:27.338227    2848 controller.go:538] quota admission added evaluator for: { namespaces}
Mar 20 11:54:28 minikube localkube[2848]: I0320 11:54:28.370804    2848 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "tmp" (UniqueName: "kubernetes.io/host-path/71661b07-2c35-11e8-8472-ca19a2bc1d78-tmp") pod "storage-provisioner" (UID: "71661b07-2c35-11e8-8472-ca19a2bc1d78")
Mar 20 11:54:28 minikube localkube[2848]: I0320 11:54:28.370911    2848 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "default-token-qs662" (UniqueName: "kubernetes.io/secret/71661b07-2c35-11e8-8472-ca19a2bc1d78-default-token-qs662") pod "storage-provisioner" (UID: "71661b07-2c35-11e8-8472-ca19a2bc1d78")
Mar 20 11:54:28 minikube localkube[2848]: I0320 11:54:28.743388    2848 controller.go:538] quota admission added evaluator for: {apps deployments}
Mar 20 11:54:28 minikube localkube[2848]: I0320 11:54:28.755081    2848 controller.go:538] quota admission added evaluator for: {extensions replicasets}
Mar 20 11:54:28 minikube localkube[2848]: I0320 11:54:28.790439    2848 event.go:218] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"kubernetes-dashboard", UID:"71b5da28-2c35-11e8-8472-ca19a2bc1d78", APIVersion:"extensions", ResourceVersion:"177", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set kubernetes-dashboard-77d8b98585 to 1
Mar 20 11:54:28 minikube localkube[2848]: I0320 11:54:28.815823    2848 event.go:218] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"kubernetes-dashboard-77d8b98585", UID:"71b79ef8-2c35-11e8-8472-ca19a2bc1d78", APIVersion:"extensions", ResourceVersion:"178", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kubernetes-dashboard-77d8b98585-mszl4
Mar 20 11:54:28 minikube localkube[2848]: I0320 11:54:28.984912    2848 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "default-token-qs662" (UniqueName: "kubernetes.io/secret/71be7ce3-2c35-11e8-8472-ca19a2bc1d78-default-token-qs662") pod "kubernetes-dashboard-77d8b98585-mszl4" (UID: "71be7ce3-2c35-11e8-8472-ca19a2bc1d78")
Mar 20 11:54:29 minikube localkube[2848]: I0320 11:54:29.127961    2848 controller.go:538] quota admission added evaluator for: {extensions deployments}
Mar 20 11:54:29 minikube localkube[2848]: I0320 11:54:29.161122    2848 event.go:218] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"kube-dns", UID:"71f08261-2c35-11e8-8472-ca19a2bc1d78", APIVersion:"extensions", ResourceVersion:"197", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set kube-dns-54cccfbdf8 to 1
Mar 20 11:54:29 minikube localkube[2848]: I0320 11:54:29.203450    2848 event.go:218] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"kube-dns-54cccfbdf8", UID:"71f262d7-2c35-11e8-8472-ca19a2bc1d78", APIVersion:"extensions", ResourceVersion:"198", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kube-dns-54cccfbdf8-xvs9t
Mar 20 11:54:29 minikube localkube[2848]: I0320 11:54:29.391315    2848 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-dns-config" (UniqueName: "kubernetes.io/configmap/71f78ce1-2c35-11e8-8472-ca19a2bc1d78-kube-dns-config") pod "kube-dns-54cccfbdf8-xvs9t" (UID: "71f78ce1-2c35-11e8-8472-ca19a2bc1d78")
Mar 20 11:54:29 minikube localkube[2848]: I0320 11:54:29.391782    2848 reconciler.go:217] operationExecutor.VerifyControllerAttachedVolume started for volume "default-token-qs662" (UniqueName: "kubernetes.io/secret/71f78ce1-2c35-11e8-8472-ca19a2bc1d78-default-token-qs662") pod "kube-dns-54cccfbdf8-xvs9t" (UID: "71f78ce1-2c35-11e8-8472-ca19a2bc1d78")
Mar 20 11:54:29 minikube localkube[2848]: W0320 11:54:29.514884    2848 container.go:393] Failed to create summary reader for "/system.slice/run-rc91cb7c140cf4fe1bb078ab89e84a5f5.scope": none of the resources are being tracked.
Mar 20 11:54:29 minikube localkube[2848]: W0320 11:54:29.880318    2848 pod_container_deletor.go:77] Container "304b22d8ad53866ae67de003f92f4148425dcc40c618ad07e076b2285f2ec521" not found in pod's containers
Mar 20 11:54:39 minikube localkube[2848]: E0320 11:54:39.527318    2848 proxier.go:1701] Failed to delete stale service IP 10.96.0.10 connections, error: error deleting connection tracking state for UDP service IP: 10.96.0.10, error: error looking for path of conntrack: exec: "conntrack": executable file not found in $PATH
Mar 20 11:55:09 minikube localkube[2848]: E0320 11:55:09.275607    2848 healthcheck.go:317] Failed to start node healthz on 0: listen tcp: address 0: missing port in address
Mar 20 11:56:09 minikube localkube[2848]: E0320 11:56:09.276511    2848 healthcheck.go:317] Failed to start node healthz on 0: listen tcp: address 0: missing port in address
Mar 20 11:57:09 minikube localkube[2848]: E0320 11:57:09.277636    2848 healthcheck.go:317] Failed to start node healthz on 0: listen tcp: address 0: missing port in address
Mar 20 11:58:09 minikube localkube[2848]: E0320 11:58:09.278122    2848 healthcheck.go:317] Failed to start node healthz on 0: listen tcp: address 0: missing port in address
Mar 20 11:59:09 minikube localkube[2848]: E0320 11:59:09.279549    2848 healthcheck.go:317] Failed to start node healthz on 0: listen tcp: address 0: missing port in address
Mar 20 12:00:09 minikube localkube[2848]: E0320 12:00:09.280491    2848 healthcheck.go:317] Failed to start node healthz on 0: listen tcp: address 0: missing port in address
Mar 20 12:01:09 minikube localkube[2848]: E0320 12:01:09.281100    2848 healthcheck.go:317] Failed to start node healthz on 0: listen tcp: address 0: missing port in address
Mar 20 12:01:58 minikube localkube[2848]: store.index: compact 333
Mar 20 12:01:58 minikube localkube[2848]: finished scheduled compaction at 333 (took 446.404µs)
Mar 20 12:02:09 minikube localkube[2848]: E0320 12:02:09.281735    2848 healthcheck.go:317] Failed to start node healthz on 0: listen tcp: address 0: missing port in address
Mar 20 12:03:09 minikube localkube[2848]: E0320 12:03:09.361978    2848 healthcheck.go:317] Failed to start node healthz on 0: listen tcp: address 0: missing port in address
Mar 20 12:04:09 minikube localkube[2848]: E0320 12:04:09.362646    2848 healthcheck.go:317] Failed to start node healthz on 0: listen tcp: address 0: missing port in address
Mar 20 12:05:09 minikube localkube[2848]: E0320 12:05:09.363338    2848 healthcheck.go:317] Failed to start node healthz on 0: listen tcp: address 0: missing port in address
Mar 20 12:06:09 minikube localkube[2848]: E0320 12:06:09.364021    2848 healthcheck.go:317] Failed to start node healthz on 0: listen tcp: address 0: missing port in address
erip commented 6 years ago

Ah... upon creation of the cluster, NO_PROXY will need to be re-exported... $ export NO_PROXY="$no_proxy,$(minikube ip)" made ~this work~ it get further.

Edit

Despite this, I'm still seeing the following my my logs:

Error response from daemon: Get https://gcr.io/v2/: x509: certificate signed by unknown authority

fejta-bot commented 6 years ago

Issues go stale after 90d of inactivity. Mark the issue as fresh with /remove-lifecycle stale. Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta. /lifecycle stale

fejta-bot commented 6 years ago

Stale issues rot after 30d of inactivity. Mark the issue as fresh with /remove-lifecycle rotten. Rotten issues close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta. /lifecycle rotten /remove-lifecycle stale

fejta-bot commented 6 years ago

Rotten issues close after 30d of inactivity. Reopen the issue with /reopen. Mark the issue as fresh with /remove-lifecycle rotten.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta. /close

kbsivacse commented 5 years ago

I'm also facing the same issue while running behind corporate proxy. Is there any way to accept the certificate to allow downloading the images?