Cannot start ingress addon: waiting for pod

Steps to reproduce the issue:

minikube start --vm-driver hyperv --cpus 2 --memory=8192
minikube addons enable ingress --alsologtostderr

Full output of failed command:

❯ minikube addons enable ingress --alsologtostderr
I0220 16:57:51.899458   28192 out.go:229] Setting OutFile to fd 88 ...
I0220 16:57:51.900398   28192 out.go:276] TERM=,COLORTERM=, which probably does not support color
I0220 16:57:51.900398   28192 out.go:242] Setting ErrFile to fd 92...
I0220 16:57:51.901397   28192 out.go:276] TERM=,COLORTERM=, which probably does not support color
I0220 16:57:51.921175   28192 addons.go:55] Setting ingress=true in profile "minikube"
I0220 16:57:51.921826   28192 addons.go:131] Setting addon ingress=true in "minikube"
I0220 16:57:51.922369   28192 host.go:66] Checking if "minikube" exists ...
I0220 16:57:51.922904   28192 main.go:119] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM minikube ).state
I0220 16:57:52.389395   28192 main.go:119] libmachine: [stdout =====>] : Running

I0220 16:57:52.390040   28192 main.go:119] libmachine: [stderr =====>] :
I0220 16:57:52.390040   28192 addons.go:247] installing /etc/kubernetes/addons/ingress-configmap.yaml
I0220 16:57:52.390734   28192 ssh_runner.go:310] scp memory --> /etc/kubernetes/addons/ingress-configmap.yaml (1251 bytes)
I0220 16:57:52.390734   28192 main.go:119] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive ( Hyper-V\Get-VM minikube ).state
I0220 16:57:52.848442   28192 main.go:119] libmachine: [stdout =====>] : Running

I0220 16:57:52.850487   28192 main.go:119] libmachine: [stderr =====>] :
I0220 16:57:52.851015   28192 main.go:119] libmachine: [executing ==>] : C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive (( Hyper-V\Get-VM minikube ).networkadapters[0]).ipaddresses[0]
I0220 16:57:53.576395   28192 main.go:119] libmachine: [stdout =====>] : 172.23.0.69

I0220 16:57:53.576923   28192 main.go:119] libmachine: [stderr =====>] :
I0220 16:57:53.576923   28192 sshutil.go:48] new ssh client: &{IP:172.23.0.69 Port:22 SSHKeyPath:C:\Users\XX\.minikube\machines\minikube\id_rsa Username:docker}
I0220 16:57:53.675885   28192 addons.go:247] installing /etc/kubernetes/addons/ingress-rbac.yaml
I0220 16:57:53.675885   28192 ssh_runner.go:310] scp memory --> /etc/kubernetes/addons/ingress-rbac.yaml (4828 bytes)
I0220 16:57:53.682452   28192 addons.go:247] installing /etc/kubernetes/addons/ingress-dp.yaml
I0220 16:57:53.682452   28192 ssh_runner.go:310] scp memory --> /etc/kubernetes/addons/ingress-dp.yaml (8533 bytes)
I0220 16:57:53.717473   28192 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.2/kubectl apply -f /etc/kubernetes/addons/ingress-configmap.yaml -f /etc/kubernetes/addons/ingress-rbac.yaml -f /etc/kubernetes/addons/ingress-dp.yaml
I0220 16:57:53.859260   28192 addons.go:346] Verifying addon ingress=true in "minikube"
I0220 16:57:53.861262   28192 out.go:119] * Verifying ingress addon...
* Verifying ingress addon...
I0220 16:57:53.869261   28192 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "kube-system" ...
I0220 16:57:53.884052   28192 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0220 16:57:53.884052   28192 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0220 16:57:54.391870   28192 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0220 16:57:54.889169   28192 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0220 16:57:55.400154   28192 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0220 16:57:55.900645   28192 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0220 16:57:56.403320   28192 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0220 16:57:56.904065   28192 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0220 16:57:57.400503   28192 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0220 16:57:57.902159   28192 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0220 16:57:58.391056   28192 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0220 16:57:58.891532   28192 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

Windows 10 Docker version 20.10.2, build 2291f61 minikube version: v1.17.1 commit: 043bdca07e54ab6e4fc0457e3064048f34133d7e

I checked the logs kubectl get pods --namespace kube-system

and see this

ingress-nginx-admission-create-lp98w        0/1     ImagePullBackOff    0          88s
ingress-nginx-admission-patch-pbff9         0/1     ErrImagePull        0          88s
ingress-nginx-controller-558664778f-s5c9t   0/1     ContainerCreating   0          88s

I've also set NO_PROXY

❯ echo $env:NO_PROXY
localhost,127.0.0.1,10.96.0.0/12,192.168.99.0/24,192.168.39.0/24

Hey @newtoniumx3 thanks for opening this issue. Could you provide more details around the pods so we can figure out why the image isn't being pulled?

kubectl describe po ingress-nginx-admission-create-lp98w --namespace kube-system

If you have docker running, I'm also curious if this happens with the docker driver as well? If you could try:

minikube start --driver docker -p docker
minikube addons enable ingress
minikube delete -p docker

that should let us know if it works with ingress.

Hey @newtoniumx3 thanks for opening this issue. Could you provide more details around the pods so we can figure out why the image isn't being pulled?
kubectl describe po ingress-nginx-admission-create-lp98w --namespace kube-system
If you have docker running, I'm also curious if this happens with the docker driver as well? If you could try:
minikube start --driver docker -p docker
minikube addons enable ingress
minikube delete -p docker
that should let us know if it works with ingress.

Hey I’m currently afraid to touch it as I finally got everything working using Kubernetes that ships with docker desktop. I’m not sure I’m willing to risk messing with my config again as I was down over a week when this stopped working for some strange reason (because I always had it working for months prior).

I will attempt on different machine to see if I can reproduce it.

@newtoniumx3 thanks, no worries if it's too difficult to try to reproduce!

@newtoniumx3 I'm going to close this issue, but if you end up being able to reproduce the issue feel free to reopen.

I'm seeing this same issue when enabling the ingress addon. Let me know what other information would be helpful here.

$ uname -a
Linux awx 4.19.0-14-arm64 #1 SMP Debian 4.19.171-2 (2021-01-30) aarch64 GNU/Linux
$ minikube version
minikube version: v1.19.0
commit: 15cede53bdc5fe242228853e737333b09d4336b5
$ minikube addons enable ingress -v=5 --alsologtostderr
I0411 08:10:33.701931   21466 out.go:278] Setting OutFile to fd 1 ...
I0411 08:10:33.702134   21466 out.go:330] isatty.IsTerminal(1) = true
I0411 08:10:33.702167   21466 out.go:291] Setting ErrFile to fd 2...
I0411 08:10:33.702191   21466 out.go:330] isatty.IsTerminal(2) = true
I0411 08:10:33.702383   21466 root.go:317] Updating PATH: /home/nate/.minikube/bin
W0411 08:10:33.702615   21466 root.go:292] Error reading config file at /home/nate/.minikube/config/config.json: open /home/nate/.minikube/config/config.json: no such file or directory
I0411 08:10:33.703183   21466 addons.go:55] Setting ingress=true in profile "minikube"
I0411 08:10:33.703226   21466 addons.go:131] Setting addon ingress=true in "minikube"
I0411 08:10:33.703292   21466 host.go:66] Checking if "minikube" exists ...
I0411 08:10:33.704276   21466 cli_runner.go:115] Run: docker container inspect minikube --format={{.State.Status}}
I0411 08:10:33.775282   21466 out.go:157]     ▪ Using image k8s.gcr.io/ingress-nginx/controller:v0.44.0
    ▪ Using image k8s.gcr.io/ingress-nginx/controller:v0.44.0
I0411 08:10:33.776992   21466 out.go:157]     ▪ Using image docker.io/jettech/kube-webhook-certgen:v1.5.1
    ▪ Using image docker.io/jettech/kube-webhook-certgen:v1.5.1
I0411 08:10:33.778497   21466 out.go:157]     ▪ Using image docker.io/jettech/kube-webhook-certgen:v1.5.1
    ▪ Using image docker.io/jettech/kube-webhook-certgen:v1.5.1
I0411 08:10:33.778595   21466 addons.go:261] installing /etc/kubernetes/addons/ingress-configmap.yaml
I0411 08:10:33.778638   21466 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-configmap.yaml (1865 bytes)
I0411 08:10:33.778744   21466 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0411 08:10:33.837673   21466 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/nate/.minikube/machines/minikube/id_rsa Username:docker}
I0411 08:10:33.957576   21466 addons.go:261] installing /etc/kubernetes/addons/ingress-rbac.yaml
I0411 08:10:33.957619   21466 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-rbac.yaml (6005 bytes)
I0411 08:10:33.977878   21466 addons.go:261] installing /etc/kubernetes/addons/ingress-dp.yaml
I0411 08:10:33.977918   21466 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-dp.yaml (9125 bytes)
I0411 08:10:33.998092   21466 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.2/kubectl apply -f /etc/kubernetes/addons/ingress-configmap.yaml -f /etc/kubernetes/addons/ingress-rbac.yaml -f /etc/kubernetes/addons/ingress-dp.yaml
I0411 08:10:34.351846   21466 addons.go:299] Verifying addon ingress=true in "minikube"
I0411 08:10:34.354113   21466 out.go:157] 🔎  Verifying ingress addon...
🔎  Verifying ingress addon...
I0411 08:10:34.357070   21466 kapi.go:59] client config for minikube: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/nate/.minikube/profiles/minikube/client.crt", KeyFile:"/home/nate/.minikube/profiles/minikube/client.key", CAFile:"/home/nate/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x132efd0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0411 08:10:34.357853   21466 cert_rotation.go:137] Starting client certificate rotation controller
I0411 08:10:34.361097   21466 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0411 08:10:34.387895   21466 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0411 08:10:34.387929   21466 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0411 08:10:34.893599   21466 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0411 08:10:35.392547   21466 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0411 08:10:35.892783   21466 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0411 08:10:36.392584   21466 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0411 08:10:36.893074   21466 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

@newtoniumx3 do u mind trying with latest version of minikube again, we fixed an inagress bug in v1.20.0 that could help with this ?

@medyagh I gave v1.20.0 a try, but unfortunately, the error still occurs for me.

$ minikube version                                     

minikube version: v1.20.0
commit: c61663e942ec43b20e8e70839dcca52e44cd85ae-dirty

$ minikube addons enable ingress -v=5 --alsologtostderr

I0520 22:43:30.604806  640679 out.go:291] Setting OutFile to fd 1 ...
I0520 22:43:30.604943  640679 out.go:343] isatty.IsTerminal(1) = true
I0520 22:43:30.604952  640679 out.go:304] Setting ErrFile to fd 2...
I0520 22:43:30.604958  640679 out.go:343] isatty.IsTerminal(2) = true
I0520 22:43:30.605082  640679 root.go:316] Updating PATH: /home/x3a/.minikube/bin
W0520 22:43:30.605191  640679 root.go:291] Error reading config file at /home/x3a/.minikube/config/config.json: open /home/x3a/.minikube/config/config.json: no such file or directory
I0520 22:43:30.605551  640679 addons.go:55] Setting ingress=true in profile "minikube"
I0520 22:43:30.605568  640679 addons.go:131] Setting addon ingress=true in "minikube"
I0520 22:43:30.605587  640679 host.go:66] Checking if "minikube" exists ...
I0520 22:43:30.606144  640679 cli_runner.go:115] Run: docker container inspect minikube --format={{.State.Status}}
I0520 22:43:30.643166  640679 out.go:170]     ▪ Using image k8s.gcr.io/ingress-nginx/controller:v0.44.0
    ▪ Using image k8s.gcr.io/ingress-nginx/controller:v0.44.0
I0520 22:43:30.646769  640679 out.go:170]     ▪ Using image docker.io/jettech/kube-webhook-certgen:v1.5.1
    ▪ Using image docker.io/jettech/kube-webhook-certgen:v1.5.1
I0520 22:43:30.648047  640679 out.go:170]     ▪ Using image docker.io/jettech/kube-webhook-certgen:v1.5.1
    ▪ Using image docker.io/jettech/kube-webhook-certgen:v1.5.1
I0520 22:43:30.648082  640679 addons.go:261] installing /etc/kubernetes/addons/ingress-configmap.yaml
I0520 22:43:30.648104  640679 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-configmap.yaml (1865 bytes)
I0520 22:43:30.648157  640679 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0520 22:43:30.672385  640679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49172 SSHKeyPath:/home/x3a/.minikube/machines/minikube/id_rsa Username:docker}
I0520 22:43:30.762305  640679 addons.go:261] installing /etc/kubernetes/addons/ingress-rbac.yaml
I0520 22:43:30.762330  640679 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-rbac.yaml (6005 bytes)
I0520 22:43:30.769416  640679 addons.go:261] installing /etc/kubernetes/addons/ingress-dp.yaml
I0520 22:43:30.769438  640679 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-dp.yaml (9394 bytes)
I0520 22:43:30.778162  640679 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.2/kubectl apply -f /etc/kubernetes/addons/ingress-configmap.yaml -f /etc/kubernetes/addons/ingress-rbac.yaml -f /etc/kubernetes/addons/ingress-dp.yaml
I0520 22:43:31.100192  640679 addons.go:299] Verifying addon ingress=true in "minikube"
I0520 22:43:31.102061  640679 out.go:170] 🔎  Verifying ingress addon...
🔎  Verifying ingress addon...
I0520 22:43:31.103062  640679 kapi.go:59] client config for minikube: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/x3a/.minikube/profiles/minikube/client.crt", KeyFile:"/home/x3a/.minikube/profiles/minikube/client.key", CAFile:"/home/x3a/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x55cf714627a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0520 22:43:31.103381  640679 cert_rotation.go:137] Starting client certificate rotation controller
I0520 22:43:31.104004  640679 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0520 22:43:31.116662  640679 kapi.go:86] Found 1 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0520 22:43:31.116681  640679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0520 22:43:31.620476  640679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0520 22:43:32.119752  640679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

...

Same issue happened for me , any suggestion to fix it ?

In my case, apache o ubunto was using port 80 sudo /etc/init.d/apache2 stop solved it

+1, i'm also seeing this issue. Will do more debugging.

Output of -v=5:

$ minikube addons enable ingress -v=5 --alsologtostderr
I0609 13:44:53.407702   50376 out.go:291] Setting OutFile to fd 1 ...
I0609 13:44:53.407987   50376 out.go:343] isatty.IsTerminal(1) = true
I0609 13:44:53.408001   50376 out.go:304] Setting ErrFile to fd 2...
I0609 13:44:53.408006   50376 out.go:343] isatty.IsTerminal(2) = true
I0609 13:44:53.408104   50376 root.go:316] Updating PATH: /Users/adam/.minikube/bin
I0609 13:44:53.408614   50376 addons.go:55] Setting ingress=true in profile "minikube-dev-adam-Adams-Mac-mini.local"
I0609 13:44:53.408631   50376 addons.go:131] Setting addon ingress=true in "minikube-dev-adam-Adams-Mac-mini.local"
W0609 13:44:53.408638   50376 addons.go:140] addon ingress should already be in state true
I0609 13:44:53.408658   50376 host.go:66] Checking if "minikube-dev-adam-Adams-Mac-mini.local" exists ...
I0609 13:44:53.408998   50376 main.go:128] libmachine: Found binary path at /Users/adam/.minikube/bin/docker-machine-driver-hyperkit
I0609 13:44:53.409056   50376 main.go:128] libmachine: Launching plugin server for driver hyperkit
I0609 13:44:53.423011   50376 main.go:128] libmachine: Plugin server listening at address 127.0.0.1:53568
I0609 13:44:53.424225   50376 main.go:128] libmachine: () Calling .GetVersion
I0609 13:44:53.425188   50376 main.go:128] libmachine: Using API Version  1
I0609 13:44:53.425210   50376 main.go:128] libmachine: () Calling .SetConfigRaw
I0609 13:44:53.425635   50376 main.go:128] libmachine: () Calling .GetMachineName
I0609 13:44:53.426082   50376 main.go:128] libmachine: Found binary path at /Users/adam/.minikube/bin/docker-machine-driver-hyperkit
I0609 13:44:53.426120   50376 main.go:128] libmachine: Launching plugin server for driver hyperkit
I0609 13:44:53.441083   50376 main.go:128] libmachine: Plugin server listening at address 127.0.0.1:53574
I0609 13:44:53.442200   50376 main.go:128] libmachine: () Calling .GetVersion
I0609 13:44:53.443164   50376 main.go:128] libmachine: Using API Version  1
I0609 13:44:53.443189   50376 main.go:128] libmachine: () Calling .SetConfigRaw
I0609 13:44:53.443626   50376 main.go:128] libmachine: () Calling .GetMachineName
I0609 13:44:53.443834   50376 main.go:128] libmachine: (minikube-dev-adam-Adams-Mac-mini.local) Calling .GetState
I0609 13:44:53.444029   50376 main.go:128] libmachine: (minikube-dev-adam-Adams-Mac-mini.local) DBG | exe=/Users/adam/.minikube/bin/docker-machine-driver-hyperkit uid=0
I0609 13:44:53.444331   50376 main.go:128] libmachine: (minikube-dev-adam-Adams-Mac-mini.local) DBG | hyperkit pid from json: 7241
I0609 13:44:53.447095   50376 main.go:128] libmachine: (minikube-dev-adam-Adams-Mac-mini.local) Calling .DriverName
I0609 13:44:53.473628   50376 out.go:170]     ▪ Using image k8s.gcr.io/ingress-nginx/controller:v0.44.0
    ▪ Using image k8s.gcr.io/ingress-nginx/controller:v0.44.0
I0609 13:44:53.499238   50376 out.go:170]     ▪ Using image docker.io/jettech/kube-webhook-certgen:v1.5.1
    ▪ Using image docker.io/jettech/kube-webhook-certgen:v1.5.1
I0609 13:44:53.524354   50376 out.go:170]     ▪ Using image docker.io/jettech/kube-webhook-certgen:v1.5.1
    ▪ Using image docker.io/jettech/kube-webhook-certgen:v1.5.1
I0609 13:44:53.524794   50376 addons.go:261] installing /etc/kubernetes/addons/ingress-configmap.yaml
I0609 13:44:53.524876   50376 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-configmap.yaml (1865 bytes)
I0609 13:44:53.524959   50376 main.go:128] libmachine: (minikube-dev-adam-Adams-Mac-mini.local) Calling .GetSSHHostname
I0609 13:44:53.525330   50376 main.go:128] libmachine: (minikube-dev-adam-Adams-Mac-mini.local) Calling .GetSSHPort
I0609 13:44:53.525524   50376 main.go:128] libmachine: (minikube-dev-adam-Adams-Mac-mini.local) Calling .GetSSHKeyPath
I0609 13:44:53.525699   50376 main.go:128] libmachine: (minikube-dev-adam-Adams-Mac-mini.local) Calling .GetSSHUsername
I0609 13:44:53.525852   50376 sshutil.go:53] new ssh client: &{IP:192.168.64.140 Port:22 SSHKeyPath:/Users/adam/.minikube/machines/minikube-dev-adam-Adams-Mac-mini.local/id_rsa Username:docker}
I0609 13:44:53.580031   50376 addons.go:261] installing /etc/kubernetes/addons/ingress-rbac.yaml
I0609 13:44:53.580075   50376 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-rbac.yaml (6005 bytes)
I0609 13:44:53.595222   50376 addons.go:261] installing /etc/kubernetes/addons/ingress-dp.yaml
I0609 13:44:53.595251   50376 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-dp.yaml (9394 bytes)
I0609 13:44:53.618277   50376 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.20.2/kubectl apply -f /etc/kubernetes/addons/ingress-configmap.yaml -f /etc/kubernetes/addons/ingress-rbac.yaml -f /etc/kubernetes/addons/ingress-dp.yaml
I0609 13:44:53.876058   50376 main.go:128] libmachine: Making call to close driver server
I0609 13:44:53.876083   50376 main.go:128] libmachine: (minikube-dev-adam-Adams-Mac-mini.local) Calling .Close
I0609 13:44:53.876304   50376 main.go:128] libmachine: (minikube-dev-adam-Adams-Mac-mini.local) DBG | Closing plugin on server side
I0609 13:44:53.876336   50376 main.go:128] libmachine: Successfully made call to close driver server
I0609 13:44:53.876356   50376 main.go:128] libmachine: Making call to close connection to plugin binary
I0609 13:44:53.876368   50376 main.go:128] libmachine: Making call to close driver server
I0609 13:44:53.876385   50376 main.go:128] libmachine: (minikube-dev-adam-Adams-Mac-mini.local) Calling .Close
I0609 13:44:53.876558   50376 main.go:128] libmachine: (minikube-dev-adam-Adams-Mac-mini.local) DBG | Closing plugin on server side
I0609 13:44:53.876634   50376 main.go:128] libmachine: Successfully made call to close driver server
I0609 13:44:53.876648   50376 main.go:128] libmachine: Making call to close connection to plugin binary
I0609 13:44:53.876666   50376 addons.go:299] Verifying addon ingress=true in "minikube-dev-adam-Adams-Mac-mini.local"
I0609 13:44:53.902697   50376 out.go:170] 🔎  Verifying ingress addon...
🔎  Verifying ingress addon...
I0609 13:44:53.909612   50376 kapi.go:59] client config for minikube-dev-adam-Adams-Mac-mini.local: &rest.Config{Host:"https://192.168.64.140:6443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/Users/adam/.minikube/profiles/minikube-dev-adam-Adams-Mac-mini.local/client.crt", KeyFile:"/Users/adam/.minikube/profiles/minikube-dev-adam-Adams-Mac-mini.local/client.key", CAFile:"/Users/adam/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x229a3c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
I0609 13:44:53.910808   50376 cert_rotation.go:137] Starting client certificate rotation controller
I0609 13:44:53.913638   50376 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0609 13:44:53.932166   50376 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0609 13:44:53.932219   50376 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0609 13:44:54.437704   50376 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0609 13:44:54.941440   50376 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0609 13:44:55.439702   50376 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0609 13:44:55.940979   50376 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0609 13:44:56.439771   50376 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0609 13:44:56.945570   50376 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0609 13:44:57.438554   50376 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0609 13:44:57.940722   50376 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0609 13:44:58.436692   50376 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0609 13:44:58.938086   50376 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0609 13:44:59.439583   50376 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

@adamf Can you do a fresh setup and send the logs?

$ minikube delete --purge --all
$ minikube start --addons=ingress --alsologtostderr

I'm having trouble recreating the issue. Also add any driver settings and make sure to paste them here.

Ok after playing with this some more it seems the error occurs after upgrading from one minikube version to the next. We should probably find a way to resolve this in general, but as a simple workaround, the solution is to just delete the cluster and recreate it with minikube delete. Not ideal, but it'll at least get minikube working again.

yep, minikube delete fixed this problem, and I did indeed just upgrade from an older minikube. Thanks!

@andriyDev Thank you. minikube delete and restart along with the addons flag worked for me.

Still getting this error on Manjaro GNOME running on Linux kernel 5.10.42-1. I am using Minikube version 1.20.0 using the Docker driver.

I0628 13:51:57.615509   60989 system_pods.go:59] 5 kube-system pods found
I0628 13:51:57.615572   60989 system_pods.go:61] "etcd-minikube" [ccc18170-3815-4fc6-adf3-246e6165e3e4] Pending
I0628 13:51:57.615588   60989 system_pods.go:61] "kube-apiserver-minikube" [7eb10ec0-548d-408d-9555-4a7d3ea18542] Pending
I0628 13:51:57.615605   60989 system_pods.go:61] "kube-controller-manager-minikube" [dc8fba93-7714-4873-8bfa-6e355baa1426] Pending
I0628 13:51:57.615619   60989 system_pods.go:61] "kube-scheduler-minikube" [9a4cb2ef-72e5-4542-8770-e4922301d9fd] Pending
I0628 13:51:57.615639   60989 system_pods.go:61] "storage-provisioner" [8267d251-2ff7-435d-9bb3-5b1b6cb70c22] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.)
...
I0628 13:52:53.386548   60989 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0628 13:52:53.885853   60989 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0628 13:52:54.388262   60989 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
...

I've tried purging minikube and using the addons flag. Going to try an update and another purge.

I fixed my problem. The issue was some control plane pods were failing, namely the kube proxy and storage provisioner. Many Manjaro users are experiencing issues where the kube proxy's configmap had required values set to null.

I0701 12:17:29.188100       1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_max' to 196608
F0701 12:17:29.188129       1 server.go:495] open /proc/sys/net/netfilter/nf_conntrack_max: permission denied

Open the configmap: $ kubectl -n kube-system edit configmap kube-proxy Inspect it for any errors. Setting maxPerCore to 0 and min to null resolved the issue in my case.

I hope this helps somebody!

Log file created at: 2021/07/14 10:16:08 Running on machine: Jackey Binary: Built with gc go1.16.4 for linux/amd64 Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg I0714 10:16:08.711874 417072 out.go:286] Setting OutFile to fd 1 ... I0714 10:16:08.711981 417072 out.go:333] TERM=xterm,COLORTERM=, which probably does not support color I0714 10:16:08.711983 417072 out.go:299] Setting ErrFile to fd 2... I0714 10:16:08.711985 417072 out.go:333] TERM=xterm,COLORTERM=, which probably does not support color I0714 10:16:08.712116 417072 root.go:312] Updating PATH: /home/jackey/.minikube/bin W0714 10:16:08.712231 417072 root.go:291] Error reading config file at /home/jackey/.minikube/config/config.json: open /home/jackey/.minikube/config/config.json: no such file or directory I0714 10:16:08.712609 417072 addons.go:59] Setting ingress=true in profile "minikube" I0714 10:16:08.712620 417072 addons.go:135] Setting addon ingress=true in "minikube" I0714 10:16:08.712938 417072 host.go:66] Checking if "minikube" exists ... I0714 10:16:08.713575 417072 cli_runner.go:115] Run: docker container inspect minikube --format={{.State.Status}} I0714 10:16:08.770254 417072 out.go:165] - Using image k8s.gcr.io/ingress-nginx/controller:v0.44.0 I0714 10:16:08.771062 417072 out.go:165] - Using image docker.io/jettech/kube-webhook-certgen:v1.5.1 I0714 10:16:08.771936 417072 out.go:165] - Using image docker.io/jettech/kube-webhook-certgen:v1.5.1 I0714 10:16:08.772054 417072 addons.go:275] installing /etc/kubernetes/addons/ingress-configmap.yaml I0714 10:16:08.772073 417072 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-configmap.yaml (1865 bytes) I0714 10:16:08.772235 417072 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0714 10:16:08.826148 417072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jackey/.minikube/machines/minikube/id_rsa Username:docker} I0714 10:16:08.944498 417072 addons.go:275] installing /etc/kubernetes/addons/ingress-rbac.yaml I0714 10:16:08.944528 417072 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-rbac.yaml (6005 bytes) I0714 10:16:08.967492 417072 addons.go:275] installing /etc/kubernetes/addons/ingress-dp.yaml I0714 10:16:08.967508 417072 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-dp.yaml (9394 bytes) I0714 10:16:08.983924 417072 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.2/kubectl apply -f /etc/kubernetes/addons/ingress-configmap.yaml -f /etc/kubernetes/addons/ingress-rbac.yaml -f /etc/kubernetes/addons/ingress-dp.yaml I0714 10:16:09.633222 417072 addons.go:313] Verifying addon ingress=true in "minikube" I0714 10:16:09.634140 417072 out.go:165] * Verifying ingress addon... I0714 10:16:09.637464 417072 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ... I0714 10:16:09.660033 417072 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx I0714 10:16:09.660058 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:10.165156 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:10.735325 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:11.166209 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:11.665979 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:12.168512 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:12.668752 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:13.167315 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:13.667630 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:14.170185 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:14.665671 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:15.170160 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:15.669157 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:16.168435 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:16.669714 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:17.168936 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:17.666877 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:18.168656 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:18.667638 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:19.165997 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:19.668807 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:20.168566 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:20.667552 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:21.169428 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:21.667235 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:22.169025 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:22.667323 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:23.170976 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:23.669305 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:24.168142 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:24.665660 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:25.165820 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:25.668220 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:26.167698 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:26.670097 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:27.164330 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:27.670465 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:28.168914 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:28.669422 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:29.168863 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:29.668333 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:30.168692 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:30.671854 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:31.168439 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:31.667933 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:32.164569 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:32.669466 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:33.169948 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:33.666540 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:34.168744 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:34.667002 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:35.168731 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:35.668183 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:36.170024 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:36.666467 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:37.169054 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:37.666926 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:38.170997 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:38.670585 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:39.169003 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:39.667026 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:40.166977 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:40.668354 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:41.170165 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:41.669021 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:42.171226 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:42.669968 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:43.169547 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:43.667642 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:44.170394 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:44.666813 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:45.170294 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:45.665157 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:46.171048 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:46.670366 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:47.168737 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:47.668766 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:48.170162 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:48.669218 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:49.167889 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:49.669974 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:50.168536 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:50.664633 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:51.169576 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:51.670428 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:52.172392 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:52.668098 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:53.166152 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:53.664641 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:54.169206 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:54.669389 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:55.169282 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:55.670062 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:56.171921 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:56.669065 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:57.168365 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:57.667196 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:58.168685 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:58.667400 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:59.169842 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:16:59.667849 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:00.170370 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:00.668929 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:01.170666 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:01.670234 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:02.168624 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:02.668662 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:03.170305 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:03.668735 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:04.169453 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:04.668899 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:05.168763 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:05.669939 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:06.169375 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:06.673041 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:07.169881 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:07.669156 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:08.170793 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:08.668410 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:09.170358 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:09.670258 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:10.169362 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:10.665879 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:11.169015 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:11.670020 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:12.170725 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:12.675025 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:13.170887 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:13.666942 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:14.170195 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:14.668099 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:15.169041 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:15.669879 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:16.169823 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:16.668417 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:17.168635 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:17.668287 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:18.170449 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:18.666456 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:19.169915 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:19.670740 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:20.170375 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:20.668852 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:21.206826 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:21.668997 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:22.171401 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:22.670660 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:23.169010 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:23.670231 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:24.168676 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:24.667136 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:25.170597 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:25.669632 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:26.170157 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:26.668218 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:27.170185 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:27.671790 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:28.171548 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:28.668141 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:29.169877 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:29.669035 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:30.171912 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:30.668226 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:31.169867 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:31.668286 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:32.170220 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:32.670352 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:33.169103 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:33.669038 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:34.170541 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:34.669698 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:35.167331 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:35.670806 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:36.171394 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:36.669835 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:37.171076 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:37.671074 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:38.171126 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:38.670493 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:39.169852 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:39.668118 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:40.171482 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:40.668772 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:41.170136 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:41.668826 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:42.170366 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:42.668214 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:43.168282 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:43.668053 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:44.169019 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:44.669324 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:45.169384 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:45.667898 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:46.173049 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:46.669639 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:47.168701 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:47.669890 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:48.167958 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:48.666967 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:49.167248 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:49.669945 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:50.170729 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:50.669266 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:51.164979 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:51.668966 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:52.170041 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:52.669731 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:53.177615 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:53.668884 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:54.169180 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:54.668140 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:55.170473 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:55.667763 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:56.169398 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:56.669418 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:57.169574 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:57.667401 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:58.166317 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:58.667099 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:59.167444 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:17:59.668389 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:00.168110 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:00.668697 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:01.168844 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:01.668365 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:02.170155 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:02.667243 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:03.169418 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:03.670694 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:04.169509 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:04.667852 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:05.170081 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:05.666558 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:06.168393 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:06.669221 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:07.170366 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:07.666475 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:08.169205 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:08.667869 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:09.166789 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:09.668834 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:10.169054 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:10.669403 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:11.170796 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:11.667923 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:12.169035 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:12.668107 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:13.171401 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:13.670639 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:14.167511 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:14.669957 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:15.167394 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:15.669779 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:16.171334 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:16.667712 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:17.169380 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:17.668472 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:18.169304 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:18.669588 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:19.166313 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:19.669466 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:20.169408 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:20.671650 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:21.167068 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:21.664274 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:22.167502 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:22.668012 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:23.168995 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:23.666390 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:24.169630 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:24.668259 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:25.168673 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:25.667071 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:26.167596 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:26.667715 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:27.168661 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:27.666800 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:28.168536 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:28.667859 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:29.169721 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:29.667869 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:30.170331 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:30.667682 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:31.171079 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:31.666966 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:32.168598 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:32.667686 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:33.169404 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:33.677516 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:34.171177 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:34.673399 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:35.169505 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:35.667829 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:36.169117 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:36.669040 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:37.168642 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:37.666410 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:38.169107 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:38.666835 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:39.171756 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:39.666026 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:40.170139 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:40.667060 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:41.169957 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:41.717115 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:42.168194 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:42.667680 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:43.170324 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:43.669185 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:44.167467 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:44.668400 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:45.171016 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:45.669541 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:46.168679 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:46.669526 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:47.171067 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:47.667809 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:48.170115 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:48.668357 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:49.168891 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:49.666046 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:50.168864 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:50.667685 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:51.169527 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:51.669843 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:52.170150 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:52.669135 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:53.170013 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:53.668034 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:54.168532 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:54.669408 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:55.168728 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:55.667534 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:56.170113 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:56.670674 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:57.169615 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:57.670787 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:58.168965 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:58.668883 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:59.170562 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:18:59.668018 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:00.168187 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:00.669227 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:01.169493 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:01.670213 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:02.171235 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:02.667334 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:03.171499 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:03.669264 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:04.173098 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:04.666406 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:05.167521 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:05.667090 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:06.168461 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:06.671157 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:07.167873 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:07.669152 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:08.169322 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:08.664640 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:09.167844 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:09.668091 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:10.169513 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:10.666050 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:11.166418 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:11.665707 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:12.165244 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:12.665549 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:13.169320 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:13.665510 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:14.167992 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:14.669290 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:15.169460 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:15.668671 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:16.165914 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:16.672378 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:17.167852 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:17.667154 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:18.180618 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:18.668773 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:19.169111 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:19.668330 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:20.169457 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:20.667254 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:21.168950 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:21.666209 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:22.170080 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:22.669517 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:23.170907 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:23.668348 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:24.168682 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:24.668315 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:25.169678 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:25.668284 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:26.169944 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:26.667832 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:27.168331 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:27.667588 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:28.169352 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:28.667170 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:29.168897 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:29.668491 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:30.171998 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:30.666789 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:31.170301 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:31.667076 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:32.169065 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:32.667132 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:33.168957 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:33.666571 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:34.164880 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:34.666508 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:35.164898 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:35.667189 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:36.169326 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:36.665925 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:37.167851 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:37.667978 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:38.167667 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:38.666279 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:39.170122 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:39.666372 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:40.168872 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:40.669963 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:41.168979 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:41.669634 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:42.171014 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:42.666343 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:43.170717 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:43.667137 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:44.170275 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:44.665654 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:45.170040 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:45.666688 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:46.175318 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:46.669398 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:47.169665 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:47.665451 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:48.170004 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:48.668604 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:49.169647 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:49.667900 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:50.170877 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:50.667377 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:51.170039 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:51.669190 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:52.169782 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:52.666325 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:53.169943 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:53.669281 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:54.168441 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:54.668015 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:55.167275 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:55.668645 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:56.171995 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:56.668334 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:57.167791 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:57.666571 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:58.168414 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:58.666645 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:59.168850 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:19:59.668533 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:00.172091 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:00.670075 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:01.170701 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:01.669325 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:02.169962 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:02.667164 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:03.170270 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:03.667767 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:04.170799 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:04.666760 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:05.170078 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:05.667952 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:06.168258 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:06.667001 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:07.168582 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:07.665891 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:08.170790 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:08.668871 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:09.170882 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:09.668217 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:10.170910 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:10.670067 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:11.169761 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:11.665587 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:12.174054 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:12.668048 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:13.168819 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:13.667274 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:14.167730 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:14.669045 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:15.169993 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:15.668418 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:16.169308 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:16.668935 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:17.165430 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:17.666349 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:18.169106 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:18.666645 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:19.169975 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:19.668639 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:20.170061 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:20.668534 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:21.167617 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:21.667304 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:22.172106 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:22.668187 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:23.169270 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:23.666227 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:24.166779 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:24.666547 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:25.168272 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:25.666477 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:26.166516 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:26.668967 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:27.168636 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:27.669578 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:28.169465 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:28.669326 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:29.166149 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:29.669278 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:30.169048 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:30.669281 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:31.168945 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:31.668699 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:32.165876 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:32.668770 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:33.168332 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:33.667221 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:34.171639 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:34.670140 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:35.168069 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:35.667846 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:36.171244 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:36.669201 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:37.169343 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:37.667472 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:38.169492 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:38.668409 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:39.164124 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:39.668798 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:40.169750 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:40.667732 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:41.169749 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:41.667603 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:42.173168 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:42.669074 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:43.166858 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:43.668827 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:44.169886 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:44.666822 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:45.179352 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:45.669703 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:46.169909 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:46.669107 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:47.170120 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:47.669738 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:48.171422 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:48.668454 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:49.170315 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:49.669936 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:50.170834 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:50.669402 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:51.170662 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:51.669287 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:52.170485 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:52.669165 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:53.169816 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:53.668372 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:54.170097 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:54.668879 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:55.168448 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:55.668532 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:56.170731 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:56.667592 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:57.166334 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:57.666613 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:58.171115 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:58.669706 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:59.170879 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:20:59.666195 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:00.170926 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:00.669626 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:01.171062 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:01.669288 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:02.167839 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:02.667116 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:03.168970 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:03.667639 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:04.169650 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:04.669315 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:05.166335 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:05.668779 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:06.165565 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:06.669203 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:07.168853 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:07.669774 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:08.170182 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:08.667650 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:09.167283 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:09.667604 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:10.168088 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:10.666995 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:11.170661 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:11.667526 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:12.170018 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:12.687149 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:13.173279 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:13.670998 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:14.169547 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:14.668969 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:15.168247 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:15.668083 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:16.170156 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:16.666633 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:17.168852 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:17.666980 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:18.170348 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:18.666880 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:19.171193 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:19.668557 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:20.169750 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:20.668641 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:21.174697 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:21.665674 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:22.171773 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:22.669360 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:23.169854 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:23.668169 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:24.170370 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:24.669737 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:25.169664 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:25.667926 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:26.169840 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:26.664397 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:27.168076 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:27.667496 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:28.169920 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:28.669561 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:29.167545 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:29.669464 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:30.169530 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:30.668235 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:31.170191 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:31.668438 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:32.170694 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:32.669799 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:33.170485 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:33.669016 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:34.169469 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:34.667533 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:35.169364 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:35.669114 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:36.171117 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:36.668943 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:37.169305 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:37.669490 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:38.168873 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:38.670188 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:39.168552 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:39.668769 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:40.169742 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:40.669849 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:41.169645 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:41.668947 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:42.170055 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:42.669723 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:43.170723 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:43.667825 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:44.169157 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:44.669618 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:45.169180 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:45.665981 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:46.168994 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:46.668673 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:47.168924 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:47.669228 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:48.169745 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:48.668085 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:49.169125 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:49.667538 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:50.169091 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:50.667219 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:51.170375 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:51.684844 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:52.165869 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:52.669977 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:53.166221 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:53.667867 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:54.167396 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:54.667590 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:55.170364 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:55.667285 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:56.168813 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:56.669298 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:57.169434 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:57.666822 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:58.166973 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:58.669780 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:59.168834 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:21:59.666532 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:00.170042 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:00.667312 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:01.170493 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:01.668362 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:02.168075 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:02.665705 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:03.169466 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:03.669929 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:04.170721 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:04.669546 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:05.168041 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:05.669401 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:06.168807 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:06.668893 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:07.169763 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:07.670029 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:08.167294 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:08.667971 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:09.167825 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:09.667341 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:09.673906 417072 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [] I0714 10:22:09.673928 417072 kapi.go:108] duration metric: took 6m0.036524729s to wait for app.kubernetes.io/name=ingress-nginx ... I0714 10:22:09.675597 417072 out.go:165] W0714 10:22:09.675797 417072 out.go:230] X Exiting due to MK_ADDON_ENABLE: run callbacks: running callbacks: [waiting for app.kubernetes.io/name=ingress-nginx pods: timed out waiting for the condition] W0714 10:22:09.675820 417072 out.go:230] W0714 10:22:09.679597 417072 out.go:230] ╭───────────────────────────────────────────────────────────────────────────────╮ │ │ │ If the above advice does not help, please let us know: │ │ https://github.com/kubernetes/minikube/issues/new/choose │ │ │ │ Please attach the following file to the GitHub issue: │ │ - /tmp/minikube_addons_b248bc55e451029e13183e55c142eb9b7b64f0e8_0.log │ │ │ ╰───────────────────────────────────────────────────────────────────────────────╯

日志文件创建于：2021/07/14 10:16:08 在机器上运行：Jackey Binary：使用 gc go1.16.4 for linux/amd64 构建日志行格式：[IWEF]mmdd hh:mm:ss.uuuuuu threadid 文件： line] msg I0714 10:16:08.711874 417072 out.go:286] 将 OutFile 设置为 fd 1 ... I0714 10:16:08.711981 417072 out.go:333] TERM=xterm=，颜色可能不支持 I0714 10:16:08.711983 417072 out.go:299] 将 ErrFile 设置为 fd 2... I0714 10:16:08.711985 417072 out.go:333] TERM=xterm,COLORTERM :10可能不支持 4 色I10 16:08.712116 417072 root.go:312] 更新路径：/home/jackey/.minikube/bin W0714 10:16:08.712231 417072 root.go:291] 在 /home/jackey/.minikube/config/config.json 读取配置文件时出错：打开 /home/jackey/.minikube/config/config.json：没有这样的文件或目录 I0714 10：16：08.712609 417072 addons.go：59]设置入口=轮廓“minikube”真 I0714 10：16：08.712620 417072 addons.go：135]设置附加入口=真在“minikube” I0714 10:16 ：08.712938 417072 host.go：66]检查是否“minikube”存在... I0714 10：16：08.713575 417072 cli_runner.go：115]执行命令搬运工容器检查minikube --format = {{State.Status}} I0714 10:16:08.770254 417072 out.go:165] - 使用图像 k8s.gcr.io/ingress-nginx/controller:v0.44.0 I0714 10:16:08.771062 417072 out.go:165] - 使用图像jettech/kube-webhook-certgen:v1.5.1 I0714 10:16:08.771936 417072 out.go:165] - 使用图像 docker.io/jettech/kube-webhook-certgen:v1.5.1 I0714 10:16:08.772054 417072 addons.go:etc/72 addons.go:etc/77 addons/ingress-configmap.yaml I0714 10:16:08.772073 417072 ssh_runner.go:316] scp 内存--> /etc/kubernetes/addons/ingress-configmap.yaml（1865 字节） I0714 10:16:2085.16:317.207. go:115] 运行：docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0714 10:16:08.826148 417072 sshutil.go:53 ] 新 ssh 客户端：&{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jackey/.minikube/machines/minikube/id_rsa Username: docker } I0714 10:16:08.944498 417072 addons.go:275] 正在安装/kubernetes/addons/ingress-rbac.yaml I0714 10:16:08.944528 417072 ssh_runner.go:316] scp 内存 --> /etc/kubernetes/addons/ingress-rbac.yaml（6005 字节） I0714 10:16:08.967492 /etc7270.yaml 安装 /etc/kubernetes/addons/ingress-rbac.yaml /kubernetes/addons/ingress-dp.yaml I0714 10:16:08.967508 417072 ssh_runner.go:316] scp 内存 --> /etc/kubernetes/addons/ingress-dp.yaml (9394 字节) I0716:980.98 417072 ssh_runner.go:149] 运行：sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.2/kubectl apply -f /etc/kubernetes/addons/ingress-configmap.yaml - f /etc/kubernetes/addons/ingress-rbac.yaml -f /etc/kubernetes/addons/ingress-dp.yaml I0714 10:16:09.633222 417072 addons.go:313] 在“minikube”中验证插件 ingress=true I0714 10:16:09.634140 417072 out.go:165] * 正在验证入口插件... I0714 10:16:09.637464 417072 kapi.go:75] 在 ns“ingress-nginx”中等待标签为“app.kubernetes.io/name=ingress-nginx”的 pod ... I0714 10:16:09.660033 kapi.707 go:86] 为标签选择器 app.kubernetes.io/name=ingress-nginx I0714 10:16:09.660058 417072 kapi.go:96 ] 找到了 3个 Pod，正在等待 pod "app.kubernetes.io/name=ingress-nginx" , 当前状态: Pending: [] I0714 10:16:10.165156 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10:16: 10.735325 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:11.166209 417072 kapi.go:96] 等待 pod " .kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:11.665979 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:12.168512 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:16:12.668752 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:16:13.167315 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:13.667630 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:14.170185 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:14.665671 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:15.170160 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:16:15.669157 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:16:16.168435 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:16.669714 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:17.168936 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:17.666877 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:18.168656 417072 kapi]。等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:18.667638 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress" -nginx", 当前状态: Pending: [] I0714 10:16:19.165997 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:19.668807 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:20.168566 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:20.667552 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:21.169428 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:16:21.667235 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:16:22.169025 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:22.667323 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:23.170976 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:23.669305 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:24.168142 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:16:24.665660 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:16:25.165820 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:25.668220 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:26.167698 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:26.670097 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:27.164330 417072 kapi]。等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:27.670465 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress" -nginx", 当前状态: Pending: [] I0714 10:16:28.168914 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:28.669422 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:29.168863 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:29.668333 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:30.168692 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:16:30.671854 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:16:31.168439 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:31.667933 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:32.164569 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:32.669466 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:33.169948 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:16:33.666540 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:16:34.168744 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:34.667002 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:35.168731 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:35.668183 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:36.170024 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:16:36.666467 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:16:37.169054 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:37.666926 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:38.170997 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:38.670585 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:39.169003 417072 kapi]。等待 pod“app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:16:39.667026 417072 kapi.go:96] 等待 pod“app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:16:40.166977 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:40.668354 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:41.170165 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:41.669021 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:42.171226 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:16:42.669968 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:16:43.169547 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:43.667642 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:44.170394 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:44.666813 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:45.170294 417072 kapi]。等待 pod“app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:16:45.665157 417072 kapi.go:96] 等待 pod“app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:16:46.171048 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:46.670366 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:47.168737 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:47.668766 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:48.170162 417072 kapi]。等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:48.669218 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress" -nginx", 当前状态: Pending: [] I0714 10:16:49.167889 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:49.669974 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:50.168536 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:50.664633 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:51.169576 417072 kapi]。等待 pod“app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:16:51.670428 417072 kapi.go:96] 等待 pod“app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:16:52.172392 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:52.668098 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:53.166152 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:53.664641 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:54.169206 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:16:54.669389 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:16:55.169282 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:55.670062 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:56.171921 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:56.669065 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:16:57.168365 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:16:57.667196 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:16:58.168685 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :16:58.667400 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:16:59.169842 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:16:59.667849 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:00.170370 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:00.668929 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:01.170666 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:01.670234 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:02.168624 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:02.668662 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:03.170305 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:03.668735 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:04.169453 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:04.668899 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:05.168763 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:05.669939 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:06.169375 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:06.673041 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:07.169881 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:07.669156 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:08.170793 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:08.668410 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:09.170358 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:09.670258 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:10.169362 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:10.665879 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:11.169015 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:11.670020 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:12.170725 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:12.675025 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:13.170887 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:13.666942 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:14.170195 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:14.668099 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:15.169041 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:15.669879 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:16.169823 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:16.668417 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:17.168635 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:17.668287 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:18.170449 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:18.666456 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:19.169915 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:19.670740 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:20.170375 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:20.668852 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:21.206826 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:21.668997 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:22.171401 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:22.670660 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:23.169010 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:23.670231 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:24.168676 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:24.667136 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:25.170597 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:25.669632 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:26.170157 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:26.668218 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:27.170185 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:27.671790 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:28.171548 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:28.668141 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:29.169877 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:29.669035 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:30.171912 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:30.668226 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:31.169867 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:31.668286 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:32.170220 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:32.670352 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:33.169103 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:33.669038 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:34.170541 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:34.669698 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:35.167331 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:35.670806 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:36.171394 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:36.669835 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:37.171076 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:37.671074 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:38.171126 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:38.670493 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:39.169852 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:39.668118 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:40.171482 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:40.668772 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:41.170136 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:41.668826 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:42.170366 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:42.668214 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:43.168282 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:43.668053 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:44.169019 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:44.669324 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:45.169384 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:45.667898 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:46.173049 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:46.669639 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:47.168701 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:47.669890 417072 kapi.go:96] 等待 pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待定：[] I0714 10:17:48.167958 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:48.666967 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:49.167248 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:49.669945 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:50.170729 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:50.669266 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:51.164979 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:51.668966 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:52.170041 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:52.669731 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:53.177615 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:53.668884 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:54.169180 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:54.668140 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:55.170473 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:55.667763 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:56.169398 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:56.669418 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:17:57.169574 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:17:57.667401 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:17:58.166317 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :17:58.667099 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:17:59.167444 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:17:59.668389 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:18:00.168110 417072 kapi]。等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:18:00.668697 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress" -nginx", 当前状态: Pending: [] I0714 10:18:01.168844 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :18:01.668365 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:18:02.170155 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:18:02.667243 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:18:03.169418 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:18:03.670694 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:18:04.169509 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :18:04.667852 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:18:05.170081 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:18:05.666558 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:18:06.168393 417072 kapi]。等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:18:06.669221 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress" -nginx", 当前状态: Pending: [] I0714 10:18:07.170366 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :18:07.666475 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:18:08.169205 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:18:08.667869 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:18:09.166789 417072 kapi]。等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:18:09.668834 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress" -nginx", 当前状态: Pending: [] I0714 10:18:10.169054 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :18:10.669403 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:18:11.170796 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:18:11.667923 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:18:12.169035 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:18:12.668107 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:18:13.171401 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :18:13.670639 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：Pending: [] I0714 10:18:14.167511 417072 kapi.go:96] 等待pod“app.kubernetes.io/name=ingress-nginx”，当前状态：待办的： [] I0714 10:18:14.669957 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[] I0714 10:18:15.167394 417072 kapi]。等待 pod “app.kubernetes.io/name=ingress-nginx”，当前状态：Pending: [] I0714 10:18:15.669779 417072 kapi.go:96] 等待 pod “app.kubernetes.io/name=ingress” -nginx", 当前状态: Pending: [] I0714 10:18:16.171334 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx", 当前状态：Pending: [] I0714 10 :18:16.667712 417072 kapi.go:96] 等待 pod "app.kubernetes.io/name=ingress-nginx"，当前状态：待定：[

minikube version: v1.22.0 commit: a03fbcf166e6f74ef224d4a63be4277d017bb62e

Also hitting similar issue. Fedora 34 Minikube 1.22.0 (was working with minikube 1.17.1 2 days ago, no more working with same error)

I tried to call minikube delete --purge --all and then minikube start --addons ingress --alsologstderr here is an extract o fthe output:

I0726 01:17:31.895851   81255 out.go:165] 🔎  Verifying ingress addon...
🔎  Verifying ingress addon...
I0726 01:17:31.899896   81255 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0726 01:17:31.901548   81255 kapi.go:86] Found 0 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0726 01:17:41.447446   81255 kapi.go:86] Found 2 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0726 01:17:41.447531   81255 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0726 01:17:41.905507   81255 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0726 01:17:41.905527   81255 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0726 01:17:42.404923   81255 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0726 01:17:42.912979   81255 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
[...]
I0726 01:23:30.912061   81255 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0726 01:23:31.413532   81255 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0726 01:23:31.912060   81255 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0726 01:23:31.920347   81255 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0726 01:23:31.920429   81255 kapi.go:108] duration metric: took 6m0.020524792s to wait for app.kubernetes.io/name=ingress-nginx ...
W0726 01:23:31.920768   81255 out.go:230] ❗  Enabling 'ingress' returned an error: running callbacks: [waiting for app.kubernetes.io/name=ingress-nginx pods: timed out waiting for the condition]
❗  Enabling 'ingress' returned an error: running callbacks: [waiting for app.kubernetes.io/name=ingress-nginx pods: timed out waiting for the condition]

if I increase log evel to 8, there is this kind of line inseted between the repeated one of waiting for pod:

I0726 01:42:21.905473   94756 round_trippers.go:432] GET https://192.168.49.2:8443/api/v1/namespaces/ingress-nginx/pods?labelSelector=app.kubernetes.io%2Fname%3Dingress-nginx
I0726 01:42:21.905490   94756 round_trippers.go:438] Request Headers:
I0726 01:42:21.905496   94756 round_trippers.go:442]     Accept: application/json, */*
I0726 01:42:21.905500   94756 round_trippers.go:442]     User-Agent: minikube/v0.0.0 (linux/amd64) kubernetes/$Format
I0726 01:42:21.907432   94756 round_trippers.go:457] Response Status: 200 OK in 1 milliseconds
I0726 01:42:21.907445   94756 round_trippers.go:460] Response Headers:
I0726 01:42:21.907450   94756 round_trippers.go:463]     Content-Type: application/json
I0726 01:42:21.907455   94756 round_trippers.go:463]     X-Kubernetes-Pf-Flowschema-Uid: 3af97ef7-492d-4aaf-adaf-b49d8045e48d
I0726 01:42:21.907460   94756 round_trippers.go:463]     X-Kubernetes-Pf-Prioritylevel-Uid: 2e5a6f17-26dd-4eb1-b40d-a9c37a6139ef
I0726 01:42:21.907465   94756 round_trippers.go:463]     Date: Sun, 25 Jul 2021 23:42:21 GMT
I0726 01:42:21.907470   94756 round_trippers.go:463]     Cache-Control: no-cache, private
I0726 01:42:21.907613   94756 request.go:1123] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"resourceVersion":"751"},"items":[{"metadata":{"name":"ingress-nginx-admission-create-dmhc9","generateName":"ingress-nginx-admission-create-","namespace":"ingress-nginx","uid":"52612f06-1372-41a4-a537-0e36254fa3c7","resourceVersion":"750","creationTimestamp":"2021-07-25T23:39:19Z","labels":{"addonmanager.kubernetes.io/mode":"Reconcile","app.kubernetes.io/component":"admission-webhook","app.kubernetes.io/instance":"ingress-nginx","app.kubernetes.io/name":"ingress-nginx","controller-uid":"17c45092-85cf-469a-8651-6f100c4b7651","job-name":"ingress-nginx-admission-create"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"ingress-nginx-admission-create","uid":"17c45092-85cf-469a-8651-6f100c4b7651","controller":true,"blockOwnerDeletion":true}],"managedFields":[{"manager":"kube-controller-manager","operation":"Update","apiVersion":"v1","time":"2021-07-25T23:39:19Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:generateName":{},"f:labels":{".":{}," [truncated 18616 chars]

Same Issue here - please let us know how to fix this issue

Exiting due to MK_ADDON_ENABLE: run callbacks: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.2/kubectl apply -f /etc/kubernetes/addons/ingress-configmap.yaml -f /etc/kubernetes/addons/ingress-rbac.yaml -f /etc/kubernetes/addons/ingress-dp.yaml: Process exited with status 1 stdout: namespace/ingress-nginx unchanged configmap/ingress-nginx-controller unchanged configmap/tcp-services unchanged configmap/udp-services unchanged serviceaccount/ingress-nginx unchanged clusterrole.rbac.authorization.k8s.io/ingress-nginx unchanged clusterrolebinding.rbac.authorization.k8s.io/ingress-nginx unchanged role.rbac.authorization.k8s.io/ingress-nginx unchanged rolebinding.rbac.authorization.k8s.io/ingress-nginx unchanged serviceaccount/ingress-nginx-admission unchanged clusterrole.rbac.authorization.k8s.io/ingress-nginx-admission unchanged clusterrolebinding.rbac.authorization.k8s.io/ingress-nginx-admission unchanged role.rbac.authorization.k8s.io/ingress-nginx-admission unchanged rolebinding.rbac.authorization.k8s.io/ingress-nginx-admission unchanged service/ingress-nginx-controller-admission unchanged service/ingress-nginx-controller unchanged validatingwebhookconfiguration.admissionregistration.k8s.io/ingress-nginx-admission configured

stderr: Error from server (Invalid): error when applying patch: {"metadata":{"annotations":{"kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"Deployment\",\"metadata\":{\"annotations\":{},\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"app.kubernetes.io/component\":\"controller\",\"app.kubernetes.io/instance\":\"ingress-nginx\",\"app.kubernetes.io/name\":\"ingress-nginx\"},\"name\":\"ingress-nginx-controller\",\"namespace\":\"ingress-nginx\"},\"spec\":{\"minReadySeconds\":0,\"revisionHistoryLimit\":10,\"selector\":{\"matchLabels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"app.kubernetes.io/component\":\"controller\",\"app.kubernetes.io/instance\":\"ingress-nginx\",\"app.kubernetes.io/name\":\"ingress-nginx\"}},\"strategy\":{\"rollingUpdate\":{\"maxUnavailable\":1},\"type\":\"RollingUpdate\"},\"template\":{\"metadata\":{\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"app.kubernetes.io/component\":\"controller\",\"app.kubernetes.io/instance\":\"ingress-nginx\",\"app.kubernetes.io/name\":\"ingress-nginx\",\"gcp-auth-skip-secret\":\"true\"}},\"spec\":{\"containers\":[{\"args\":[\"/nginx-ingress-controller\",\"--ingress-class=nginx\",\"--configmap=$(POD_NAMESPACE)/ingress-nginx-controller\",\"--report-node-internal-ip-address\",\"--tcp-services-configmap=$(POD_NAMESPACE)/tcp-services\",\"--udp-services-configmap=$(POD_NAMESPACE)/udp-services\",\"--validating-webhook=:8443\",\"--validating-webhook-certificate=/usr/local/certificates/cert\",\"--validating-webhook-key=/usr/local/certificates/key\"],\"env\":[{\"name\":\"POD_NAME\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"metadata.name\"}}},{\"name\":\"POD_NAMESPACE\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"metadata.namespace\"}}},{\"name\":\"LD_PRELOAD\",\"value\":\"/usr/local/lib/libmimalloc.so\"}],\"image\":\"k8s.gcr.io/ingress-nginx/controller:v0.44.0@sha256:3dd0fac48073beaca2d67a78c746c7593f9c575168a17139a9955a82c63c4b9a\",\"imagePullPolicy\":\"IfNotPresent\",\"lifecycle\":{\"preStop\":{\"exec\":{\"command\":[\"/wait-shutdown\"]}}},\"livenessProbe\":{\"failureThreshold\":5,\"httpGet\":{\"path\":\"/healthz\",\"port\":10254,\"scheme\":\"HTTP\"},\"initialDelaySeconds\":10,\"periodSeconds\":10,\"successThreshold\":1,\"timeoutSeconds\":1},\"name\":\"controller\",\"ports\":[{\"containerPort\":80,\"hostPort\":80,\"name\":\"http\",\"protocol\":\"TCP\"},{\"containerPort\":443,\"hostPort\":443,\"name\":\"https\",\"protocol\":\"TCP\"},{\"containerPort\":8443,\"name\":\"webhook\",\"protocol\":\"TCP\"}],\"readinessProbe\":{\"failureThreshold\":3,\"httpGet\":{\"path\":\"/healthz\",\"port\":10254,\"scheme\":\"HTTP\"},\"initialDelaySeconds\":10,\"periodSeconds\":10,\"successThreshold\":1,\"timeoutSeconds\":1},\"resources\":{\"requests\":{\"cpu\":\"100m\",\"memory\":\"90Mi\"}},\"securityContext\":{\"allowPrivilegeEscalation\":true,\"capabilities\":{\"add\":[\"NET_BIND_SERVICE\"],\"drop\":[\"ALL\"]},\"runAsUser\":101},\"volumeMounts\":[{\"mountPath\":\"/usr/local/certificates/\",\"name\":\"webhook-cert\",\"readOnly\":true}]}],\"dnsPolicy\":\"ClusterFirst\",\"serviceAccountName\":\"ingress-nginx\",\"volumes\":[{\"name\":\"webhook-cert\",\"secret\":{\"secretName\":\"ingress-nginx-admission\"}}]}}}}\n"},"labels":{"addonmanager.kubernetes.io/mode":"Reconcile","app.kubernetes.io/managed-by":null,"app.kubernetes.io/version":null,"helm.sh/chart":null}},"spec":{"minReadySeconds":0,"selector":{"matchLabels":{"addonmanager.kubernetes.io/mode":"Reconcile"}},"strategy":{"$retainKeys":["rollingUpdate","type"],"rollingUpdate":{"maxUnavailable":1}},"template":{"metadata":{"labels":{"addonmanager.kubernetes.io/mode":"Reconcile","gcp-auth-skip-secret":"true"}},"spec":{"$setElementOrder/containers":[{"name":"controller"}],"containers":[{"$setElementOrder/ports":[{"containerPort":80},{"containerPort":443},{"containerPort":8443}],"args":["/nginx-ingress-controller","--ingress-class=nginx","--configmap=$(POD_NAMESPACE)/ingress-nginx-controller","--report-node-internal-ip-address","--tcp-services-configmap=$(POD_NAMESPACE)/tcp-services","--udp-services-configmap=$(POD_NAMESPACE)/udp-services","--validating-webhook=:8443","--validating-webhook-certificate=/usr/local/certificates/cert","--validating-webhook-key=/usr/local/certificates/key"],"image":"k8s.gcr.io/ingress-nginx/controller:v0.44.0@sha256:3dd0fac48073beaca2d67a78c746c7593f9c575168a17139a9955a82c63c4b9a","name":"controller","ports":[{"containerPort":80,"hostPort":80},{"containerPort":443,"hostPort":443}]}],"nodeSelector":null,"terminationGracePeriodSeconds":null}}}} to: Resource: "apps/v1, Resource=deployments", GroupVersionKind: "apps/v1, Kind=Deployment" Name: "ingress-nginx-controller", Namespace: "ingress-nginx" for: "/etc/kubernetes/addons/ingress-dp.yaml": Deployment.apps "ingress-nginx-controller" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"addonmanager.kubernetes.io/mode":"Reconcile", "app.kubernetes.io/component":"controller", "app.kubernetes.io/instance":"ingress-nginx", "app.kubernetes.io/name":"ingress-nginx"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable Error from server (Invalid): error when applying patch: {"metadata":{"annotations":{"helm.sh/hook":null,"helm.sh/hook-delete-policy":null,"kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"batch/v1\",\"kind\":\"Job\",\"metadata\":{\"annotations\":{},\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"app.kubernetes.io/component\":\"admission-webhook\",\"app.kubernetes.io/instance\":\"ingress-nginx\",\"app.kubernetes.io/name\":\"ingress-nginx\"},\"name\":\"ingress-nginx-admission-create\",\"namespace\":\"ingress-nginx\"},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"app.kubernetes.io/component\":\"admission-webhook\",\"app.kubernetes.io/instance\":\"ingress-nginx\",\"app.kubernetes.io/name\":\"ingress-nginx\"},\"name\":\"ingress-nginx-admission-create\"},\"spec\":{\"containers\":[{\"args\":[\"create\",\"--host=ingress-nginx-controller-admission,ingress-nginx-controller-admission.$(POD_NAMESPACE).svc\",\"--namespace=$(POD_NAMESPACE)\",\"--secret-name=ingress-nginx-admission\"],\"env\":[{\"name\":\"POD_NAMESPACE\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"metadata.namespace\"}}}],\"image\":\"docker.io/jettech/kube-webhook-certgen:v1.5.1@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7\",\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"create\"}],\"restartPolicy\":\"OnFailure\",\"securityContext\":{\"runAsNonRoot\":true,\"runAsUser\":2000},\"serviceAccountName\":\"ingress-nginx-admission\"}}}}\n"},"labels":{"addonmanager.kubernetes.io/mode":"Reconcile","app.kubernetes.io/managed-by":null,"app.kubernetes.io/version":null,"helm.sh/chart":null}},"spec":{"template":{"metadata":{"labels":{"addonmanager.kubernetes.io/mode":"Reconcile","app.kubernetes.io/managed-by":null,"app.kubernetes.io/version":null,"helm.sh/chart":null}},"spec":{"$setElementOrder/containers":[{"name":"create"}],"containers":[{"image":"docker.io/jettech/kube-webhook-certgen:v1.5.1@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7","name":"create"}]}}}} to: Resource: "batch/v1, Resource=jobs", GroupVersionKind: "batch/v1, Kind=Job" Name: "ingress-nginx-admission-create", Namespace: "ingress-nginx" for: "/etc/kubernetes/addons/ingress-dp.yaml": Job.batch "ingress-nginx-admission-create" is invalid: spec.template: Invalid value: core.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-admission-create", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(time.Location)(nil)}}, DeletionTimestamp:(v1.Time)(nil), DeletionGracePeriodSeconds:(int64)(nil), Labels:map[string]string{"addonmanager.kubernetes.io/mode":"Reconcile", "app.kubernetes.io/component":"admission-webhook", "app.kubernetes.io/instance":"ingress-nginx", "app.kubernetes.io/name":"ingress-nginx", "controller-uid":"a248445e-1a3b-4295-b3f5-155ecd02cd53", "job-name":"ingress-nginx-admission-create"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:core.PodSpec{Volumes:[]core.Volume(nil), InitContainers:[]core.Container(nil), Containers:[]core.Container{core.Container{Name:"create", Image:"docker.io/jettech/kube-webhook-certgen:v1.5.1@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7", Command:[]string(nil), Args:[]string{"create", "--host=ingress-nginx-controller-admission,ingress-nginx-controller-admission.$(POD_NAMESPACE).svc", "--namespace=$(POD_NAMESPACE)", "--secret-name=ingress-nginx-admission"}, WorkingDir:"", Ports:[]core.ContainerPort(nil), EnvFrom:[]core.EnvFromSource(nil), Env:[]core.EnvVar{core.EnvVar{Name:"POD_NAMESPACE", Value:"", ValueFrom:(core.EnvVarSource)(0xc00754d180)}}, Resources:core.ResourceRequirements{Limits:core.ResourceList(nil), Requests:core.ResourceList(nil)}, VolumeMounts:[]core.VolumeMount(nil), VolumeDevices:[]core.VolumeDevice(nil), LivenessProbe:(core.Probe)(nil), ReadinessProbe:(core.Probe)(nil), StartupProbe:(core.Probe)(nil), Lifecycle:(core.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(core.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]core.EphemeralContainer(nil), RestartPolicy:"OnFailure", TerminationGracePeriodSeconds:(int64)(0xc002b51238), ActiveDeadlineSeconds:(int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"ingress-nginx-admission", AutomountServiceAccountToken:(bool)(nil), NodeName:"", SecurityContext:(core.PodSecurityContext)(0xc00865c280), ImagePullSecrets:[]core.LocalObjectReference(nil), Hostname:"", Subdomain:"", SetHostnameAsFQDN:(bool)(nil), Affinity:(core.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]core.Toleration(nil), HostAliases:[]core.HostAlias(nil), PriorityClassName:"", Priority:(int32)(nil), PreemptionPolicy:(core.PreemptionPolicy)(nil), DNSConfig:(core.PodDNSConfig)(nil), ReadinessGates:[]core.PodReadinessGate(nil), RuntimeClassName:(string)(nil), Overhead:core.ResourceList(nil), EnableServiceLinks:(bool)(nil), TopologySpreadConstraints:[]core.TopologySpreadConstraint(nil)}}: field is immutable Error from server (Invalid): error when applying patch: {"metadata":{"annotations":{"helm.sh/hook":null,"helm.sh/hook-delete-policy":null,"kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"batch/v1\",\"kind\":\"Job\",\"metadata\":{\"annotations\":{},\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"app.kubernetes.io/component\":\"admission-webhook\",\"app.kubernetes.io/instance\":\"ingress-nginx\",\"app.kubernetes.io/name\":\"ingress-nginx\"},\"name\":\"ingress-nginx-admission-patch\",\"namespace\":\"ingress-nginx\"},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"app.kubernetes.io/component\":\"admission-webhook\",\"app.kubernetes.io/instance\":\"ingress-nginx\",\"app.kubernetes.io/name\":\"ingress-nginx\"},\"name\":\"ingress-nginx-admission-patch\"},\"spec\":{\"containers\":[{\"args\":[\"patch\",\"--webhook-name=ingress-nginx-admission\",\"--namespace=$(POD_NAMESPACE)\",\"--patch-mutating=false\",\"--secret-name=ingress-nginx-admission\",\"--patch-failure-policy=Fail\"],\"env\":[{\"name\":\"POD_NAMESPACE\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"metadata.namespace\"}}}],\"image\":\"docker.io/jettech/kube-webhook-certgen:v1.5.1@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7\",\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"patch\"}],\"restartPolicy\":\"OnFailure\",\"securityContext\":{\"runAsNonRoot\":true,\"runAsUser\":2000},\"serviceAccountName\":\"ingress-nginx-admission\"}}}}\n"},"labels":{"addonmanager.kubernetes.io/mode":"Reconcile","app.kubernetes.io/managed-by":null,"app.kubernetes.io/version":null,"helm.sh/chart":null}},"spec":{"template":{"metadata":{"labels":{"addonmanager.kubernetes.io/mode":"Reconcile","app.kubernetes.io/managed-by":null,"app.kubernetes.io/version":null,"helm.sh/chart":null}},"spec":{"$setElementOrder/containers":[{"name":"patch"}],"containers":[{"image":"docker.io/jettech/kube-webhook-certgen:v1.5.1@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7","name":"patch"}]}}}} to: Resource: "batch/v1, Resource=jobs", GroupVersionKind: "batch/v1, Kind=Job" Name: "ingress-nginx-admission-patch", Namespace: "ingress-nginx" for: "/etc/kubernetes/addons/ingress-dp.yaml": Job.batch "ingress-nginx-admission-patch" is invalid: spec.template: Invalid value: core.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-admission-patch", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(time.Location)(nil)}}, DeletionTimestamp:(v1.Time)(nil), DeletionGracePeriodSeconds:(int64)(nil), Labels:map[string]string{"addonmanager.kubernetes.io/mode":"Reconcile", "app.kubernetes.io/component":"admission-webhook", "app.kubernetes.io/instance":"ingress-nginx", "app.kubernetes.io/name":"ingress-nginx", "controller-uid":"4d91945d-f827-4fe2-96b4-d2bd9dad961a", "job-name":"ingress-nginx-admission-patch"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:core.PodSpec{Volumes:[]core.Volume(nil), InitContainers:[]core.Container(nil), Containers:[]core.Container{core.Container{Name:"patch", Image:"docker.io/jettech/kube-webhook-certgen:v1.5.1@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7", Command:[]string(nil), Args:[]string{"patch", "--webhook-name=ingress-nginx-admission", "--namespace=$(POD_NAMESPACE)", "--patch-mutating=false", "--secret-name=ingress-nginx-admission", "--patch-failure-policy=Fail"}, WorkingDir:"", Ports:[]core.ContainerPort(nil), EnvFrom:[]core.EnvFromSource(nil), Env:[]core.EnvVar{core.EnvVar{Name:"POD_NAMESPACE", Value:"", ValueFrom:(core.EnvVarSource)(0xc006ee1e20)}}, Resources:core.ResourceRequirements{Limits:core.ResourceList(nil), Requests:core.ResourceList(nil)}, VolumeMounts:[]core.VolumeMount(nil), VolumeDevices:[]core.VolumeDevice(nil), LivenessProbe:(core.Probe)(nil), ReadinessProbe:(core.Probe)(nil), StartupProbe:(core.Probe)(nil), Lifecycle:(core.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(core.SecurityContext)(nil), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]core.EphemeralContainer(nil), RestartPolicy:"OnFailure", TerminationGracePeriodSeconds:(int64)(0xc00e7b5438), ActiveDeadlineSeconds:(int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"ingress-nginx-admission", AutomountServiceAccountToken:(bool)(nil), NodeName:"", SecurityContext:(core.PodSecurityContext)(0xc00bda3780), ImagePullSecrets:[]core.LocalObjectReference(nil), Hostname:"", Subdomain:"", SetHostnameAsFQDN:(bool)(nil), Affinity:(core.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]core.Toleration(nil), HostAliases:[]core.HostAlias(nil), PriorityClassName:"", Priority:(int32)(nil), PreemptionPolicy:(core.PreemptionPolicy)(nil), DNSConfig:(core.PodDNSConfig)(nil), ReadinessGates:[]core.PodReadinessGate(nil), RuntimeClassName:(string)(nil), Overhead:core.ResourceList(nil), EnableServiceLinks:(bool)(nil), TopologySpreadConstraints:[]core.TopologySpreadConstrai

If someone will help, I was facing the same problem, and delete didn't help. I'm managed to fix it by updating minikube from v1.20.0 to v1.22.0 and starting with the addon flag

If anyone here with the issue persisting could run:

minikube kubectl -- get pods --selector="app.kubernetes.io/name=ingress-nginx" -n ingress-nginx

post the result, and then for all non-running non-completed jobs run:

minikube kubectl -- get logs <pod name> -n ingress-nginx

and post the logs, that would be really helpful!

~~Output:~~

$ minikube kubectl -- get pods --selector="app.kubernetes.io/name=ingress-nginx" -n ingress-nginx
    > kubectl.sha256: 64 B / 64 B [--------------------------] 100.00% ? p/s 0s
    > kubectl: 44.27 MiB / 44.27 MiB [-------------] 100.00% 39.25 MiB p/s 1.3s
Unable to connect to the server: dial tcp 192.168.48.3:8443: connect: no route to host

Sorry, forget to start minikube, after I run minikube start, the problem

waiting for app.kubernetes.io/name=ingress-nginx pods: timed out waiting for the condition

is disappeared :)

minikube kubectl -- get logs

[k8s@iZ8vb1cgnytsf2bnokinqcZ root]$ minikube kubectl -- get pods --selector="app.kubernetes.io/name=ingress-nginx" -n ingress-nginx NAME READY STATUS RESTARTS AGE ingress-nginx-admission-create-rcm4q 0/1 Completed 0 36m ingress-nginx-admission-patch-pdsjb 0/1 Completed 0 36m ingress-nginx-controller-59b45fb494-2tcfb 0/1 ImagePullBackOff 0 36m

minikube kubectl -- get logs ingress-nginx-controller-59b45fb494-2tcfb -n ingress-nginx error: the server doesn't have a resource type "logs"

Hopefully helping info

@Bytesu Oh I totally messed up, it should be minikube kubectl -- logs ingress-nginx-controller-59b45fb494-2tcfb -n ingress-nginx. That'll give even more info.

The image pull backoff is already fascinating though!

.... containers:

name: controller image: 'k8s.gcr.io/ingress-nginx/controller:v0.44.0' ......

i edited yaml ,changed 'k8s.gcr.io/ingress-nginx/controller:v0.44.0@sha256:........ ' to 'k8s.gcr.io/ingress-nginx/controller:v0.44.0', then kubectl apply -f spec.yaml and minikube addons enable ingress , IT WORKS!!!!!

.... containers:

name: controller image: 'k8s.gcr.io/ingress-nginx/controller:v0.44.0' ......

i edited yaml ,changed 'k8s.gcr.io/ingress-nginx/controller:v0.44.0@sha256:........ ' to 'k8s.gcr.io/ingress-nginx/controller:v0.44.0', then kubectl apply -f spec.yaml and minikube addons enable ingress , IT WORKS!!!!!

where is the spec.yaml？

For an immediate fix, https://github.com/andriyDev/minikube/blob/232384b9b2a448db793d595870aa1dea35c18a26/pkg/minikube/assets/addons.go?plain=1#L248, you can modify that to no longer include the @sha... bit. This however is entirely the wrong solution. The sha shouldn't be wrong?

@Himkwok thank you so much for this discovery! Do you mind running docker image pull k8s.gcr.io/ingress-nginx/controller:v0.44.0@sha256:3dd0fac48073beaca2d67a78c746c7593f9c575168a17139a9955a82c63c4b9a? If that fails, run k8s.gcr.io/ingress-nginx/controller:v0.44.0. For both please paste the output here! That would be very helpful!

Actually, @Bytesu if you're able to compile minikube, do you mind replicating @Himkwok's result by removing the sha bit like I said before?

@Bytesu There's an even easier way to test this actually, just use minikube addons enable ingress --images="IngressController=ingress-nginx/controller:v0.44.0"

Are either of you using a corp registry of some kind?

minikube addons enable ingress --images="IngressController=ingress-nginx/controller:v0.44.0

no , I used another way to solve my problem . Thanks very much . and I suppose my issue is leaded by network that I couldn't access the k8s.gcr.io

minikube addons enable ingress --images="IngressController=ingress-nginx/controller:v0.44.0

no , I used another way to solve my problem . Thanks very much . and I suppose my issue is leaded by network that I couldn't access the k8s.gcr.io

you can pull image from dockerhub

docker pull pollyduan/ingress-nginx-controller:v0.44.0

docker tag pollyduan/ingress-nginx-controller:v0.44.0 k8s.gcr.io/ingress-nginx/controller:v0.44.0

.... containers:

name: controller image: 'k8s.gcr.io/ingress-nginx/controller:v0.44.0' ......

i edited yaml ,changed 'k8s.gcr.io/ingress-nginx/controller:v0.44.0@sha256:........ ' to 'k8s.gcr.io/ingress-nginx/controller:v0.44.0', then kubectl apply -f spec.yaml and minikube addons enable ingress , IT WORKS!!!!!

where is the spec.yaml？

kubectl edit pods ingress-nginx-controller-7b8cbd57c9-jnzmd -n ingress-nginx and change to 'image: k8s.gcr.io/ingress-nginx/controller:v0.44.0'， I hope these can help

minikube addons enable ingress --images="IngressController=ingress-nginx/controller:v0.44.0

no , I used another way to solve my problem . Thanks very much . and I suppose my issue is leaded by network that I couldn't access the k8s.gcr.io

you can pull image from dockerhub

docker pull pollyduan/ingress-nginx-controller:v0.44.0

docker tag pollyduan/ingress-nginx-controller:v0.44.0 k8s.gcr.io/ingress-nginx/controller:v0.44.0

I had tried like this before I pasted here, it's still something wrong with it

[minikube@localhost root]$ minikube kubectl -- get pods --selector="app.kubernetes.io/name=ingress-nginx" -n ingress-nginx
NAME                                       READY   STATUS              RESTARTS   AGE
ingress-nginx-admission-create-k9dr6       0/1     ImagePullBackOff    0          17m
ingress-nginx-admission-patch-cjwvj        0/1     ImagePullBackOff    0          17m
ingress-nginx-controller-8668846c7-8q7fp   0/1     ContainerCreating   0          17m

[minikube@localhost root]$ minikube kubectl -- logs ingress-nginx-admission-create-k9dr6  -n ingress-nginx
Error from server (BadRequest): container "create" in pod "ingress-nginx-admission-create-k9dr6" is waiting to start: trying and failing to pull image

[minikube@localhost root]$ minikube kubectl -- logs ingress-nginx-admission-patch-cjwvj  -n ingress-nginx
Error from server (BadRequest): container "patch" in pod "ingress-nginx-admission-patch-cjwvj" is waiting to start: trying and failing to pull image

[minikube@localhost root]$ minikube kubectl -- logs ingress-nginx-controller-8668846c7-8q7fp  -n ingress-nginx
Error from server (BadRequest): container "controller" in pod "ingress-nginx-controller-8668846c7-8q7fp" is waiting to start: ContainerCreating

It's like image not pulled , but the log below looks like pulled success.

[minikube@localhost root]$ minikube addons enable ingress
    ▪ Using image registry.cn-hangzhou.aliyuncs.com/google_containers/docker.io/jettech/kube-webhook-certgen:v1.5.1@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7 (global image repository)
    ▪ Using image registry.cn-hangzhou.aliyuncs.com/google_containers/ingress-nginx/controller:v0.44.0@sha256:3dd0fac48073beaca2d67a78c746c7593f9c575168a17139a9955a82c63c4b9a (global image repository)
    ▪ Using image registry.cn-hangzhou.aliyuncs.com/google_containers/docker.io/jettech/kube-webhook-certgen:v1.5.1@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7 (global image repository)
🔎  Verifying ingress addon...

kube connect this

Running on machine: localhost
Binary: Built with gc go1.16.4 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0827 15:15:16.997734   60608 out.go:286] Setting OutFile to fd 1 ...
I0827 15:15:16.998152   60608 out.go:338] isatty.IsTerminal(1) = true
I0827 15:15:16.998158   60608 out.go:299] Setting ErrFile to fd 2...
I0827 15:15:16.998161   60608 out.go:338] isatty.IsTerminal(2) = true
I0827 15:15:16.998366   60608 root.go:312] Updating PATH: /home/minikube/.minikube/bin
I0827 15:15:16.999761   60608 addons.go:59] Setting ingress=true in profile "minikube"
I0827 15:15:16.999776   60608 addons.go:135] Setting addon ingress=true in "minikube"
I0827 15:15:17.000074   60608 host.go:66] Checking if "minikube" exists ...
I0827 15:15:17.001043   60608 cli_runner.go:115] Run: docker container inspect minikube --format={{.State.Status}}
I0827 15:15:17.169484   60608 out.go:165]     ▪ Using image registry.cn-hangzhou.aliyuncs.com/google_containers/ingress-nginx/controller:v0.44.0@sha256:3dd0fac48073beaca2d67a78c746c7593f9c575168a17139a9955a82c63c4b9a (global image repository)
I0827 15:15:17.170033   60608 out.go:165]     ▪ Using image registry.cn-hangzhou.aliyuncs.com/google_containers/docker.io/jettech/kube-webhook-certgen:v1.5.1@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7 (global image repository)
I0827 15:15:17.170506   60608 out.go:165]     ▪ Using image registry.cn-hangzhou.aliyuncs.com/google_containers/docker.io/jettech/kube-webhook-certgen:v1.5.1@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7 (global image repository)
I0827 15:15:17.170579   60608 addons.go:275] installing /etc/kubernetes/addons/ingress-configmap.yaml
I0827 15:15:17.170598   60608 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-configmap.yaml (1865 bytes)
I0827 15:15:17.170680   60608 cli_runner.go:115] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0827 15:15:17.216884   60608 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49172 SSHKeyPath:/home/minikube/.minikube/machines/minikube/id_rsa Username:docker}
I0827 15:15:17.339541   60608 addons.go:275] installing /etc/kubernetes/addons/ingress-rbac.yaml
I0827 15:15:17.339557   60608 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-rbac.yaml (6005 bytes)
I0827 15:15:17.353338   60608 addons.go:275] installing /etc/kubernetes/addons/ingress-dp.yaml
I0827 15:15:17.353345   60608 ssh_runner.go:316] scp memory --> /etc/kubernetes/addons/ingress-dp.yaml (9539 bytes)
I0827 15:15:17.367147   60608 ssh_runner.go:149] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.21.2/kubectl apply -f /etc/kubernetes/addons/ingress-configmap.yaml -f /etc/kubernetes/addons/ingress-rbac.yaml -f /etc/kubernetes/addons/ingress-dp.yaml
I0827 15:15:18.310897   60608 addons.go:313] Verifying addon ingress=true in "minikube"
I0827 15:15:18.322408   60608 out.go:165] 🔎  Verifying ingress addon...
I0827 15:15:18.339342   60608 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0827 15:15:18.419365   60608 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0827 15:21:18.423923   60608 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 15:21:18.426565   60608 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 15:21:18.426575   60608 kapi.go:108] duration metric: took 6m0.089261197s to wait for app.kubernetes.io/name=ingress-nginx ...
I0827 15:21:18.435685   60608 out.go:165]
W0827 15:21:18.435908   60608 out.go:230] ❌  Exiting due to MK_ADDON_ENABLE: run callbacks: running callbacks: [waiting for app.kubernetes.io/name=ingress-nginx pods: timed out waiting for the condition]
W0827 15:21:18.435937   60608 out.go:230]
W0827 15:21:18.446326   60608 out.go:230] ╭─────────────────────────────────────────────────────────────────────────────╮
│                                                                             │
│    😿  If the above advice does not help, please let us know:               │
│    👉  https://github.com/kubernetes/minikube/issues/new/choose             │
│                                                                             │
│    Please attach the following file to the GitHub issue:                    │
│    - /tmp/minikube_addons_657d376187cd72746604141ceddc839ee4e6f05e_0.log    │
│                                                                             │
╰─────────────────────────────────────────────────────────────────────────────╯

I think I know why, it because the China's great GFW build by you know who.

In the minikube , here is a --image-mirror-country , and unfortunately I should set it to cn ,to use aliyun's registry.

But in some reason, it not available. so I get that error.

If other dude in China, not use --image-mirror-country, it will use gcr and will get same thing for good reason by GFW.

solution

In minikube ssh pull image from docker hub :

jettech/kube-webhook-certgen:v1.5.1
willdockerhub/ingress-nginx-controller:v0.44.0

The second is a personal image just mirror ingress-nginx/controller for gcr

And then rename tag to what you need, and then minikube addons enable ingress

I think the registry of aliyun can use for his own build maybe

I had the same issue with 'minikube addons enable ingress' command. Hence tried the following solution: Tried to pull the ingress image directly using 'docker pull' from command line Got the error - Error response from daemon: Get https://registry-1.docker.io/v2/: dial tcp 192.168.10.1:443: connect: connection refused Changed the network to another ISP and reissued the 'docker pull' command. This time the 2 images (k8s.gcr.io/ingress-nginx/controller:v0.44.0 , docker.io/jettech/kube-webhook-certgen:v1.5.1 ) downloaded properly Post that, issued the minikube addons enable ingress command and it worked successfully

I faced this image downloading issue during other scenarios also and had to use the same - switch ISP solution. So bottomline - one possibility to check is

Change ISP
Download images using normal 'docker pull '
Try 'minikube addons enable ingress' command again

I think I know why, it because the China's great GFW build by you know who.

In the minikube , here is a --image-mirror-country , and unfortunately I should set it to cn ,to use aliyun's registry.

But in some reason, it not available. so I get that error.

If other dude in China, not use --image-mirror-country, it will use gcr and will get same thing for good reason by GFW.

solution

In minikube ssh pull image from docker hub :

jettech/kube-webhook-certgen:v1.5.1

willdockerhub/ingress-nginx-controller:v0.44.0

The second is a personal image just mirror ingress-nginx/controller for gcr

And then rename tag to what you need, and then minikube addons enable ingress

I think the registry of aliyun can use for his own build maybe

@yangyaofei I would be happy to accept a PR or review a PR that fixes it

do you think this PR helps ?

https://github.com/kubernetes/minikube/pull/12411

I think I know why, it because the China's great GFW build by you know who. In the minikube , here is a --image-mirror-country , and unfortunately I should set it to cn ,to use aliyun's registry. But in some reason, it not available. so I get that error. If other dude in China, not use --image-mirror-country, it will use gcr and will get same thing for good reason by GFW.

solution

In minikube ssh pull image from docker hub :

jettech/kube-webhook-certgen:v1.5.1

willdockerhub/ingress-nginx-controller:v0.44.0

The second is a personal image just mirror ingress-nginx/controller for gcr And then rename tag to what you need, and then minikube addons enable ingress I think the registry of aliyun can use for his own build maybe

@yangyaofei I would be happy to accept a PR or review a PR that fixes it

do you think this PR helps ?

12411

Hi @medyagh thank you to let me know this.

Actually, I'm a starter with this. so I don't know it will help or not . But I saw #11785 , I think this will be helped.

And I have a suggest that is add more error message when cannot pull the image, and add little more document about it and a general solution for this. There are two types dev in china, one is read official doc and use google, another is read chinese blog and use baidu . The devs only use baidu will follow the chinese blog and probably use the version build by alibaba( aliyun ), The devs can use google, only thing they need is to know why this error occur, and then they can solve it by this own or with a simple guide with few sentences.

And for #11785 , it's good. I'm not sure that googlecontainer repo is build by aliyun or some user of aliyun. I think that's not reliable, unless that repo is build by aliyun officially and can offer a map for the image's name. If not, sooner or later , someone will open a same issue. And that's why I think a few extra document is needed.

For the record, same block for the ghcr and other repo, so technically is not the problem of minikube or gcr 😂😂😂

I had same problem. There is how I solved it: OS: Ubuntu 20.04.2 LTS minikube: v1.16.0 driver: docker

An error:

ERR command "minikube addons enable ingress" output:
* Verifying ingress addon...

X Exiting due to MK_ENABLE: run callbacks: running callbacks: [waiting for app.kubernetes.io/name=ingress-nginx pods: timed out waiting for the condition]
*
* If the above advice does not help, please let us know:

The solution:

Looking for pod "kube-proxy" with status "CrashLoopBackOff": kubectl get pod -n kube-system
Need to get logs of this service: kubectl logs kube-proxy-randomsymbols -n kube-system
Logs has to contain an error linked with parameter net/netfilter/nf_conntrack_max by reason Permission denied. Need to set this parameter manually. Value of this parameter contains in logs. In my case value was 196608. sudo sysctl net/netfilter/nf_conntrack_max=196608
Restart or recreate minikube

Note: Value of net/netfilter/nf_conntrack_max resets after every reboot

I'm in china and here is my way to solve this problem: minikube version: v1.23.2

I found no matter how I specify the --image="IngressController=***", It still goes to k8s.gcr.io So I looked into source code and found this

"ingress": NewAddon([]*BinAsset{
        MustBinAsset(addons.IngressAssets,
            "ingress/ingress-deploy.yaml.tmpl",
            vmpath.GuestAddonsDir,
            "ingress-deploy.yaml",
            "0640"),
    }, false, "ingress", "", map[string]string{
        // https://github.com/kubernetes/ingress-nginx/blob/557604f4ef526f7755d36089b617bc7686c389f9/deploy/static/provider/kind/deploy.yaml#L323
        "IngressController": "ingress-nginx/controller:v1.0.0-beta.3@sha256:44a7a06b71187a4529b0a9edee5cc22bdf71b414470eff696c3869ea8d90a695",
        // https://github.com/kubernetes/ingress-nginx/blob/557604f4ef526f7755d36089b617bc7686c389f9/deploy/static/provider/kind/deploy.yaml#L612
        "KubeWebhookCertgenCreate": "k8s.gcr.io/ingress-nginx/kube-webhook-certgen:v1.0@sha256:f3b6b39a6062328c095337b4cadcefd1612348fdd5190b1dcbcb9b9e90bd8068",
        // https://github.com/kubernetes/ingress-nginx/blob/557604f4ef526f7755d36089b617bc7686c389f9/deploy/static/provider/kind/deploy.yaml#L660
        "KubeWebhookCertgenPatch": "k8s.gcr.io/ingress-nginx/kube-webhook-certgen:v1.0@sha256:f3b6b39a6062328c095337b4cadcefd1612348fdd5190b1dcbcb9b9e90bd8068",
    }, map[string]string{
        "IngressController": "k8s.gcr.io",
    }),

func NewAddon(assets []*BinAsset, enabled bool, addonName string, maintainer string, images map[string]string, registries map[string]string) *Addon {
    a := &Addon{
        Assets:     assets,
        enabled:    enabled,
        addonName:  addonName,
        Maintainer: maintainer,
        Images:     images,
        Registries: registries,
    }
    return a
}

So I use minikube addons enable ingress --registries="IngressController=docker.io" --images="IngressController=wangshun1024/ingress-nginx-controller:v1.0.0-beta.3,KubeWebhookCertgenCreate=liangjw/kube-webhook-certgen:v1.0,KubeWebhookCertgenPatch=liangjw/kube-webhook-certgen:v1.0" and it works.

For others: You can found a replacement ingress and kube-webhook-certgen images for your version of minikube and use the same command as I but with different --images and --registries parameters.

Some suggestions: Maybe remove the Registries parameter for IngressController and move into Images directly is a better idea? just like
KubeWebhookCertgenCreate and KubeWebhookCertgenPatch.

I got the same issue when running minikube addons enable ingress

minikube version: v1.24.0
Kubernetes version : It's been said in the detail mode.
Client Version: version.Info{Major:"1", Minor:"22", GitVersion:"v1.22.3", GitCommit:"c92036820499fedefec0f847e2054d824aea6cd1", GitTreeState:"clean", BuildDate:"2021-10-27T18:41:28Z", GoVersion:"go1.16.9", Compiler:"gc", Platform:"linux/amd64"} Server Version: version.Info{Major:"1", Minor:"22", GitVersion:"v1.22.3", GitCommit:"c92036820499fedefec0f847e2054d824aea6cd1", GitTreeState:"clean", BuildDate:"2021-10-27T18:35:25Z", GoVersion:"go1.16.9", Compiler:"gc", Platform:"linux/amd64"}

Docker Version: It's been said in the detail mode .
Client: Docker Engine - Community Version: 20.10.10 API version: 1.41 Go version: go1.16.9 Git commit: b485636 Built: Mon Oct 25 07:42:59 2021 OS/Arch: linux/amd64 Context: default Experimental: true

Server: Docker Engine - Community Engine: Version: 20.10.10 API version: 1.41 (minimum version 1.12) Go version: go1.16.9 Git commit: e2f740d Built: Mon Oct 25 07:41:08 2021 OS/Arch: linux/amd64 Experimental: false containerd: Version: 1.4.11 GitCommit: 5b46e404f6b9f661a205e28d59c982d3634148f8 runc: Version: 1.0.2 GitCommit: v1.0.2-0-g52b36a2 docker-init: Version: 0.19.0 GitCommit: de40ad0

I even tested out this approach:

minikube stop
minikube start
minikube addons enable ingress

Hint: I first enabled the ingress add-on and then went for the Mandatory ingress-nginx services. The result was confusing. It went all good for all of them with the exception of the last 2 items on the list.

job.batch/ingress-nginx-admission-create unchanged
job.batch/ingress-nginx-admission-patch unchanged

What's wrong with them? I even deleted the minikube and started it over. It hasn't worked though.

The Kubernetes project currently lacks enough contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

After 90d of inactivity, lifecycle/stale is applied
After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

Mark this issue or PR as fresh with /remove-lifecycle stale
Mark this issue or PR as rotten with /lifecycle rotten
Close this issue or PR with /close
Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

there seem to be potentially multiple different/similar problems reported and also several solutions/workarounds in this issue (specifically around firewalls) and we've implemented a number of improvements in the meantime (last being https://github.com/kubernetes/minikube/pull/13439 that's merger but not yet released), so I'll close this issue now and please open a new one if you still face issues with the ingress addon

thank you

/close

I have tried all the suggestions in this thread but still having this issue? What is the final solution?

我已经尝试了这个线程中的所有建议，但仍然有这个问题？最终的解决方案是什么？ I also have this situation and it is not resolved at present

Even if I managed to manually pull the 2 images related to enabling ingress, the minikube addons enable ingress still failed with the same error. The logic is kind of dumb when it can't detect whether the required images are already in minikube VM. Simply put, if you can't pull, I pull it for you, and you still don't work.

kubernetes / minikube