[BUG] 2.5.12 Rancher HA deployment failed calling webhook "validate.nginx.ingress.kubernetes.io"

[ronhorton]

Rancher Server Setup

• Rancher version: 2.5.12
• Installation option (Docker install/Helm Chart): Helm
  • If Helm Chart, Kubernetes Cluster and version (RKE1, RKE2, k3s, EKS, etc):
• Proxy/Cert Details:

Information about the Cluster

• Kubernetes version: v1.20.14
• Cluster Type (Local/Downstream): local
  • If downstream, what type of cluster? (Custom/Imported or specify provider for Hosted/Infrastructure Provider):

    HA Deployment Fails due to Internal error occurred: failed calling webhook "validate.nginx.ingress.kubernetes.io": run cmd: export KUBECONFIG=/src/rancher-validation/tests/v3_api/resource/kube_config_cluster-ha-filled.yml && helm_v3 install rancher rancher-latest/rancher --version 2.5.12 --namespace cattle-system --set hostname=host.url --set ingress.tls.source=secret --set bootstrapPassword=admin return code: 1 output: b'Error: Internal error occurred: failed calling webhook "validate.nginx.ingress.kubernetes.io": Post "[https://ingress-nginx-controller-admission.ingress-nginx.svc:443/networking/v1beta1/ingresses?timeout=10s](https://ingress-nginx-controller-admission.ingress-nginx.svc/networking/v1beta1/ingresses?timeout=10s)": dial tcp x.x.x.x:443: connect: connection refused\n' run cmd: kubectl -n cattle-system get pods -l app=rancher --no-headers -o custom-columns=name:.metadata.name | while read rancherpod; do kubectl -n cattle-system exec $rancherpod -c rancher -- loglevel --set trace; done To Reproduce this was caught while running deploy ha jenkins job

    Result ha not accessible Expected Result

    ha accessible, ingress created Screenshots

    Additional context

    workaround: https://github.com/rancher/rancher/issues/33067#issuecomment-856000277 encountered this issue with all 2.5.x installation attempts

[stefanlasiewski]

This continues to happen with Rancher 2.6.

[son-la]

and Rancher 2.7.9 ...

I have RKE 1.4.8 Kubernetes v1.26.7-rancher1-1 on RHEL9.2 (Firewalld disabled). The issue is really random