search

karmada-io / karmada

Open, Multi-Cloud, Multi-Cluster Kubernetes Orchestration
https://karmada.io
Apache License 2.0
4.39k stars 867 forks source link

When I used the Kylin v10 version to deploy. #5292

Open xrwang8 opened 1 month ago

xrwang8 commented 1 month ago

What happened:

image 
Events:
  Type     Reason     Age                    From               Message
  ----     ------     ----                   ----               -------
  Normal   Scheduled  39m                    default-scheduler  Successfully assigned karmada-ewvg84/wwww-karmada-apiserver-d976b9b44-6jj7j to 172.28.10.5
  Normal   Created    39m                    kubelet            Created container kube-apiserver
  Normal   Started    39m                    kubelet            Started container kube-apiserver
  Warning  Unhealthy  37m (x8 over 39m)      kubelet            Liveness probe failed: Get "https://10.42.1.10:5443/livez": net/http: TLS handshake timeout
  Normal   Killing    37m                    kubelet            Container kube-apiserver failed liveness probe, will be restarted
  Normal   Pulled     37m (x2 over 39m)      kubelet            Container image "registry.k8s.io/kube-apiserver:v1.26.12" already present on machine
  Warning  Unhealthy  37m                    kubelet            Readiness probe failed: Get "https://10.42.1.10:5443/readyz": read tcp 172.28.10.5:55720->10.42.1.10:5443: read: connection reset by peer
  Warning  Unhealthy  9m33s (x111 over 39m)  kubelet            Readiness probe failed: Get "https://10.42.1.10:5443/readyz": net/http: TLS handshake timeout
  Warning  BackOff    4m23s (x64 over 25m)   kubelet            Back-off restarting failed container

What you expected to happen:

How to reproduce it (as minimally and precisely as possible):

Anything else we need to know?:

Environment: Kylin v10

liangyuanpeng commented 1 month ago

how do you deploy the karmada? and provide more detail for here, like etcd logs,etcd status, kubernetes version, etc...

xrwang8 commented 1 month ago

karamada-operator k8s 1.20.10

xrwang8 commented 1 month ago

karmada-operator logs

I0803 02:04:20.636460       1 crd.go:145] "[unpack] Successfully unpacked crd tar" karmada="karmada-ws91rh/xrwang"
I0803 02:04:20.639581       1 cert.go:70] "[certs] Skip certs task, found previous certificates in secret" karmada="karmada-ws91rh/xrwang"
I0803 02:04:20.652390       1 upload.go:217] "[upload-KarmadaCert] Successfully uploaded karmada certs to secret" karmada="karmada-ws91rh/xrwang"
I0803 02:04:20.660219       1 upload.go:251] "[upload-etcdCert] Successfully uploaded etcd certs to secret" karmada="karmada-ws91rh/xrwang"
I0803 02:04:20.666748       1 upload.go:278] "[upload-webhookCert] Successfully uploaded webhook certs to secret" karmada="karmada-ws91rh/xrwang"
E0803 02:04:20.697083       1 planner.go:114] "failed to executed the workflow" err="failed to install etcd component, err: err when creating etcd client service, err: unable to update Service: Service \"xrwang-karmada-etcd-client\" is invalid: spec.clusterIPs[0]: Invalid value: []string(nil): primary clusterIP can not be unset" workflow="init" karmada="karmada-ws91rh/xrwang"
E0803 02:04:20.704362       1 controller.go:329] "Reconciler error" err="failed to install etcd component, err: err when creating etcd client service, err: unable to update Service: Service \"xrwang-karmada-etcd-client\" is invalid: spec.clusterIPs[0]: Invalid value: []string(nil): primary clusterIP can not be unset" controller="karmada" controllerGroup="operator.karmada.io" controllerKind="Karmada" Karmada="karmada-ws91rh/xrwang" namespace="karmada-ws91rh" name="xrwang" reconcileID="938462c7-794e-46de-a1a4-6ea56710dbe8"
I0803 02:04:21.984980       1 controller.go:100] "Reconciling karmada" name="xrwang"
I0803 02:04:21.985033       1 planner.go:108] "Start execute the workflow" workflow="init" karmada="karmada-ws91rh/xrwang"
I0803 02:04:22.000274       1 crd.go:65] "[prepare-crds] Using crd folder" folder="/var/lib/karmada/1.9.0" karmada="karmada-ws91rh/xrwang"
I0803 02:04:22.000647       1 crd.go:85] "[download-crds] Skip download crd yaml files, the crd tar exists on disk" karmada="karmada-ws91rh/xrwang"
I0803 02:04:22.000676       1 crd.go:142] "[unpack] These crds yaml files have been decompressed in the path" path="/var/lib/karmada/1.9.0/crds" karmada="karmada-ws91rh/xrwang"
I0803 02:04:22.000831       1 crd.go:145] "[unpack] Successfully unpacked crd tar" karmada="karmada-ws91rh/xrwang"
I0803 02:04:22.004531       1 cert.go:70] "[certs] Skip certs task, found previous certificates in secret" karmada="karmada-ws91rh/xrwang"
I0803 02:04:22.016215       1 upload.go:217] "[upload-KarmadaCert] Successfully uploaded karmada certs to secret" karmada="karmada-ws91rh/xrwang"
I0803 02:04:22.023951       1 upload.go:251] "[upload-etcdCert] Successfully uploaded etcd certs to secret" karmada="karmada-ws91rh/xrwang"
I0803 02:04:22.031118       1 upload.go:278] "[upload-webhookCert] Successfully uploaded webhook certs to secret" karmada="karmada-ws91rh/xrwang"
E0803 02:04:22.060768       1 planner.go:114] "failed to executed the workflow" err="failed to install etcd component, err: err when creating etcd client service, err: unable to update Service: Service \"xrwang-karmada-etcd-client\" is invalid: spec.clusterIPs[0]: Invalid value: []string(nil): primary clusterIP can not be unset" workflow="init" karmada="karmada-ws91rh/xrwang"
E0803 02:04:22.067002       1 controller.go:329] "Reconciler error" err="failed to install etcd component, err: err when creating etcd client service, err: unable to update Service: Service \"xrwang-karmada-etcd-client\" is invalid: spec.clusterIPs[0]: Invalid value: []string(nil): primary clusterIP can not be unset" controller="karmada" controllerGroup="operator.karmada.io" controllerKind="Karmada" Karmada="karmada-ws91rh/xrwang" namespace="karmada-ws91rh" name="xrwang" reconcileID="99ecf2bf-4131-420b-a4c6-26e1c851063f"
I0803 02:04:24.627987       1 controller.go:100] "Reconciling karmada" name="xrwang"
I0803 02:04:24.628097       1 planner.go:108] "Start execute the workflow" workflow="init" karmada="karmada-ws91rh/xrwang"
I0803 02:04:24.646633       1 crd.go:65] "[prepare-crds] Using crd folder" folder="/var/lib/karmada/1.9.0" karmada="karmada-ws91rh/xrwang"
I0803 02:04:24.646965       1 crd.go:85] "[download-crds] Skip download crd yaml files, the crd tar exists on disk" karmada="karmada-ws91rh/xrwang"
I0803 02:04:24.646983       1 crd.go:142] "[unpack] These crds yaml files have been decompressed in the path" path="/var/lib/karmada/1.9.0/crds" karmada="karmada-ws91rh/xrwang"
I0803 02:04:24.647001       1 crd.go:145] "[unpack] Successfully unpacked crd tar" karmada="karmada-ws91rh/xrwang"
I0803 02:04:24.650415       1 cert.go:70] "[certs] Skip certs task, found previous certificates in secret" karmada="karmada-ws91rh/xrwang"
I0803 02:04:24.666478       1 upload.go:217] "[upload-KarmadaCert] Successfully uploaded karmada certs to secret" karmada="karmada-ws91rh/xrwang"
I0803 02:04:24.674163       1 upload.go:251] "[upload-etcdCert] Successfully uploaded etcd certs to secret" karmada="karmada-ws91rh/xrwang"
I0803 02:04:24.682097       1 upload.go:278] "[upload-webhookCert] Successfully uploaded webhook certs to secret" karmada="karmada-ws91rh/xrwang"
E0803 02:04:24.714238       1 planner.go:114] "failed to executed the workflow" err="failed to install etcd component, err: err when creating etcd client service, err: unable to update Service: Service \"xrwang-karmada-etcd-client\" is invalid: spec.clusterIPs[0]: Invalid value: []string(nil): primary clusterIP can not be unset" workflow="init" karmada="karmada-ws91rh/xrwang"
E0803 02:04:24.721329       1 controller.go:329] "Reconciler error" err="failed to install etcd component, err: err when creating etcd client service, err: unable to update Service: Service \"xrwang-karmada-etcd-client\" is invalid: spec.clusterIPs[0]: Invalid value: []string(nil): primary clusterIP can not be unset" controller="karmada" controllerGroup="operator.karmada.io" controllerKind="Karmada" Karmada="karmada-ws91rh/xrwang" namespace="karmada-ws91rh" name="xrwang" reconcileID="5844fca8-9807-4430-8d9b-9ee6f4af52d6"
I0803 02:04:29.842151       1 controller.go:100] "Reconciling karmada" name="xrwang"
I0803 02:04:29.842242       1 planner.go:108] "Start execute the workflow" workflow="init" karmada="karmada-ws91rh/xrwang"
I0803 02:04:29.857177       1 crd.go:65] "[prepare-crds] Using crd folder" folder="/var/lib/karmada/1.9.0" karmada="karmada-ws91rh/xrwang"
I0803 02:04:29.857860       1 crd.go:85] "[download-crds] Skip download crd yaml files, the crd tar exists on disk" karmada="karmada-ws91rh/xrwang"
I0803 02:04:29.857883       1 crd.go:142] "[unpack] These crds yaml files have been decompressed in the path" path="/var/lib/karmada/1.9.0/crds" karmada="karmada-ws91rh/xrwang"
I0803 02:04:29.857890       1 crd.go:145] "[unpack] Successfully unpacked crd tar" karmada="karmada-ws91rh/xrwang"
I0803 02:04:29.860963       1 cert.go:70] "[certs] Skip certs task, found previous certificates in secret" karmada="karmada-ws91rh/xrwang"
I0803 02:04:29.872976       1 upload.go:217] "[upload-KarmadaCert] Successfully uploaded karmada certs to secret" karmada="karmada-ws91rh/xrwang"
I0803 02:04:29.883102       1 upload.go:251] "[upload-etcdCert] Successfully uploaded etcd certs to secret" karmada="karmada-ws91rh/xrwang"
I0803 02:04:29.890417       1 upload.go:278] "[upload-webhookCert] Successfully uploaded webhook certs to secret" karmada="karmada-ws91rh/xrwang"
E0803 02:04:29.919954       1 planner.go:114] "failed to executed the workflow" err="failed to install etcd component, err: err when creating etcd client service, err: unable to update Service: Service \"xrwang-karmada-etcd-client\" is invalid: spec.clusterIPs[0]: Invalid value: []string(nil): primary clusterIP can not be unset" workflow="init" karmada="karmada-ws91rh/xrwang"
E0803 02:04:29.926101       1 controller.go:329] "Reconciler error" err="failed to install etcd component, err: err when creating etcd client service, err: unable to update Service: Service \"xrwang-karmada-etcd-client\" is invalid: spec.clusterIPs[0]: Invalid value: []string(nil): primary clusterIP can not be unset" controller="karmada" controllerGroup="operator.karmada.io" controllerKind="Karmada" Karmada="karmada-ws91rh/xrwang" namespace="karmada-ws91rh" name="xrwang" reconcileID="fee6bade-7ad3-4d18-ae29-a0ffcd74299f"
I0803 02:04:40.166402       1 controller.go:100] "Reconciling karmada" name="xrwang"
I0803 02:04:40.166470       1 planner.go:108] "Start execute the workflow" workflow="init" karmada="karmada-ws91rh/xrwang"
I0803 02:04:40.183074       1 crd.go:65] "[prepare-crds] Using crd folder" folder="/var/lib/karmada/1.9.0" karmada="karmada-ws91rh/xrwang"
I0803 02:04:40.183702       1 crd.go:85] "[download-crds] Skip download crd yaml files, the crd tar exists on disk" karmada="karmada-ws91rh/xrwang"
I0803 02:04:40.183783       1 crd.go:142] "[unpack] These crds yaml files have been decompressed in the path" path="/var/lib/karmada/1.9.0/crds" karmada="karmada-ws91rh/xrwang"
I0803 02:04:40.183848       1 crd.go:145] "[unpack] Successfully unpacked crd tar" karmada="karmada-ws91rh/xrwang"
I0803 02:04:40.187602       1 cert.go:70] "[certs] Skip certs task, found previous certificates in secret" karmada="karmada-ws91rh/xrwang"
I0803 02:04:40.198813       1 upload.go:217] "[upload-KarmadaCert] Successfully uploaded karmada certs to secret" karmada="karmada-ws91rh/xrwang"
I0803 02:04:40.205939       1 upload.go:251] "[upload-etcdCert] Successfully uploaded etcd certs to secret" karmada="karmada-ws91rh/xrwang"
I0803 02:04:40.212739       1 upload.go:278] "[upload-webhookCert] Successfully uploaded webhook certs to secret" karmada="karmada-ws91rh/xrwang"
E0803 02:04:40.246253       1 planner.go:114] "failed to executed the workflow" err="failed to install etcd component, err: err when creating etcd client service, err: unable to update Service: Service \"xrwang-karmada-etcd-client\" is invalid: spec.clusterIPs[0]: Invalid value: []string(nil): primary clusterIP can not be unset" workflow="init" karmada="karmada-ws91rh/xrwang"
E0803 02:04:40.254415       1 controller.go:329] "Reconciler error" err="failed to install etcd component, err: err when creating etcd client service, err: unable to update Service: Service \"xrwang-karmada-etcd-client\" is invalid: spec.clusterIPs[0]: Invalid value: []string(nil): primary clusterIP can not be unset" controller="karmada" controllerGroup="operator.karmada.io" controllerKind="Karmada" Karmada="karmada-ws91rh/xrwang" namespace="karmada-ws91rh" name="xrwang" reconcileID="6795c4be-df82-4c98-bc71-78a93ef80709"
I0803 02:05:00.735354       1 controller.go:100] "Reconciling karmada" name="xrwang"
I0803 02:05:00.735437       1 planner.go:108] "Start execute the workflow" workflow="init" karmada="karmada-ws91rh/xrwang"
I0803 02:05:00.760595       1 crd.go:65] "[prepare-crds] Using crd folder" folder="/var/lib/karmada/1.9.0" karmada="karmada-ws91rh/xrwang"
I0803 02:05:00.760958       1 crd.go:85] "[download-crds] Skip download crd yaml files, the crd tar exists on disk" karmada="karmada-ws91rh/xrwang"
I0803 02:05:00.760976       1 crd.go:142] "[unpack] These crds yaml files have been decompressed in the path" path="/var/lib/karmada/1.9.0/crds" karmada="karmada-ws91rh/xrwang"
I0803 02:05:00.761003       1 crd.go:145] "[unpack] Successfully unpacked crd tar" karmada="karmada-ws91rh/xrwang"
I0803 02:05:00.764452       1 cert.go:70] "[certs] Skip certs task, found previous certificates in secret" karmada="karmada-ws91rh/xrwang"
I0803 02:05:00.778288       1 upload.go:217] "[upload-KarmadaCert] Successfully uploaded karmada certs to secret" karmada="karmada-ws91rh/xrwang"
I0803 02:05:00.787331       1 upload.go:251] "[upload-etcdCert] Successfully uploaded etcd certs to secret" karmada="karmada-ws91rh/xrwang"
I0803 02:05:00.794040       1 upload.go:278] "[upload-webhookCert] Successfully uploaded webhook certs to secret" karmada="karmada-ws91rh/xrwang"
E0803 02:05:00.826380       1 planner.go:114] "failed to executed the workflow" err="failed to install etcd component, err: err when creating etcd client service, err: unable to update Service: Service \"xrwang-karmada-etcd-client\" is invalid: spec.clusterIPs[0]: Invalid value: []string(nil): primary clusterIP can not be unset" workflow="init" karmada="karmada-ws91rh/xrwang"
E0803 02:05:00.833956       1 controller.go:329] "Reconciler error" err="failed to install etcd component, err: err when creating etcd client service, err: unable to update Service: Service \"xrwang-karmada-etcd-client\" is invalid: spec.clusterIPs[0]: Invalid value: []string(nil): primary clusterIP can not be unset" controller="karmada" controllerGroup="operator.karmada.io" controllerKind="Karmada" Karmada="karmada-ws91rh/xrwang" namespace="karmada-ws91rh" name="xrwang" reconcileID="ec82f065-d19d-4239-9b74-9e3fefe9e502"
liangyuanpeng commented 1 month ago

karamada-operator

cc @calvin0327