Open szbjb opened 4 years ago
Internal Server Error rpc error: code = Internal desc = describe resources failed: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: connection error: desc = "transport: Error while dialing dial tcp 10.0.0.68:9113: connect: connection timed out"
`kubesphere-alerting-system alerting-db-ctrl-job-85f7z 0/1 Completed 0 31m 172.17.9.33 192.168.123.60 <none> <none> Every 1.0s: kubectl get pods -o wide -A Sat Dec 28 13:24:49 2019 NAMESPACE NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES default my-grafana-986448dfb-kprm5 1/1 Running 0 10h 172.17.9.10 192.168.123.60 <none> <none> default my-nfs-client-nfs-client-provisioner-7d94f6b97b-h5ct6 1/1 Running 0 10h 172.17.9.4 192.168.123.60 <none> <none> default web-nginx-9mdwp 1/1 Running 0 3h24m 172.17.9.79 192.168.123.60 <none> <none> istio-system istio-citadel-69cc4f4864-mrk9b 1/1 Running 0 10h 172.17.9.32 192.168.123.60 <none> <none> istio-system istio-galley-698d44d7b-4bqxv 1/1 Running 0 10h 172.17.9.56 192.168.123.60 <none> <none> istio-system istio-ingressgateway-7dc4478b56-zxr4p 1/1 Running 0 10h 172.17.9.52 192.168.123.60 <none> <none> istio-system istio-init-crd-10-1.3.3-wpzs6 0/1 Completed 0 10h 172.17.9.30 192.168.123.60 <none> <none> istio-system istio-init-crd-11-1.3.3-mjz7f 0/1 Completed 0 10h 172.17.9.31 192.168.123.60 <none> <none> istio-system istio-init-crd-12-1.3.3-tcgp4 0/1 Completed 0 10h 172.17.9.32 192.168.123.60 <none> <none> istio-system istio-pilot-6984d9c885-g9fw4 2/2 Running 0 10h 172.17.9.31 192.168.123.60 <none> <none> istio-system istio-policy-85475fdbb4-j6clz 2/2 Running 2 10h 172.17.9.51 192.168.123.60 <none> <none> istio-system istio-sidecar-injector-6868965dcc-7gc9t 1/1 Running 0 10h 172.17.9.58 192.168.123.60 <none> <none> istio-system istio-telemetry-77dbf8f8c-ql6bz 2/2 Running 2 10h 172.17.9.30 192.168.123.60 <none> <none> istio-system jaeger-collector-676fcfc5b6-2rbvm 1/1 Running 0 10h 172.17.9.54 192.168.123.60 <none> <none> istio-system jaeger-operator-6d6c985c57-mgm56 1/1 Running 0 10h 172.17.9.53 192.168.123.60 <none> <none> istio-system jaeger-query-655495d7bb-nrkqm 2/2 Running 0 10h 172.17.9.55 192.168.123.60 <none> <none> kube-system coredns-86bb88b7d7-b788d 1/1 Running 0 10h 172.17.9.3 192.168.123.60 <none> <none> kube-system coredns-86bb88b7d7-l9mtz 1/1 Running 0 10h 172.17.9.6 192.168.123.60 <none> <none> kube-system coredns-86bb88b7d7-rdbcc 1/1 Running 0 10h 172.17.9.5 192.168.123.60 <none> <none> kube-system heapster-bcfd594cd-rxzm4 1/1 Running 0 59m 172.17.9.80 192.168.123.60 <none> <none> kube-system kubernetes-dashboard-55c78b7fd9-4kskm 1/1 Running 0 10h 172.17.9.11 192.168.123.60 <none> <none> kube-system tiller-deploy-7dd4495c74-pxxpp 1/1 Running 0 10h 172.17.9.2 192.168.123.60 <none> <none> kubesphere-alerting-system alerting-client-7c66d559d4-w7tdk 1/1 Running 0 10h 172.17.9.38 192.168.123.60 <none> <none> kubesphere-alerting-system alerting-db-ctrl-job-85f7z 0/1 Completed 0 10h 172.17.9.33 192.168.123.60 <none> <none> kubesphere-alerting-system alerting-db-init-job-5gt4g 0/1 Completed 0 10h 172.17.9.31 192.168.123.60 <none> <none> kubesphere-alerting-system alerting-executor-96db579d4-2wd6v 2/2 Running 0 10h 172.17.9.35 192.168.123.60 <none> <none> kubesphere-alerting-system alerting-manager-869b5786b7-cxqpf 1/1 Running 0 10h 172.17.9.37 192.168.123.60 <none> <none> kubesphere-alerting-system alerting-watcher-fb94896dd-9jdgd 1/1 Running 0 10h 172.17.9.36 192.168.123.60 <none> <none> kubesphere-alerting-system notification-db-ctrl-job-j7d8r 0/1 Completed 0 10h 172.17.9.32 192.168.123.60 <none> <none> kubesphere-alerting-system notification-db-init-job-jzvn5 0/1 Completed 0 10h 172.17.9.30 192.168.123.60 <none> <none> kubesphere-alerting-system notification-deployment-7f8bcbb498-hd7tr 1/1 Running 0 10h 172.17.9.34 192.168.123.60 <none> <none> kubesphere-controls-system default-http-backend-56c8cfc8cc-28hp8 1/1 Running 0 10h 172.17.9.16 192.168.123.60 <none> <none> kubesphere-controls-system kubectl-admin-549cdddd4d-sbng7 1/1 Running 0 10h 172.17.9.24 192.168.123.60 <none> <none> kubesphere-controls-system kubectl-devops-75cdc7b87b-mh8g6 1/1 Running 0 3h31m 172.17.9.78 192.168.123.60 <none> <none> kubesphere-devops-system ks-devops-db-ctrl-job-8mt88 0/1 Completed 0 10h 172.17.9.62 192.168.123.60 <none> <none> kubesphere-devops-system ks-devops-db-init-job-f9mcd 0/1 Completed 0 10h 172.17.9.60 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-gitaly-0 1/1 Running 0 10h 172.17.9.69 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-gitlab-exporter-575fc5866f-zvvb5 1/1 Running 0 10h 172.17.9.44 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-gitlab-shell-8564b56ccf-qdj8b 1/1 Running 0 10h 172.17.9.70 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-gitlab-shell-8564b56ccf-vd9qp 1/1 Running 0 10h 172.17.9.76 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-migrations.1-nq87z 0/1 Completed 0 10h 172.17.9.78 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-minio-69cb8665b-xt59l 1/1 Running 0 10h 172.17.9.74 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-minio-create-buckets.1-q42z8 0/1 Completed 0 10h 172.17.9.75 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-nginx-ingress-controller-77d6b57c84-2rhph 1/1 Running 0 10h 172.17.9.64 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-nginx-ingress-default-backend-64fc94cdc7-snjcc 1/1 Running 0 10h 172.17.9.71 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-postgresql-5fb496454f-hpxt2 2/2 Running 0 10h 172.17.9.65 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-redis-57987d64f9-nxqlh 2/2 Running 0 10h 172.17.9.72 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-registry-64986474fd-d2j8x 1/1 Running 0 10h 172.17.9.77 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-shared-secrets.1-zi4-7rgtq 0/1 Error 0 10h 172.17.9.65 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-shared-secrets.1-zi4-ks878 0/1 Error 0 10h 172.17.9.44 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-sidekiq-all-in-1-687ff44c57-5gsst 1/1 Running 0 10h 172.17.9.73 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-task-runner-5c778bc897-kx989 1/1 Running 0 10h 172.17.9.66 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-unicorn-96d7fd46f-4s6pg 2/2 Running 0 10h 172.17.9.67 192.168.123.60 <none> <none> kubesphere-devops-system ks-gitlab-unicorn-96d7fd46f-xchqb 2/2 Running 0 10h 172.17.9.68 192.168.123.60 <none> <none> kubesphere-devops-system ks-harbor-harbor-chartmuseum-678c8c48c4-wkcmg 1/1 Running 0 10h 172.17.9.50 192.168.123.60 <none> <none> kubesphere-devops-system ks-harbor-harbor-clair-9fc99559d-vbsw9 1/1 Running 7 10h 172.17.9.21 192.168.123.60 <none> <none> kubesphere-devops-system ks-harbor-harbor-core-5d8b78b9bf-j7z4g 1/1 Running 4 10h 172.17.9.27 192.168.123.60 <none> <none> kubesphere-devops-system ks-harbor-harbor-database-0 1/1 Running 0 10h 172.17.9.48 192.168.123.60 <none> <none> kubesphere-devops-system ks-harbor-harbor-jobservice-fdfc6d755-86lcf 1/1 Running 4 10h 172.17.9.20 192.168.123.60 <none> <none> kubesphere-devops-system ks-harbor-harbor-nginx-7c669556b8-69rzg 1/1 Running 0 10h 172.17.9.19 192.168.123.60 <none> <none> kubesphere-devops-system ks-harbor-harbor-portal-7d584fd48c-bmjbn 1/1 Running 0 10h 172.17.9.28 192.168.123.60 <none> <none> kubesphere-devops-system ks-harbor-harbor-redis-0 1/1 Running 0 10h 172.17.9.49 192.168.123.60 <none> <none> kubesphere-devops-system ks-harbor-harbor-registry-ff494fddd-dh4fx 2/2 Running 0 10h 172.17.9.47 192.168.123.60 <none> <none> kubesphere-devops-system ks-harbor-setup-ldap-tmzvj 0/1 Completed 0 10h 172.17.9.60 192.168.123.60 <none> <none> kubesphere-devops-system ks-jenkins-5f79756f64-sx6s6 1/1 Running 0 10h 172.17.9.75 192.168.123.60 <none> <none> kubesphere-devops-system ks-sonarqube-postgresql-5579dfc7d-lsrgl 1/1 Running 0 10h 172.17.9.62 192.168.123.60 <none> <none> kubesphere-devops-system ks-sonarqube-sonarqube-5964689cd4-rfvms 1/1 Running 0 10h 172.17.9.60 192.168.123.60 <none> <none> kubesphere-devops-system s2ioperator-0 1/1 Running 1 10h 172.17.9.59 192.168.123.60 <none> <none> kubesphere-devops-system uc-jenkins-update-center-576f9f676-255vf 1/1 Running 0 10h 172.17.9.29 192.168.123.60 <none> <none> kubesphere-logging-system elasticsearch-logging-data-0 1/1 Running 0 10h 172.17.9.43 192.168.123.60 <none> <none> kubesphere-logging-system elasticsearch-logging-discovery-0 1/1 Running 0 10h 172.17.9.42 192.168.123.60 <none> <none> kubesphere-logging-system elasticsearch-logging-kibana-69478fc4db-l5bm4 1/1 Running 0 10h 172.17.9.40 192.168.123.60 <none> <none> kubesphere-logging-system fluent-bit-wnhlt 2/2 Running 0 10h 172.17.9.33 192.168.123.60 <none> <none> kubesphere-logging-system logging-fluentbit-operator-6bf8b86665-k6g26 1/1 Running 0 10h 172.17.9.39 192.168.123.60 <none> <none> kubesphere-logging-system logsidecar-injector-6dfcd594d7-8sfck 1/1 Running 0 10h 172.17.9.46 192.168.123.60 <none> <none> kubesphere-logging-system logsidecar-injector-6dfcd594d7-zbk8r 1/1 Running 0 10h 172.17.9.45 192.168.123.60 <none> <none> kubesphere-monitoring-system kube-state-metrics-5558ffb87f-zlq78 4/4 Running 0 10h 172.17.9.25 192.168.123.60 <none> <none> kubesphere-monitoring-system node-exporter-7mkls 2/2 Running 0 10h 192.168.123.60 192.168.123.60 <none> <none> kubesphere-monitoring-system prometheus-k8s-0 3/3 Running 1 10h 172.17.9.22 192.168.123.60 <none> <none> kubesphere-monitoring-system prometheus-k8s-system-0 3/3 Running 1 10h 172.17.9.26 192.168.123.60 <none> <none> kubesphere-monitoring-system prometheus-operator-6f59fff977-dpwvd 1/1 Running 0 10h 172.17.9.23 192.168.123.60 <none> <none> kubesphere-system etcd-5ff47ccd88-grq4k 1/1 Running 0 10h 172.17.9.9 192.168.123.60 <none> <none> kubesphere-system ks-account-7b84489c88-nkbq8 1/1 Running 0 10h 172.17.9.18 192.168.123.60 <none> <none> kubesphere-system ks-apigateway-6cc8d6cb4d-pjw6t 1/1 Running 0 10h 172.17.9.12 192.168.123.60 <none> <none> kubesphere-system ks-apiserver-685967756c-4h44s 1/1 Running 0 10h 172.17.9.57 192.168.123.60 <none> <none> kubesphere-system ks-console-8579f4b8d7-624rr 1/1 Running 0 10h 172.17.9.17 192.168.123.60 <none> <none> kubesphere-system ks-controller-manager-7bb7c8484b-8k76q 1/1 Running 0 10h 172.17.9.41 192.168.123.60 <none> <none> kubesphere-system ks-installer-76b7888579-czzph 1/1 Running 0 10h 172.17.9.13 192.168.123.60 <none> <none> kubesphere-system minio-cf9dff644-s9xjj 1/1 Running 0 10h 172.17.9.7 192.168.123.60 <none> <none> kubesphere-system mysql-798dffc85f-vh8lq 1/1 Running 0 10h 172.17.9.8 192.168.123.60 <none> <none> kubesphere-system openldap-0 1/1 Running 0 10h 172.17.9.14 192.168.123.60 <none> <none> kubesphere-system redis-746bd7d798-xv82z 1/1 Running 0 10h 172.17.9.15 192.168.123.60 <none> <none> openpitrix-system hyperpitrix-release-app-job-t72q7 0/1 Completed 0 10h 172.17.9.56 192.168.123.60 <none> <none> openpitrix-system openpitrix-app-db-ctrl-job-sbjc7 0/1 Completed 0 10h 172.17.9.55 192.168.123.60 <none> <none> openpitrix-system openpitrix-attachment-db-ctrl-job-b6ggv 0/1 Completed 1 10h 172.17.9.51 192.168.123.60 <none> <none> openpitrix-system openpitrix-cluster-db-ctrl-job-7scft 0/1 Completed 2 10h 172.17.9.52 192.168.123.60 <none> <none> openpitrix-system openpitrix-db-init-job-kszvf 0/1 Completed 0 10h 172.17.9.62 192.168.123.60 <none> <none> openpitrix-system openpitrix-hyperpitrix-deployment-665cf858d7-znrkf 1/1 Running 0 10h 172.17.9.61 192.168.123.60 <none> <none> openpitrix-system openpitrix-isv-db-ctrl-job-tvslx 0/1 Completed 2 10h 172.17.9.54 192.168.123.60 <none> <none> openpitrix-system openpitrix-job-db-ctrl-job-56l5q 0/1 Completed 2 10h 172.17.9.53 192.168.123.60 <none> <none> openpitrix-system openpitrix-repo-db-ctrl-job-5zwxm 0/1 Completed 1 10h 172.17.9.58 192.168.123.60 <none> <none> openpitrix-system openpitrix-rp-kubernetes-deployment-688f78fddf-b2tf9 1/1 Running 0 10h 172.17.9.63 192.168.123.60 <none> <none> openpitrix-system openpitrix-runtime-db-ctrl-job-lgngz 0/1 Completed 0 10h 172.17.9.59 192.168.123.60 <none> <none> openpitrix-system openpitrix-task-db-ctrl-job-jnl4w 0/1 Completed 0 10h 172.17.9.60 192.168.123.60 <none> <none> `
去openpitrix-hyperpitrix-deployment-665cf858d7-znrkf这个pod里边 netstat -tnpl 看看9113端口的状态
Internal Server Error rpc error: code = Internal desc = describe resources failed: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: connection error: desc = "transport: Error while dialing dial tcp 10.0.0.68:9113: connect: connection timed out"![image](https://user-images.githubusercontent.com/34825299/71539311-5740d300-2975-11ea-8f9d-c0bf868d4fca.png)