search

apecloud / kubeblocks

KubeBlocks is an open-source control plane software that runs and manages databases, message queues and other stateful applications on K8s.
https://kubeblocks.io
GNU Affero General Public License v3.0
2.14k stars 176 forks source link

[BUG] Reconciler error: no operation required #2255

Closed JashBook closed 1 year ago

JashBook commented 1 year ago

Describe the bug A clear and concise description of what the bug is.

kbcli version
Kubernetes: v1.24.10-eks-48e63af
KubeBlocks: 0.5.0-alpha.1
kbcli: 0.5.0-alpha.1

To Reproduce Steps to reproduce the behavior:

  1. Install kubeblocks CrashLoopBackOff and automatically restarting several times, it succeeded
  2. create cluster is success 
    kubectl get pod
NAME                                                                  READY   STATUS      RESTARTS      AGE
kb-addon-alertmanager-webhook-adaptor-b8df446b6-xn5g5                 2/2     Running     0             13h
kb-addon-grafana-847ffd849-rt7hw                                      3/3     Running     0             13h
kb-addon-prometheus-alertmanager-0                                    2/2     Running     0             13h
kb-addon-prometheus-server-0                                          2/2     Running     0             13h
kb-addon-snapshot-controller-65b6db596-lbd6w                          1/1     Running     0             13h
kubeblocks-c6644f957-lfmd5                                            1/1     Running     7 (10h ago)   11h
mysql-cluster-mysql-0                                                 4/4     Running     0             10h
mysql-cluster-mysql-1                                                 4/4     Running     0             10h
mysql-cluster-mysql-2                                                 4/4     Running     0             10h
  3. See error: logs kubeblocks Reconciler error 
    
kubectl logs kubeblocks-c6644f957-lfmd5
2023-03-27T15:12:52.333Z    INFO    setup   unable read in config, errors ignored
2023-03-27T15:12:52.333Z    INFO    setup   config file: 
2023-03-27T15:12:52.333Z    INFO    setup   config settings: map[alsologtostderr:false cert_dir:/tmp/k8s-webhook-server/serving-certs cm_namespace:default cm_recon_retry_duration_ms:100 enable_debug_sysaccounts:false health_probe_bind_address::8081 kill_container_signal:SIGKILL kubeblocks_addon_sa_name:kubeblocks-addon-installer kubeblocks_image:registry.cn-hangzhou.aliyuncs.com/apecloud/kubeblocks:0.5.0-alpha.1 kubeblocks_serviceaccount_name:kubeblocks kubeconfig: leader_elect:true log_backtrace_at::0 log_dir: logtostderr:false maxconcurrentreconciles_addon:4 maxconcurrentreconciles_clusterdef:4 maxconcurrentreconciles_clusterversion:4 maxconcurrentreconciles_dataprotection:4 metrics_bind_address::8080 pod_min_ready_seconds:10 probe_service_grpc_port:50001 probe_service_http_port:3501 probe_service_log_level:info stderrthreshold:2 v:0 vmodule: volumesnapshot:true zap_devel:false zap_encoder:console zap_log_level: zap_stacktrace_level: zap_time_encoding:iso8601]
2023-03-27T15:12:53.237Z    INFO    controller-runtime.metrics  Metrics server is starting to listen    {"addr": ":8080"}
2023-03-27T15:12:53.239Z    INFO    setup   starting manager
2023-03-27T15:12:53.239Z    INFO    Starting server {"path": "/metrics", "kind": "metrics", "addr": "[::]:8080"}
2023-03-27T15:12:53.239Z    INFO    Starting server {"kind": "health probe", "addr": "[::]:8081"}
I0327 15:12:53.239786       1 leaderelection.go:248] attempting to acquire leader lease default/001c317f.kubeblocks.io...
I0327 15:13:09.904466       1 leaderelection.go:258] successfully acquired lease default/001c317f.kubeblocks.io
2023-03-27T15:13:09.904Z    INFO    Starting EventSource    {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1alpha1.Cluster"}
2023-03-27T15:13:09.904Z    INFO    Starting EventSource    {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.StatefulSet"}
2023-03-27T15:13:09.904Z    INFO    Starting EventSource    {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.Deployment"}
2023-03-27T15:13:09.904Z    INFO    Starting EventSource    {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.Service"}
2023-03-27T15:13:09.904Z    INFO    Starting EventSource    {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.Secret"}
2023-03-27T15:13:09.904Z    INFO    Starting EventSource    {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.ConfigMap"}
2023-03-27T15:13:09.904Z    INFO    Starting EventSource    {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.PersistentVolumeClaim"}
2023-03-27T15:13:09.904Z    INFO    Starting EventSource    {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.PodDisruptionBudget"}
2023-03-27T15:13:09.904Z    INFO    Starting Controller {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster"}
2023-03-27T15:13:09.905Z    INFO    Starting EventSource    {"controller": "clusterversion", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterVersion", "source": "kind source: *v1alpha1.ClusterVersion"}
2023-03-27T15:13:09.905Z    INFO    Starting Controller {"controller": "clusterversion", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterVersion"}
2023-03-27T15:13:09.905Z    INFO    Starting EventSource    {"controller": "clusterdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterDefinition", "source": "kind source: *v1alpha1.ClusterDefinition"}
2023-03-27T15:13:09.905Z    INFO    Starting Controller {"controller": "clusterdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterDefinition"}
2023-03-27T15:13:09.905Z    INFO    Starting EventSource    {"controller": "backuppolicy", "controllerGroup": "dataprotection.kubeblocks.io", "controllerKind": "BackupPolicy", "source": "kind source: *v1alpha1.BackupPolicy"}
2023-03-27T15:13:09.905Z    INFO    Starting Controller {"controller": "backuppolicy", "controllerGroup": "dataprotection.kubeblocks.io", "controllerKind": "BackupPolicy"}
2023-03-27T15:13:09.905Z    INFO    Starting EventSource    {"controller": "backuptool", "controllerGroup": "dataprotection.kubeblocks.io", "controllerKind": "BackupTool", "source": "kind source: *v1alpha1.BackupTool"}
2023-03-27T15:13:09.905Z    INFO    Starting Controller {"controller": "backuptool", "controllerGroup": "dataprotection.kubeblocks.io", "controllerKind": "BackupTool"}
2023-03-27T15:13:09.905Z    INFO    Starting EventSource    {"controller": "backup", "controllerGroup": "dataprotection.kubeblocks.io", "controllerKind": "Backup", "source": "kind source: *v1alpha1.Backup"}
2023-03-27T15:13:09.905Z    INFO    Starting EventSource    {"controller": "backup", "controllerGroup": "dataprotection.kubeblocks.io", "controllerKind": "Backup", "source": "kind source: *v1.Job"}
2023-03-27T15:13:09.905Z    INFO    Starting EventSource    {"controller": "backup", "controllerGroup": "dataprotection.kubeblocks.io", "controllerKind": "Backup", "source": "kind source: *v1.PartialObjectMetadata"}
2023-03-27T15:13:09.905Z    INFO    Starting Controller {"controller": "backup", "controllerGroup": "dataprotection.kubeblocks.io", "controllerKind": "Backup"}
2023-03-27T15:13:09.906Z    INFO    Starting EventSource    {"controller": "cronjob", "controllerGroup": "batch", "controllerKind": "CronJob", "source": "kind source: *v1.CronJob"}
2023-03-27T15:13:09.906Z    INFO    Starting EventSource    {"controller": "cronjob", "controllerGroup": "batch", "controllerKind": "CronJob", "source": "kind source: *v1.Job"}
2023-03-27T15:13:09.906Z    INFO    Starting Controller {"controller": "cronjob", "controllerGroup": "batch", "controllerKind": "CronJob"}
2023-03-27T15:13:09.906Z    INFO    Starting EventSource    {"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "source": "kind source: *v1alpha1.OpsRequest"}
2023-03-27T15:13:09.906Z    INFO    Starting Controller {"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest"}
2023-03-27T15:13:09.906Z    INFO    Starting EventSource    {"controller": "restorejob", "controllerGroup": "dataprotection.kubeblocks.io", "controllerKind": "RestoreJob", "source": "kind source: *v1alpha1.RestoreJob"}
2023-03-27T15:13:09.906Z    INFO    Starting Controller {"controller": "restorejob", "controllerGroup": "dataprotection.kubeblocks.io", "controllerKind": "RestoreJob"}
2023-03-27T15:13:09.906Z    INFO    Starting EventSource    {"controller": "addon", "controllerGroup": "extensions.kubeblocks.io", "controllerKind": "Addon", "source": "kind source: *v1alpha1.Addon"}
2023-03-27T15:13:09.906Z    INFO    Starting Controller {"controller": "addon", "controllerGroup": "extensions.kubeblocks.io", "controllerKind": "Addon"}
2023-03-27T15:13:09.906Z    INFO    Starting EventSource    {"controller": "configconstraint", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ConfigConstraint", "source": "kind source: *v1alpha1.ConfigConstraint"}
2023-03-27T15:13:09.906Z    INFO    Starting EventSource    {"controller": "configconstraint", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ConfigConstraint", "source": "kind source: *v1.ConfigMap"}
2023-03-27T15:13:09.906Z    INFO    Starting Controller {"controller": "configconstraint", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ConfigConstraint"}
2023-03-27T15:13:09.906Z    INFO    Starting EventSource    {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1alpha1.Cluster"}
2023-03-27T15:13:09.906Z    INFO    Starting EventSource    {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.Secret"}
2023-03-27T15:13:09.906Z    INFO    Starting EventSource    {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.Job"}
2023-03-27T15:13:09.906Z    INFO    Starting Controller {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster"}
2023-03-27T15:13:09.906Z    INFO    Starting EventSource    {"controller": "configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "source": "kind source: *v1.ConfigMap"}
2023-03-27T15:13:09.907Z    INFO    Starting Controller {"controller": "configmap", "controllerGroup": "", "controllerKind": "ConfigMap"}
2023-03-27T15:13:09.907Z    INFO    Starting EventSource    {"controller": "persistentvolumeclaim", "controllerGroup": "", "controllerKind": "PersistentVolumeClaim", "source": "kind source: *v1.PersistentVolumeClaim"}
2023-03-27T15:13:09.907Z    INFO    Starting Controller {"controller": "persistentvolumeclaim", "controllerGroup": "", "controllerKind": "PersistentVolumeClaim"}
2023-03-27T15:13:09.907Z    INFO    Starting EventSource    {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "source": "kind source: *v1.Event"}
2023-03-27T15:13:09.907Z    INFO    Starting Controller {"controller": "event", "controllerGroup": "", "controllerKind": "Event"}
2023-03-27T15:13:09.907Z    INFO    Starting EventSource    {"controller": "deployment", "controllerGroup": "apps", "controllerKind": "Deployment", "source": "kind source: *v1.Deployment"}
2023-03-27T15:13:09.907Z    INFO    Starting EventSource    {"controller": "deployment", "controllerGroup": "apps", "controllerKind": "Deployment", "source": "kind source: *v1.ReplicaSet"}
2023-03-27T15:13:09.907Z    INFO    Starting Controller {"controller": "deployment", "controllerGroup": "apps", "controllerKind": "Deployment"}
2023-03-27T15:13:09.907Z    INFO    Starting EventSource    {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "source": "kind source: *v1.StatefulSet"}
2023-03-27T15:13:09.907Z    INFO    Starting EventSource    {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "source": "kind source: *v1.Pod"}
2023-03-27T15:13:09.907Z    INFO    Starting Controller {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet"}
2023-03-27T15:13:10.012Z    INFO    Starting workers    {"controller": "clusterdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterDefinition", "worker count": 4}
2023-03-27T15:13:10.015Z    INFO    Starting workers    {"controller": "backuppolicy", "controllerGroup": "dataprotection.kubeblocks.io", "controllerKind": "BackupPolicy", "worker count": 4}
2023-03-27T15:13:10.017Z    INFO    Starting workers    {"controller": "backuptool", "controllerGroup": "dataprotection.kubeblocks.io", "controllerKind": "BackupTool", "worker count": 4}
2023-03-27T15:13:10.022Z    INFO    Starting workers    {"controller": "cronjob", "controllerGroup": "batch", "controllerKind": "CronJob", "worker count": 1}
2023-03-27T15:13:10.023Z    INFO    Starting workers    {"controller": "restorejob", "controllerGroup": "dataprotection.kubeblocks.io", "controllerKind": "RestoreJob", "worker count": 4}
2023-03-27T15:13:10.023Z    INFO    Starting workers    {"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "worker count": 1}
2023-03-27T15:13:10.023Z    INFO    Starting workers    {"controller": "addon", "controllerGroup": "extensions.kubeblocks.io", "controllerKind": "Addon", "worker count": 4}
2023-03-27T15:13:10.024Z    INFO    Starting workers    {"controller": "persistentvolumeclaim", "controllerGroup": "", "controllerKind": "PersistentVolumeClaim", "worker count": 1}
2023-03-27T15:13:10.024Z    INFO    Starting workers    {"controller": "configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "worker count": 1}
2023-03-27T15:13:10.025Z    INFO    Starting workers    {"controller": "configconstraint", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ConfigConstraint", "worker count": 1}
2023-03-27T15:13:10.028Z    INFO    Starting workers    {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "worker count": 1}
2023-03-27T15:13:10.028Z    INFO    Starting workers    {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "worker count": 1}
2023-03-27T15:13:10.029Z    INFO    parser Readiness probe event message failed {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-0.17504ee4bdc97174","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-0.17504ee4bdc97174", "reconcileID": "2ecc8a95-d100-4b2d-b7c0-ea19a152e55d", "event": "default/mysql-cluster-mysql-0.17504ee4bdc97174", "message": "Container image \"registry.cn-hangzhou.aliyuncs.com/apecloud/kubeblocks:0.5.0-alpha.1\" already present on machine"}
2023-03-27T15:13:10.029Z    INFO    parse probe event message failed    {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-0.17504ee4bdc97174","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-0.17504ee4bdc97174", "reconcileID": "2ecc8a95-d100-4b2d-b7c0-ea19a152e55d", "event": "default/mysql-cluster-mysql-0.17504ee4bdc97174", "message": "Container image \"registry.cn-hangzhou.aliyuncs.com/apecloud/kubeblocks:0.5.0-alpha.1\" already present on machine"}
2023-03-27T15:13:10.029Z    INFO    parser Readiness probe event message failed {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-0.17504ee4becdc199","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-0.17504ee4becdc199", "reconcileID": "f81a0323-ef79-4100-9bbb-b1c8fa57e28a", "event": "default/mysql-cluster-mysql-0.17504ee4becdc199", "message": "Created container kb-checkrole"}
2023-03-27T15:13:10.029Z    INFO    parse probe event message failed    {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-0.17504ee4becdc199","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-0.17504ee4becdc199", "reconcileID": "f81a0323-ef79-4100-9bbb-b1c8fa57e28a", "event": "default/mysql-cluster-mysql-0.17504ee4becdc199", "message": "Created container kb-checkrole"}
2023-03-27T15:13:10.029Z    INFO    parser Readiness probe event message failed {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-0.17504ee4c3b7f39c","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-0.17504ee4c3b7f39c", "reconcileID": "91f10691-5839-4e1a-9739-6b324cb94fed", "event": "default/mysql-cluster-mysql-0.17504ee4c3b7f39c", "message": "Started container kb-checkrole"}
2023-03-27T15:13:10.029Z    INFO    parse probe event message failed    {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-0.17504ee4c3b7f39c","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-0.17504ee4c3b7f39c", "reconcileID": "91f10691-5839-4e1a-9739-6b324cb94fed", "event": "default/mysql-cluster-mysql-0.17504ee4c3b7f39c", "message": "Started container kb-checkrole"}
2023-03-27T15:13:10.029Z    INFO    Starting workers    {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "worker count": 1}
2023-03-27T15:13:10.029Z    INFO    Starting workers    {"controller": "deployment", "controllerGroup": "apps", "controllerKind": "Deployment", "worker count": 1}
2023-03-27T15:13:10.030Z    INFO    parser Readiness probe event message failed {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-2.17504ee6cf86ad82","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-2.17504ee6cf86ad82", "reconcileID": "7e921f30-ca00-4c50-be7e-baccbfed4955", "event": "default/mysql-cluster-mysql-2.17504ee6cf86ad82", "message": "Started container kb-checkrole"}
2023-03-27T15:13:10.030Z    INFO    parse probe event message failed    {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-2.17504ee6cf86ad82","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-2.17504ee6cf86ad82", "reconcileID": "7e921f30-ca00-4c50-be7e-baccbfed4955", "event": "default/mysql-cluster-mysql-2.17504ee6cf86ad82", "message": "Started container kb-checkrole"}
2023-03-27T15:13:10.031Z    INFO    parser Readiness probe event message failed {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-2.17504ee6ca84c8e8","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-2.17504ee6ca84c8e8", "reconcileID": "57d34fb6-362b-42e8-9626-88d7a2e885cf", "event": "default/mysql-cluster-mysql-2.17504ee6ca84c8e8", "message": "Created container kb-checkrole"}
2023-03-27T15:13:10.031Z    INFO    parse probe event message failed    {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-2.17504ee6ca84c8e8","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-2.17504ee6ca84c8e8", "reconcileID": "57d34fb6-362b-42e8-9626-88d7a2e885cf", "event": "default/mysql-cluster-mysql-2.17504ee6ca84c8e8", "message": "Created container kb-checkrole"}
2023-03-27T15:13:10.031Z    INFO    parser Readiness probe event message failed {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-1.17504ee5cbbe6880","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-1.17504ee5cbbe6880", "reconcileID": "4b219388-d3d7-4ac9-b5a4-f6bdac7103b2", "event": "default/mysql-cluster-mysql-1.17504ee5cbbe6880", "message": "Container image \"registry.cn-hangzhou.aliyuncs.com/apecloud/kubeblocks:0.5.0-alpha.1\" already present on machine"}
2023-03-27T15:13:10.031Z    INFO    parse probe event message failed    {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-1.17504ee5cbbe6880","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-1.17504ee5cbbe6880", "reconcileID": "4b219388-d3d7-4ac9-b5a4-f6bdac7103b2", "event": "default/mysql-cluster-mysql-1.17504ee5cbbe6880", "message": "Container image \"registry.cn-hangzhou.aliyuncs.com/apecloud/kubeblocks:0.5.0-alpha.1\" already present on machine"}
2023-03-27T15:13:10.031Z    INFO    parser Readiness probe event message failed {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-2.17504ee48b5edad1","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-2.17504ee48b5edad1", "reconcileID": "670b42d9-a522-4cba-937e-ebc97f4bdd2c", "event": "default/mysql-cluster-mysql-2.17504ee48b5edad1", "message": "Pulling image \"registry.cn-hangzhou.aliyuncs.com/apecloud/kubeblocks:0.5.0-alpha.1\""}
2023-03-27T15:13:10.031Z    INFO    parse probe event message failed    {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-2.17504ee48b5edad1","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-2.17504ee48b5edad1", "reconcileID": "670b42d9-a522-4cba-937e-ebc97f4bdd2c", "event": "default/mysql-cluster-mysql-2.17504ee48b5edad1", "message": "Pulling image \"registry.cn-hangzhou.aliyuncs.com/apecloud/kubeblocks:0.5.0-alpha.1\""}
2023-03-27T15:13:10.032Z    INFO    parser Readiness probe event message failed {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-1.17504ee5d327d15a","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-1.17504ee5d327d15a", "reconcileID": "3b463647-da63-4c27-9a23-34c995f7d421", "event": "default/mysql-cluster-mysql-1.17504ee5d327d15a", "message": "Started container kb-checkrole"}
2023-03-27T15:13:10.032Z    INFO    parse probe event message failed    {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-1.17504ee5d327d15a","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-1.17504ee5d327d15a", "reconcileID": "3b463647-da63-4c27-9a23-34c995f7d421", "event": "default/mysql-cluster-mysql-1.17504ee5d327d15a", "message": "Started container kb-checkrole"}
2023-03-27T15:13:10.033Z    INFO    parser Readiness probe event message failed {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-1.17504ee5ccf0ef93","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-1.17504ee5ccf0ef93", "reconcileID": "ffe039ec-b5ba-4655-8291-a92d983d0548", "event": "default/mysql-cluster-mysql-1.17504ee5ccf0ef93", "message": "Created container kb-checkrole"}
2023-03-27T15:13:10.033Z    INFO    parse probe event message failed    {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-1.17504ee5ccf0ef93","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-1.17504ee5ccf0ef93", "reconcileID": "ffe039ec-b5ba-4655-8291-a92d983d0548", "event": "default/mysql-cluster-mysql-1.17504ee5ccf0ef93", "message": "Created container kb-checkrole"}
2023-03-27T15:13:10.033Z    INFO    parser Readiness probe event message failed {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-2.17504ee6c990cfca","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-2.17504ee6c990cfca", "reconcileID": "36fe2e53-127f-455d-b206-79be5fab34ec", "event": "default/mysql-cluster-mysql-2.17504ee6c990cfca", "message": "Successfully pulled image \"registry.cn-hangzhou.aliyuncs.com/apecloud/kubeblocks:0.5.0-alpha.1\" in 9.633367113s (9.633374924s including waiting)"}
2023-03-27T15:13:10.033Z    INFO    parse probe event message failed    {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "Event": {"name":"mysql-cluster-mysql-2.17504ee6c990cfca","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql-2.17504ee6c990cfca", "reconcileID": "36fe2e53-127f-455d-b206-79be5fab34ec", "event": "default/mysql-cluster-mysql-2.17504ee6c990cfca", "message": "Successfully pulled image \"registry.cn-hangzhou.aliyuncs.com/apecloud/kubeblocks:0.5.0-alpha.1\" in 9.633367113s (9.633374924s including waiting)"}
2023-03-27T15:13:10.039Z    INFO    Cluster is not ready yet    {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "Cluster": {"name":"pg-cluster","namespace":"default"}, "namespace": "default", "name": "pg-cluster", "reconcileID": "e81d4c93-3ee8-41a1-8ed2-5dda73e4b854", "cluster": "default/pg-cluster", "cluster": {"namespace": "default", "name": "pg-cluster"}}
2023-03-27T15:13:10.041Z    INFO    component status changed    {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "StatefulSet": {"name":"mysql-cluster-mysql","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql", "reconcileID": "4ca413e4-4e2a-4963-8bc7-9a29c3cd21f1", "statefulSet": "default/mysql-cluster-mysql", "componentName": "mysql", "phase": "Running", "componentIsRunning": true, "podsAreReady": true}
2023-03-27T15:13:10.043Z    INFO    KubeAPIWarningLogger    child pods are preserved by default when jobs are deleted; set propagationPolicy=Background to remove them or set propagationPolicy=Orphan to suppress this warning
2023-03-27T15:13:10.059Z    INFO    no operation required   {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "StatefulSet": {"name":"mysql-cluster-mysql","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql", "reconcileID": "4ca413e4-4e2a-4963-8bc7-9a29c3cd21f1", "statefulSet": "default/mysql-cluster-mysql"}
2023-03-27T15:13:10.059Z    ERROR   Reconciler error    {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "StatefulSet": {"name":"mysql-cluster-mysql","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql", "reconcileID": "4ca413e4-4e2a-4963-8bc7-9a29c3cd21f1", "error": "no operation required"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-03-27T15:13:10.083Z    INFO    component status changed    {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "StatefulSet": {"name":"test-cluster-mysql","namespace":"default"}, "namespace": "default", "name": "test-cluster-mysql", "reconcileID": "945c1225-6116-4a4c-b76c-00e43d9eb545", "statefulSet": "default/test-cluster-mysql", "componentName": "mysql", "phase": "Running", "componentIsRunning": true, "podsAreReady": true}
2023-03-27T15:13:10.096Z    INFO    no operation required   {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "StatefulSet": {"name":"test-cluster-mysql","namespace":"default"}, "namespace": "default", "name": "test-cluster-mysql", "reconcileID": "945c1225-6116-4a4c-b76c-00e43d9eb545", "statefulSet": "default/test-cluster-mysql"}
2023-03-27T15:13:10.096Z    ERROR   Reconciler error    {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "StatefulSet": {"name":"test-cluster-mysql","namespace":"default"}, "namespace": "default", "name": "test-cluster-mysql", "reconcileID": "945c1225-6116-4a4c-b76c-00e43d9eb545", "error": "no operation required"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-03-27T15:13:10.102Z    INFO    component status changed    {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "StatefulSet": {"name":"mysql-cluster-mysql","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql", "reconcileID": "b1f56efc-c257-4093-96ec-3a19228196e6", "statefulSet": "default/mysql-cluster-mysql", "componentName": "mysql", "phase": "Running", "componentIsRunning": true, "podsAreReady": true}
2023-03-27T15:13:10.107Z    INFO    Starting workers    {"controller": "backup", "controllerGroup": "dataprotection.kubeblocks.io", "controllerKind": "Backup", "worker count": 4}
2023-03-27T15:13:10.112Z    INFO    Starting workers    {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "worker count": 1}
2023-03-27T15:13:10.112Z    INFO    Starting workers    {"controller": "clusterversion", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterVersion", "worker count": 4}
2023-03-27T15:13:10.112Z    INFO    no operation required   {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "StatefulSet": {"name":"mysql-cluster-mysql","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql", "reconcileID": "b1f56efc-c257-4093-96ec-3a19228196e6", "statefulSet": "default/mysql-cluster-mysql"}
2023-03-27T15:13:10.112Z    ERROR   Reconciler error    {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "StatefulSet": {"name":"mysql-cluster-mysql","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql", "reconcileID": "b1f56efc-c257-4093-96ec-3a19228196e6", "error": "no operation required"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-03-27T15:13:10.118Z    INFO    component status changed    {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "StatefulSet": {"name":"test-cluster-mysql","namespace":"default"}, "namespace": "default", "name": "test-cluster-mysql", "reconcileID": "1ec20ff0-3268-45db-9561-7ba86f07b1f9", "statefulSet": "default/test-cluster-mysql", "componentName": "mysql", "phase": "Running", "componentIsRunning": true, "podsAreReady": true}
2023-03-27T15:13:10.128Z    INFO    no operation required   {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "StatefulSet": {"name":"test-cluster-mysql","namespace":"default"}, "namespace": "default", "name": "test-cluster-mysql", "reconcileID": "1ec20ff0-3268-45db-9561-7ba86f07b1f9", "statefulSet": "default/test-cluster-mysql"}
2023-03-27T15:13:10.128Z    ERROR   Reconciler error    {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "StatefulSet": {"name":"test-cluster-mysql","namespace":"default"}, "namespace": "default", "name": "test-cluster-mysql", "reconcileID": "1ec20ff0-3268-45db-9561-7ba86f07b1f9", "error": "no operation required"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:329
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:274
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.4/pkg/internal/controller/controller.go:235
2023-03-27T15:13:10.134Z    INFO    component status changed    {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "StatefulSet": {"name":"mysql-cluster-mysql","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql", "reconcileID": "3b911d67-a52a-48e9-a68f-288ce4ee7735", "statefulSet": "default/mysql-cluster-mysql", "componentName": "mysql", "phase": "Running", "componentIsRunning": true, "podsAreReady": true}
2023-03-27T15:13:10.144Z    INFO    no operation required   {"controller": "statefulset", "controllerGroup": "apps", "controllerKind": "StatefulSet", "StatefulSet": {"name":"mysql-cluster-mysql","namespace":"default"}, "namespace": "default", "name": "mysql-cluster-mysql", "reconcileID": "3b911d67-a52a-48e9-a68f-288ce4ee7735", "statefulSet": "default/mysql-cluster-mysql"}


**Expected behavior**
Do not have Reconciler error info

**Screenshots**
If applicable, add screenshots to help explain your problem.

**Desktop (please complete the following information):**
 - OS: [e.g. iOS]
 - Browser [e.g. chrome, safari]
 - Version [e.g. 22]

**Additional context**
Add any other context about the problem here.
nashtsai commented 1 year ago

duplicated #2238