search

apecloud / kubeblocks

KubeBlocks is an open-source control plane software that runs and manages databases, message queues and other stateful applications on K8s.
https://kubeblocks.io
GNU Affero General Public License v3.0
1.75k stars 154 forks source link

[BUG]kb crash when restore mongo #7661

Closed ahjing99 closed 5 days ago

ahjing99 commented 5 days ago

kbcli version Kubernetes: v1.29.4-gke.1043002 KubeBlocks: 0.9.0-beta.40 kbcli: 0.9.0-beta.1

  1. Create cluster

    
apiVersion: apps.kubeblocks.io/v1alpha1
kind: Cluster
metadata:
name: mongo-guxygd
namespace: default
spec:
clusterDefinitionRef: mongodb
clusterVersionRef: mongodb-6.0
terminationPolicy: WipeOut
componentSpecs:
- name: mongodb
  componentDefRef: mongodb
  replicas: 3
  resources:
    requests:
      cpu: 100m
      memory: 0.5Gi
    limits:
      cpu: 100m
      memory: 0.5Gi
  volumeClaimTemplates:
    - name: data
      spec:
        storageClassName:
        accessModes:
          - ReadWriteOnce
        resources:
          requests:
            storage: 3Gi

  `kubectl apply -f test_create_mongo-guxygd.yaml`

cluster.apps.kubeblocks.io/mongo-guxygd created

2. backup and restore

kbcli cluster backup mongo-guxygd --method dump --namespace default

Backup backup-default-mongo-guxygd-20240628094641 created successfully, you can view the progress: kbcli cluster list-backups --name=backup-default-mongo-guxygd-20240628094641 -n default

  `kbcli cluster describe-backup backup-default-mongo-guxygd-20240628094641 --namespace default `

Name: backup-default-mongo-guxygd-20240628094641 Cluster: mongo-guxygd Namespace: default

Spec: Method: dump Policy Name: mongo-guxygd-mongodb-backup-policy

Status: Phase: Completed Total Size: 1376 ActionSet Name: mongodb-dump Repository: backuprepo-kbcli-test Duration: 10s Start Time: Jun 28,2024 09:46 UTC+0800 Completion Time: Jun 28,2024 09:46 UTC+0800 Path: /default/mongo-guxygd-28ca55c3-67a9-42e1-82d5-c9fb59ab3a9d/mongodb/backup-default-mongo-guxygd-20240628094641 Time Range Start: Jun 28,2024 09:46 UTC+0800 Time Range End: Jun 28,2024 09:46 UTC+0800

Warning Events: 

  `kbcli cluster restore mongo-guxygd-backup --backup backup-default-mongo-guxygd-20240628094641 --namespace default `

Cluster mongo-guxygd-backup created


3. kb crash

➜ ~ k logs kubeblocks-fdb74c479-jq5bb -n kb-system -f Defaulted container "manager" out of: manager, tools (init), datascript (init) 2024-06-28T01:48:51.983Z INFO setup config file: /etc/kubeblocks/config.yaml 2024-06-28T01:48:51.983Z INFO setup config settings: map[apps:true cert_dir:/tmp/k8s-webhook-server/serving-certs cm_namespace:kb-system cm_recon_retry_duration_ms:1000 config_manager_grpc_port:9901 config_manager_log_level:info data_plane_affinity:{"nodeAffinity":{"preferredDuringSchedulingIgnoredDuringExecution":[{"preference":{"matchExpressions":[{"key":"kb-data","operator":"In","values":["true"]}]},"weight":100}]}} data_plane_tolerations:[{"effect":"NoSchedule","key":"kb-data","operator":"Equal","value":"true"}] default_storage_class:kb-default-sc enable_debug_sysaccounts:false enabled_runtime_metrics:false enablerbacmanager:true experimental:false extensions:true health_probe_bind_address::8081 host_port_cm_name:kubeblocks-host-ports host_port_exclude_ranges:6443,10250,10257,10259,2379-2380,30000-32767 host_port_include_ranges:1025-65536 ignore_config_template_default_mode:false ignore_pod_vertical_scaling:false kb_max_lag:10 kb_ttl:15 kubeblocks_addon_helm_install_options:--atomic --cleanup-on-fail --wait --insecure-skip-tls-verify kubeblocks_addon_helm_uninstall_options:[] kubeblocks_addon_sa_name:kubeblocks-addon-installer kubeblocks_datascript_clients_image:docker.io/apecloud/kubeblocks-datascript:0.9.0-beta.40 kubeblocks_reconcile_workers:8 kubeblocks_serviceaccount_name:kubeblocks kubeblocks_tools_image:docker.io/apecloud/kubeblocks-tools:0.9.0-beta.40 kubeconfig: kubernetes_cluster_domain:cluster.local leader_elect:true leader_elect_id:001c317f lorry_grpc_port:50001 lorry_http_port:3501 lorry_log_level:info managed_namespaces: max_plain_revision_count:1024 maxconcurrentreconciles_addon:8 metrics_bind_address::8080 multi_cluster_contexts: multi_cluster_contexts_disabled: multi_cluster_kubeconfig: pod_min_ready_seconds:10 volumesnapshot_api_beta:false workloads:true zap_devel:false zap_encoder:console zap_log_level: zap_stacktrace_level: zap_time_encoding:iso8601] 2024-06-28T01:48:51.984Z INFO setup golang runtime metrics. {"featureGate": false} 2024-06-28T01:48:52.025Z INFO setup starting manager 2024-06-28T01:48:52.025Z INFO starting server {"kind": "health probe", "addr": "[::]:8081"} 2024-06-28T01:48:52.025Z INFO controller-runtime.metrics Starting metrics server 2024-06-28T01:48:52.025Z INFO controller-runtime.metrics Serving metrics server {"bindAddress": ":8080", "secure": false} I0628 01:48:52.026213 1 leaderelection.go:250] attempting to acquire leader lease kb-system/001c317f.kubeblocks.io... I0628 01:49:10.562677 1 leaderelection.go:260] successfully acquired lease kb-system/001c317f.kubeblocks.io 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: v1alpha1.Cluster"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: v1alpha1.Component"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: v1.Service"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: v1.Secret"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: v1alpha1.BackupPolicy"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: v1alpha1.BackupSchedule"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: v1alpha1.Component"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: v1alpha1.InstanceSet"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: v1.Service"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: v1.Secret"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: v1.ConfigMap"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: v1alpha1.Backup"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: v1alpha1.Restore"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: v1.Job"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: v1.ClusterRoleBinding"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: v1.RoleBinding"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: v1.ServiceAccount"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: v1.PersistentVolumeClaim"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: v1alpha1.Configuration"} 2024-06-28T01:49:10.563Z INFO Starting Controller {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component"} 2024-06-28T01:49:10.563Z INFO Starting Controller {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "clusterversion", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterVersion", "source": "kind source: v1alpha1.ClusterVersion"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "componentdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentDefinition", "source": "kind source: v1alpha1.ComponentDefinition"} 2024-06-28T01:49:10.563Z INFO Starting Controller {"controller": "componentdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentDefinition"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "clusterdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterDefinition", "source": "kind source: v1alpha1.ClusterDefinition"} 2024-06-28T01:49:10.563Z INFO Starting Controller {"controller": "clusterdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterDefinition"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "configconstraint", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ConfigConstraint", "source": "kind source: v1beta1.ConfigConstraint"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "configconstraint", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ConfigConstraint", "source": "kind source: v1.ConfigMap"} 2024-06-28T01:49:10.563Z INFO Starting Controller {"controller": "configconstraint", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ConfigConstraint"} 2024-06-28T01:49:10.563Z INFO Starting Controller {"controller": "clusterversion", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterVersion"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "opsdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsDefinition", "source": "kind source: v1alpha1.OpsDefinition"} 2024-06-28T01:49:10.563Z INFO Starting Controller {"controller": "opsdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsDefinition"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "componentversion", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentVersion", "source": "kind source: v1alpha1.ComponentVersion"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "componentversion", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentVersion", "source": "kind source: v1alpha1.ComponentDefinition"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "source": "kind source: v1alpha1.OpsRequest"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "source": "kind source: v1.Job"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "source": "kind source: v1alpha1.Restore"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "source": "kind source: v1alpha1.Cluster"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "source": "kind source: v1alpha1.InstanceSet"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "source": "kind source: v1alpha1.Backup"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "source": "kind source: v1.PersistentVolumeClaim"} 2024-06-28T01:49:10.563Z INFO Starting EventSource {"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "source": "kind source: v1.Pod"} 2024-06-28T01:49:10.564Z INFO Starting Controller {"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "configuration", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Configuration", "source": "kind source: v1alpha1.Configuration"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "configuration", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Configuration", "source": "kind source: v1.ConfigMap"} 2024-06-28T01:49:10.564Z INFO Starting Controller {"controller": "configuration", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Configuration"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "source": "kind source: v1.ConfigMap"} 2024-06-28T01:49:10.564Z INFO Starting Controller {"controller": "configmap", "controllerGroup": "", "controllerKind": "ConfigMap"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "source": "kind source: v1.Event"} 2024-06-28T01:49:10.564Z INFO Starting Controller {"controller": "event", "controllerGroup": "", "controllerKind": "Event"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: v1alpha1.Cluster"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: v1.Secret"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: v1.Job"} 2024-06-28T01:49:10.564Z INFO Starting Controller {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "servicedescriptor", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ServiceDescriptor", "source": "kind source: v1alpha1.ServiceDescriptor"} 2024-06-28T01:49:10.564Z INFO Starting Controller {"controller": "servicedescriptor", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ServiceDescriptor"} 2024-06-28T01:49:10.563Z INFO Starting Controller {"controller": "componentversion", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentVersion"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "componentclassdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentClassDefinition", "source": "kind source: v1alpha1.ComponentClassDefinition"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "addon", "controllerGroup": "extensions.kubeblocks.io", "controllerKind": "Addon", "source": "kind source: v1alpha1.Addon"} 2024-06-28T01:49:10.564Z INFO Starting Controller {"controller": "componentclassdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentClassDefinition"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "addon", "controllerGroup": "extensions.kubeblocks.io", "controllerKind": "Addon", "source": "kind source: v1.Job"} 2024-06-28T01:49:10.564Z INFO Starting Controller {"controller": "addon", "controllerGroup": "extensions.kubeblocks.io", "controllerKind": "Addon"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "backuppolicytemplate", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "BackupPolicyTemplate", "source": "kind source: v1alpha1.BackupPolicyTemplate"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "instanceset", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "InstanceSet", "source": "kind source: v1alpha1.InstanceSet"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "instanceset", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "InstanceSet", "source": "kind source: v1.PersistentVolumeClaim"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "instanceset", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "InstanceSet", "source": "kind source: v1.Job"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "instanceset", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "InstanceSet", "source": "kind source: v1.Service"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "instanceset", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "InstanceSet", "source": "kind source: v1.ConfigMap"} 2024-06-28T01:49:10.564Z INFO Starting EventSource {"controller": "instanceset", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "InstanceSet", "source": "kind source: *v1.Pod"} 2024-06-28T01:49:10.564Z INFO Starting Controller {"controller": "instanceset", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "InstanceSet"} 2024-06-28T01:49:10.564Z INFO Starting Controller {"controller": "backuppolicytemplate", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "BackupPolicyTemplate"} W0628 01:49:10.666690 1 warnings.go:70] Due to the lack of practical use cases, this API is deprecated from KB 0.9.0. W0628 01:49:10.709615 1 warnings.go:70] Due to the lack of practical use cases, this API is deprecated from KB 0.9.0. W0628 01:49:11.005287 1 warnings.go:70] The ClusterVersion CRD has been deprecated since 0.9.0 W0628 01:49:11.045051 1 warnings.go:70] The ClusterVersion CRD has been deprecated since 0.9.0 2024-06-28T01:49:11.289Z INFO Starting workers {"controller": "backuppolicytemplate", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "BackupPolicyTemplate", "worker count": 1} 2024-06-28T01:49:11.289Z INFO Starting workers {"controller": "opsdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsDefinition", "worker count": 1} 2024-06-28T01:49:11.289Z INFO Starting workers {"controller": "componentclassdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentClassDefinition", "worker count": 1} 2024-06-28T01:49:11.313Z INFO Starting workers {"controller": "addon", "controllerGroup": "extensions.kubeblocks.io", "controllerKind": "Addon", "worker count": 8} W0628 01:49:11.339295 1 warnings.go:70] Due to the lack of practical use cases, this API is deprecated from KB 0.9.0. W0628 01:49:11.352866 1 warnings.go:70] Due to the lack of practical use cases, this API is deprecated from KB 0.9.0. 2024-06-28T01:49:11.365Z INFO Starting workers {"controller": "configuration", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Configuration", "worker count": 4} 2024-06-28T01:49:11.365Z INFO Starting workers {"controller": "servicedescriptor", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ServiceDescriptor", "worker count": 1} 2024-06-28T01:49:11.365Z INFO Starting workers {"controller": "configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "worker count": 2} 2024-06-28T01:49:11.365Z INFO Starting workers {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "worker count": 1} 2024-06-28T01:49:11.365Z INFO Starting workers {"controller": "componentversion", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentVersion", "worker count": 1} 2024-06-28T01:49:11.366Z INFO Starting workers {"controller": "instanceset", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "InstanceSet", "worker count": 8} 2024-06-28T01:49:11.366Z INFO Starting workers {"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "worker count": 4} 2024-06-28T01:49:11.367Z INFO Starting workers {"controller": "clusterversion", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterVersion", "worker count": 1} 2024-06-28T01:49:11.367Z INFO Starting workers {"controller": "clusterdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterDefinition", "worker count": 1} 2024-06-28T01:49:11.368Z INFO Starting workers {"controller": "configconstraint", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ConfigConstraint", "worker count": 1} 2024-06-28T01:49:11.368Z INFO Starting workers {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "worker count": 8} 2024-06-28T01:49:11.369Z INFO Starting workers {"controller": "componentdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentDefinition", "worker count": 1} 2024-06-28T01:49:11.374Z INFO Starting workers {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "worker count": 2} 2024-06-28T01:49:11.392Z INFO class general-1c1g does not conform to any constraints {"controller": "componentclassdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentClassDefinition", "ComponentClassDefinition": {"name":"kb.classes.default.apecloud-mysql.mysql"}, "namespace": "", "name": "kb.classes.default.apecloud-mysql.mysql", "reconcileID": "e895fa79-5f21-400a-807b-83549c58b2a7", "classDefinition": {"name":"kb.classes.default.apecloud-mysql.mysql"}} 2024-06-28T01:49:11.393Z INFO class mo-4c32g does not conform to any constraints {"controller": "componentclassdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentClassDefinition", "ComponentClassDefinition": {"name":"kb.classes.default.mysql.mysql"}, "namespace": "", "name": "kb.classes.default.mysql.mysql", "reconcileID": "5b64ea6d-4f63-452e-b9b0-310648b58e4f", "classDefinition": {"name":"kb.classes.default.mysql.mysql"}} 2024-06-28T01:49:11.413Z INFO Starting workers {"controller": "event", "controllerGroup": "", "controllerKind": "Event", "worker count": 1} 2024-06-28T01:49:11.904Z INFO KubeAPIWarningLogger unknown field "spec.template.metadata.creationTimestamp" 2024-06-28T01:49:11.904Z INFO KubeAPIWarningLogger unknown field "spec.volumeClaimTemplates[0].metadata.creationTimestamp" 2024-06-28T01:49:12.716Z INFO configSpec config is not used by any container, and pass. configSpec configs: [] 2024-06-28T01:49:13.305Z INFO configSpec config is not used by any container, and pass. configSpec configs: [{{redis-replication-config redis7-config-template kb-system redis-config } [] redis7-config-constraints [] [] []}] 2024-06-28T01:49:13.876Z INFO component status conditions, isInstanceSetRunning: true, isAllConfigSynced: true, hasRunningVolumeExpansion: false, hasFailure: false, isInCreatingPhase: false, isComponentAvailable: true {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "Component": {"name":"redis-rbzcai-redis-twemproxy","namespace":"default"}, "namespace": "default", "name": "redis-rbzcai-redis-twemproxy", "reconcileID": "8352896c-ee9a-46cf-8b50-18b66229c1bb", "component": {"name":"redis-rbzcai-redis-twemproxy","namespace":"default"}} 2024-06-28T01:49:14.143Z INFO Observed a panic in reconciler: runtime error: invalid memory address or nil pointer dereference {"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "Component": {"name":"mongo-guxygd-backup-mongodb","namespace":"default"}, "namespace": "default", "name": "mongo-guxygd-backup-mongodb", "reconcileID": "01613dd6-6edf-4ae5-99af-e52a426cb966"} panic: runtime error: invalid memory address or nil pointer dereference [recovered] panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x1 addr=0x40 pc=0x16b76c9]

goroutine 863 [running]: sigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).Reconcile.func1() /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:116 +0x1e5 panic({0x2858cc0?, 0x4b34980?}) /usr/local/go/src/runtime/panic.go:914 +0x21f github.com/apecloud/kubeblocks/apis/dataprotection/v1alpha1.(Restore).GetNamespace(0x2cbc6fc?)

:1 +0x9 sigs.k8s.io/controller-runtime/pkg/controller/controllerutil.validateOwner({0x332efc8, 0xc002484600}, {0x332f0d0, 0x0}) /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/controller/controllerutil/controllerutil.go:225 +0x68 sigs.k8s.io/controller-runtime/pkg/controller/controllerutil.SetControllerReference({0x332efc8, 0xc002484600}, {0x332f0d0?, 0x0}, 0x7be865330748?) /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/controller/controllerutil/controllerutil.go:66 +0x105 github.com/apecloud/kubeblocks/pkg/controller/plan.(*RestoreManager).createRestoreAndWait(0xc0022b3730, 0x1eafafd?, {0xc001c92378, 0x1, 0x2c33320?}) /src/pkg/controller/plan/restore.go:370 +0xbb github.com/apecloud/kubeblocks/pkg/controller/plan.(*RestoreManager).DoPrepareData(0xc0022b3730, 0xc0002cf180, 0xc002484600?, 0xc001dde588?) /src/pkg/controller/plan/restore.go:142 +0x299 github.com/apecloud/kubeblocks/pkg/controller/plan.(*RestoreManager).DoRestore(0xc0022b3730, 0xc0002cf180, 0xc002484600, 0x0) /src/pkg/controller/plan/restore.go:95 +0x67 github.com/apecloud/kubeblocks/controllers/apps.(*componentRestoreTransformer).Transform(0xc0022b5b10, {0x33078d0?, 0xc0022fe510?}, 0xc0022b5b40?) /src/controllers/apps/transformer_component_restore.go:69 +0x2ab github.com/apecloud/kubeblocks/pkg/controller/graph.TransformerChain.ApplyTo({0xc0022f94a0?, 0x16, 0xc0024848a8?}, {0x33078d0, 0xc0022fe510}, 0x417832?) /src/pkg/controller/graph/transformer.go:57 +0x9b github.com/apecloud/kubeblocks/controllers/apps.(*componentPlanBuilder).Build(0xc000490730) /src/controllers/apps/component_plan_builder.go:117 +0xb6 github.com/apecloud/kubeblocks/controllers/apps.(*ComponentReconciler).Reconcile(0xc0008ead20, {0x3307c88, 0xc0024808d0}, {{{0xc001157c40, 0x7}, {0xc000afc700, 0x1b}}}) /src/controllers/apps/component_controller.go:191 +0xa0e sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile(0x330dea8?, {0x3307c88?, 0xc0024808d0?}, {{{0xc001157c40?, 0xb?}, {0xc000afc700?, 0x0?}}}) /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:119 +0xb7 sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc0008fe500, {0x3307cc0, 0xc000c482d0}, {0x2996060?, 0xc000c03a40?}) /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:316 +0x3cc sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc0008fe500, {0x3307cc0, 0xc000c482d0}) /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:266 +0x1af sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2() /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:227 +0x79 created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2 in goroutine 89 /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:223 +0x565 ```