apecloud / kubeblocks

KubeBlocks is an open-source control plane software that runs and manages databases, message queues and other stateful applications on K8s.
https://kubeblocks.io
GNU Affero General Public License v3.0
2.2k stars 184 forks source link

[BUG] 1.0 Start apecloud-mysql cluster failed #8524

Open tianyue86 opened 1 day ago

tianyue86 commented 1 day ago

Describe the bug A clear and concise description of what the bug is.

To Reproduce Steps to reproduce the behavior:

  1. Create apecloud-mysql in running status
    
    NAMESPACE   NAME           CLUSTER-DEFINITION   TERMINATION-POLICY   STATUS    AGE
    default     mysql3c2       apecloud-mysql       Delete               Running    134m
    k get pod:
    mysql3c2-mysql-0         4/4     Running            0          119s
2. Stop the cluster: success
===>the pod mysql3c2-mysql-0 disappears after stopping the cluster

kbcli cluster stop mysql3c2 --auto-approve --force=true --namespace default

k get cluster -A
NAMESPACE NAME CLUSTER-DEFINITION TERMINATION-POLICY STATUS AGE default mysql3c2 apecloud-mysql Delete Stopped 134m

4. Start the cluster: failed, always in pending

kbcli cluster start mysql3c2 --force=true --namespace default

kbcli cluster describe-ops mysql3c2-start-5wp7t -n default Spec: Name: mysql3c2-start-5wp7t NameSpace: default Cluster: mysql3c2 Type: Start

Command: kbcli cluster start mysql3c2 --namespace=default

Status: Start Time: Nov 25,2024 17:11 UTC+0800 Duration: 22m Status: Running Progress: 0/1 OBJECT-KEY STATUS DURATION MESSAGE
Pod/mysql3c2-mysql-0(mysql/Create) Pending wait to create pod: Pod/mysql3c2-mysql-0 in Component: mysql

Conditions: LAST-TRANSITION-TIME TYPE REASON STATUS MESSAGE
Nov 25,2024 17:11 UTC+0800 WaitForProgressing WaitForProgressing True wait for the controller to process the OpsRequest: mysql3c2-start-5wp7t in Cluster: mysql3c2
Nov 25,2024 17:11 UTC+0800 Validated ValidateOpsRequestPassed True OpsRequest: mysql3c2-start-5wp7t is validated
Nov 25,2024 17:11 UTC+0800 Starting StartCluster True Start the Cluster: mysql3c2

Warning Events:



Attach the log for investigation:
[all-containers-logs.zip](https://github.com/user-attachments/files/17901487/all-containers-logs.zip)
xuriwuyun commented 1 day ago

The pods are not being created after the start, it seems that the controller is not functioning as expected.

tianyue86 commented 1 day ago

@leon-inf Please take a look to check if it's a problem with the controller. Thanks!