apecloud / kubeblocks

KubeBlocks is an open-source control plane software that runs and manages databases, message queues and other stateful applications on K8s.
https://kubeblocks.io
GNU Affero General Public License v3.0
2.06k stars 167 forks source link

[BUG] Official-postgresql cluster is always creating #7943

Open haowen159 opened 1 month ago

haowen159 commented 1 month ago

Describe the bug A clear and concise description of what the bug is.

kbcli version
Kubernetes: v1.28.11-gke.1019001
KubeBlocks: 1.0.0-alpha.1
kbcli: 1.0.0-alpha.0

To Reproduce Steps to reproduce the behavior:

  1. create cluster
    kbcli cluster create  offpg-uextdi --termination-policy=WipeOut --cluster-definition=official-postgresql --enable-all-logs=false --set cpu=100m,memory=0.5Gi,replicas=2,storage=3Gi  --namespace default
  2. cluster status
    k get cluster
    NAME              CLUSTER-DEFINITION    VERSION   TERMINATION-POLICY   STATUS     AGE
    offpg-uextdi      official-postgresql             WipeOut              Creating   11m
    weaviate-bdlnqf                                   WipeOut              Failed     19h
    k get pod -l app.kubernetes.io/instance=offpg-uextdi
    NAME                        READY   STATUS    RESTARTS      AGE
    offpg-uextdi-postgresql-0   2/2     Running   0             11m
    offpg-uextdi-postgresql-1   2/2     Running   2 (10m ago)   11m
    k get cmp -l app.kubernetes.io/instance=offpg-uextdi
    NAME                      DEFINITION   SERVICE-VERSION   STATUS     AGE
    offpg-uextdi-postgresql                                  Creating   11m

    The cluster is always creating

  3. see logs
    k logs offpg-uextdi-postgresql-1 -c lorry
    2024-08-08T02:59:30Z    INFO    Initialize DB manager
    2024-08-08T02:59:30Z    INFO    KB_WORKLOAD_TYPE ENV not set
    2024-08-08T02:59:30Z    INFO    Volume-Protection       succeed to init volume protection       {"pod": "offpg-uextdi-postgresql-1", "spec": {"highWatermark":"0","volumes":[]}}
    2024-08-08T02:59:30Z    INFO    HTTPServer      Starting HTTP Server
    2024-08-08T02:59:30Z    INFO    HTTPServer      API route path  {"method": "POST", "path": ["/v1.0/datadump", "/v1.0/lockinstance", "/v1.0/postprovision", "/v1.0/dataload", "/v1.0/volumeprotection", "/v1.0/checkrunning", "/v1.0/leavemember", "/v1.0/exec", "/v1.0/grantuserrole", "/v1.0/unlockinstance", "/v1.0/joinmember", "/v1.0/createuser", "/v1.0/revokeuserrole", "/v1.0/preterminate", "/v1.0/getlag", "/v1.0/switchover", "/v1.0/deleteuser", "/v1.0/rebuild"]}
    2024-08-08T02:59:30Z    INFO    HTTPServer      API route path  {"method": "GET", "path": ["/v1.0/listsystemaccounts", "/v1.0/describeuser", "/v1.0/checkrole", "/v1.0/listusers", "/v1.0/getrole", "/v1.0/healthycheck", "/v1.0/query"]}
    2024-08-08T02:59:30Z    INFO    cronjobs        env is not set  {"env": "KB_CRON_JOBS"}
    2024-08-08T02:59:33Z    INFO    DCS-K8S pod selector: app.kubernetes.io/instance=offpg-uextdi,app.kubernetes.io/managed-by=kubeblocks,apps.kubeblocks.io/component-name=postgresql
    2024-08-08T02:59:33Z    INFO    DCS-K8S podlist: 2
    2024-08-08T02:59:33Z    INFO    DCS-K8S Leader configmap is not found   {"configmap": "offpg-uextdi-postgresql-leader"}
    2024-08-08T02:59:33Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:33Z    INFO    checkrole       role checks failed continuously {"times": 0}
    2024-08-08T02:59:33Z    INFO    event   send event: map[operation:checkRole originalRole:waitForStart]
    2024-08-08T02:59:33Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:33Z    INFO    event   send event success      {"message": "{\"operation\":\"checkRole\",\"originalRole\":\"waitForStart\"}"}
    2024-08-08T02:59:34Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:35Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:36Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:37Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:38Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:39Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:40Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:41Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:42Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:43Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:44Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:45Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:46Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:47Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:48Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:49Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:50Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:51Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:52Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:53Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:54Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:55Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:56Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:57Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:58Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T02:59:59Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:00Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:01Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:02Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:03Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:04Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:05Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:06Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:07Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:08Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:09Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:10Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:11Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:12Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:13Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:14Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:15Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:16Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:17Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:18Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:19Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:20Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:21Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:22Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:23Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:24Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:25Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:26Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:27Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:28Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:29Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:30Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:31Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:32Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:33Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:34Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:35Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:36Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:37Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:38Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:39Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:40Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:41Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:42Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:43Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:44Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:45Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:46Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:47Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:48Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:49Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:50Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:51Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:52Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:53Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:54Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:55Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:56Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:57Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:58Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:00:59Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:00Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:01Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:02Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:03Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:04Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:05Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:06Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:07Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:08Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:09Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:10Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:11Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:12Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:13Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:14Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:15Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:16Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:17Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:18Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:19Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:20Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:21Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}
    2024-08-08T03:01:22Z    INFO    checkrole       executing checkRole error       {"error": "role probe commands is empty!"}

Expected behavior A clear and concise description of what you expected to happen.

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

Additional context Add any other context about the problem here.

github-actions[bot] commented 1 week ago

This issue has been marked as stale because it has been open for 30 days with no activity