Resources Allocation:
COMPONENT DEDICATED CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS
mongodb false 100m / 100m 512Mi / 512Mi data:3Gi kb-default-sc
Images:
COMPONENT TYPE IMAGE
mongodb docker.io/apecloud/mongo:7.0.12
Data Protection:
BACKUP-REPO AUTO-BACKUP BACKUP-SCHEDULE BACKUP-METHOD BACKUP-RETENTION RECOVERABLE-TIME
Show cluster events: kbcli cluster list-events -n default mongo-bk
logs lorry
kubectl logs mongo-bk-mongodb-0 lorry
2024-09-30T03:17:37Z INFO Initialize DB manager
2024-09-30T03:17:37Z INFO KB_WORKLOAD_TYPE ENV not set
2024-09-30T03:17:37Z INFO Volume-Protection succeed to init volume protection {"pod": "mongo-bk-mongodb-0", "spec": {"highWatermark":"0","volumes":[]}}
2024-09-30T03:17:37Z INFO HTTPServer Starting HTTP Server
2024-09-30T03:17:37Z INFO HTTPServer API route path {"method": "POST", "path": ["/v1.0/revokeuserrole", "/v1.0/volumeprotection", "/v1.0/joinmember", "/v1.0/createuser", "/v1.0/deleteuser", "/v1.0/unlockinstance", "/v1.0/getlag", "/v1.0/switchover", "/v1.0/dataload", "/v1.0/leavemember", "/v1.0/rebuild", "/v1.0/postprovision", "/v1.0/preterminate", "/v1.0/grantuserrole", "/v1.0/exec", "/v1.0/checkrunning", "/v1.0/lockinstance", "/v1.0/datadump"]}
2024-09-30T03:17:37Z INFO HTTPServer API route path {"method": "GET", "path": ["/v1.0/getrole", "/v1.0/query", "/v1.0/listusers", "/v1.0/describeuser", "/v1.0/healthycheck", "/v1.0/checkrole", "/v1.0/listsystemaccounts"]}
2024-09-30T03:17:37Z INFO cronjobs env is not set {"env": "KB_CRON_JOBS"}
2024-09-30T03:17:47Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:17:49Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:17:51Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:17:53Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:17:55Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:17:57Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:17:59Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:01Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:03Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:05Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:07Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:09Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:11Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:13Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:15Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:17Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:19Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:21Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:23Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:25Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:27Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:29Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:31Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:33Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:35Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:37Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:39Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:41Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:43Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:45Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"}
2024-09-30T03:18:46Z INFO MongoDB DB is not ready {"error": "connection() error occurred during connection handshake: auth error: sasl conversation error: unable to authenticate using mechanism \"SCRAM-SHA-1\": (AuthenticationFailed) Authentication failed."}
2024-09-30T03:18:48Z INFO MongoDB DB is not ready {"error": "connection() error occurred during connection handshake: auth error: sasl conversation error: unable to authenticate using mechanism \"SCRAM-SHA-1\": (AuthenticationFailed) Authentication failed."}
2024-09-30T03:18:50Z INFO MongoDB DB is not ready {"error": "connection() error occurred during connection handshake: auth error: sasl conversation error: unable to authenticate using mechanism \"SCRAM-SHA-1\": (AuthenticationFailed) Authentication failed."}
2024-09-30T03:18:52Z INFO MongoDB DB startup ready
2024-09-30T03:18:53Z INFO DCS-K8S pod selector: app.kubernetes.io/instance=mongo-bk,app.kubernetes.io/managed-by=kubeblocks,apps.kubeblocks.io/component-name=mongodb
2024-09-30T03:18:53Z INFO DCS-K8S podlist: 3
2024-09-30T03:18:53Z INFO DCS-K8S Leader configmap is not found {"configmap": "mongo-bk-mongodb-leader"}
2024-09-30T03:18:53Z INFO DCS-K8S pod selector: app.kubernetes.io/instance=mongo-bk,app.kubernetes.io/managed-by=kubeblocks,apps.kubeblocks.io/component-name=mongodb
2024-09-30T03:18:53Z INFO DCS-K8S podlist: 3
2024-09-30T03:18:53Z DEBUG checkrole check member {"member": "mongo-bk-mongodb-0", "role": ""}
2024-09-30T03:18:53Z DEBUG checkrole check member {"member": "mongo-bk-mongodb-1", "role": ""}
2024-09-30T03:18:53Z DEBUG checkrole check member {"member": "mongo-bk-mongodb-2", "role": ""}
2024-09-30T03:18:53Z INFO event send event: map[event:Success operation:checkRole originalRole:waitForStart role:{"term":"1727666333036028","PodRoleNamePairs":[{"podName":"mongo-bk-mongodb-0","roleName":"primary","podUid":"60d1e300-1f31-4f60-b3f1-9c94aa10f19a"}]}]
2024-09-30T03:18:53Z INFO event send event success {"message": "{\"event\":\"Success\",\"operation\":\"checkRole\",\"originalRole\":\"waitForStart\",\"role\":\"{\\"term\\":\\"1727666333036028\\",\\"PodRoleNamePairs\\":[{\\"podName\\":\\"mongo-bk-mongodb-0\\",\\"roleName\\":\\"primary\\",\\"podUid\\":\\"60d1e300-1f31-4f60-b3f1-9c94aa10f19a\\"}]}\"}"}
kubectl logs mongo-bk-mongodb-1 lorry
2024-09-30T03:17:52Z INFO Initialize DB manager
2024-09-30T03:17:52Z INFO KB_WORKLOAD_TYPE ENV not set
2024-09-30T03:17:52Z INFO Volume-Protection succeed to init volume protection {"pod": "mongo-bk-mongodb-1", "spec": {"highWatermark":"0","volumes":[]}}
2024-09-30T03:17:52Z INFO HTTPServer Starting HTTP Server
2024-09-30T03:17:52Z INFO HTTPServer API route path {"method": "POST", "path": ["/v1.0/rebuild", "/v1.0/createuser", "/v1.0/datadump", "/v1.0/exec", "/v1.0/volumeprotection", "/v1.0/grantuserrole", "/v1.0/checkrunning", "/v1.0/getlag", "/v1.0/switchover", "/v1.0/deleteuser", "/v1.0/joinmember", "/v1.0/leavemember", "/v1.0/lockinstance", "/v1.0/postprovision", "/v1.0/preterminate", "/v1.0/dataload", "/v1.0/unlockinstance", "/v1.0/revokeuserrole"]}
2024-09-30T03:17:52Z INFO HTTPServer API route path {"method": "GET", "path": ["/v1.0/listsystemaccounts", "/v1.0/healthycheck", "/v1.0/getrole", "/v1.0/query", "/v1.0/checkrole", "/v1.0/describeuser", "/v1.0/listusers"]}
2024-09-30T03:17:52Z INFO cronjobs env is not set {"env": "KB_CRON_JOBS"}
2024-09-30T03:18:02Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:03Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:05Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:07Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:09Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:11Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:13Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:15Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:17Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:19Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
...
kubectl logs mongo-bk-mongodb-2 lorry
2024-09-30T03:18:07Z INFO Initialize DB manager
2024-09-30T03:18:07Z INFO KB_WORKLOAD_TYPE ENV not set
2024-09-30T03:18:07Z INFO Volume-Protection succeed to init volume protection {"pod": "mongo-bk-mongodb-2", "spec": {"highWatermark":"0","volumes":[]}}
2024-09-30T03:18:07Z INFO HTTPServer Starting HTTP Server
2024-09-30T03:18:07Z INFO HTTPServer API route path {"method": "POST", "path": ["/v1.0/postprovision", "/v1.0/getlag", "/v1.0/joinmember", "/v1.0/preterminate", "/v1.0/unlockinstance", "/v1.0/checkrunning", "/v1.0/rebuild", "/v1.0/exec", "/v1.0/revokeuserrole", "/v1.0/leavemember", "/v1.0/switchover", "/v1.0/lockinstance", "/v1.0/volumeprotection", "/v1.0/createuser", "/v1.0/deleteuser", "/v1.0/grantuserrole", "/v1.0/datadump", "/v1.0/dataload"]}
2024-09-30T03:18:07Z INFO HTTPServer API route path {"method": "GET", "path": ["/v1.0/describeuser", "/v1.0/listsystemaccounts", "/v1.0/getrole", "/v1.0/healthycheck", "/v1.0/query", "/v1.0/checkrole", "/v1.0/listusers"]}
2024-09-30T03:18:07Z INFO cronjobs env is not set {"env": "KB_CRON_JOBS"}
2024-09-30T03:18:17Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:19Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:21Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:23Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:25Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:27Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:29Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:31Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:33Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:35Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:37Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:39Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
2024-09-30T03:18:41Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"}
...
**Expected behavior**
A clear and concise description of what you expected to happen.
**Screenshots**
If applicable, add screenshots to help explain your problem.
**Desktop (please complete the following information):**
- OS: [e.g. iOS]
- Browser [e.g. chrome, safari]
- Version [e.g. 22]
**Additional context**
Add any other context about the problem here.
Describe the bug
To Reproduce Steps to reproduce the behavior:
Endpoints: COMPONENT MODE INTERNAL EXTERNAL
mongodb ReadWrite mongo-bk-mongodb.default.svc.cluster.local:27017
mongo-bk-mongodb-mongodb.default.svc.cluster.local:27017
mongo-bk-mongodb-mongodb-ro.default.svc.cluster.local:27017
Topology: COMPONENT INSTANCE ROLE STATUS AZ NODE CREATED-TIME Running ap-northeast-1c ip-172-31-2-216.ap-northeast-1.compute.internal/172.31.2.216 Sep 30,2024 11:17 UTC+0800 Running ap-northeast-1c ip-172-31-11-137.ap-northeast-1.compute.internal/172.31.11.137 Sep 30,2024 11:18 UTC+0800
mongodb mongo-bk-mongodb-0 primary Running ap-northeast-1c ip-172-31-4-99.ap-northeast-1.compute.internal/172.31.4.99 Sep 30,2024 11:17 UTC+0800
mongodb mongo-bk-mongodb-1
mongodb mongo-bk-mongodb-2
Resources Allocation: COMPONENT DEDICATED CPU(REQUEST/LIMIT) MEMORY(REQUEST/LIMIT) STORAGE-SIZE STORAGE-CLASS
mongodb false 100m / 100m 512Mi / 512Mi data:3Gi kb-default-sc
Images: COMPONENT TYPE IMAGE
mongodb docker.io/apecloud/mongo:7.0.12
Data Protection: BACKUP-REPO AUTO-BACKUP BACKUP-SCHEDULE BACKUP-METHOD BACKUP-RETENTION RECOVERABLE-TIME
Show cluster events: kbcli cluster list-events -n default mongo-bk
kubectl logs mongo-bk-mongodb-0 lorry 2024-09-30T03:17:37Z INFO Initialize DB manager 2024-09-30T03:17:37Z INFO KB_WORKLOAD_TYPE ENV not set 2024-09-30T03:17:37Z INFO Volume-Protection succeed to init volume protection {"pod": "mongo-bk-mongodb-0", "spec": {"highWatermark":"0","volumes":[]}} 2024-09-30T03:17:37Z INFO HTTPServer Starting HTTP Server 2024-09-30T03:17:37Z INFO HTTPServer API route path {"method": "POST", "path": ["/v1.0/revokeuserrole", "/v1.0/volumeprotection", "/v1.0/joinmember", "/v1.0/createuser", "/v1.0/deleteuser", "/v1.0/unlockinstance", "/v1.0/getlag", "/v1.0/switchover", "/v1.0/dataload", "/v1.0/leavemember", "/v1.0/rebuild", "/v1.0/postprovision", "/v1.0/preterminate", "/v1.0/grantuserrole", "/v1.0/exec", "/v1.0/checkrunning", "/v1.0/lockinstance", "/v1.0/datadump"]} 2024-09-30T03:17:37Z INFO HTTPServer API route path {"method": "GET", "path": ["/v1.0/getrole", "/v1.0/query", "/v1.0/listusers", "/v1.0/describeuser", "/v1.0/healthycheck", "/v1.0/checkrole", "/v1.0/listsystemaccounts"]} 2024-09-30T03:17:37Z INFO cronjobs env is not set {"env": "KB_CRON_JOBS"} 2024-09-30T03:17:47Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:17:49Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:17:51Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:17:53Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:17:55Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:17:57Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:17:59Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:01Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:03Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:05Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:07Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:09Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:11Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:13Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:15Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:17Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:19Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:21Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:23Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:25Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:27Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:29Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:31Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:33Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:35Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:37Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:39Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:41Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:43Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:45Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown }, ] }"} 2024-09-30T03:18:46Z INFO MongoDB DB is not ready {"error": "connection() error occurred during connection handshake: auth error: sasl conversation error: unable to authenticate using mechanism \"SCRAM-SHA-1\": (AuthenticationFailed) Authentication failed."} 2024-09-30T03:18:48Z INFO MongoDB DB is not ready {"error": "connection() error occurred during connection handshake: auth error: sasl conversation error: unable to authenticate using mechanism \"SCRAM-SHA-1\": (AuthenticationFailed) Authentication failed."} 2024-09-30T03:18:50Z INFO MongoDB DB is not ready {"error": "connection() error occurred during connection handshake: auth error: sasl conversation error: unable to authenticate using mechanism \"SCRAM-SHA-1\": (AuthenticationFailed) Authentication failed."} 2024-09-30T03:18:52Z INFO MongoDB DB startup ready 2024-09-30T03:18:53Z INFO DCS-K8S pod selector: app.kubernetes.io/instance=mongo-bk,app.kubernetes.io/managed-by=kubeblocks,apps.kubeblocks.io/component-name=mongodb 2024-09-30T03:18:53Z INFO DCS-K8S podlist: 3 2024-09-30T03:18:53Z INFO DCS-K8S Leader configmap is not found {"configmap": "mongo-bk-mongodb-leader"} 2024-09-30T03:18:53Z INFO DCS-K8S pod selector: app.kubernetes.io/instance=mongo-bk,app.kubernetes.io/managed-by=kubeblocks,apps.kubeblocks.io/component-name=mongodb 2024-09-30T03:18:53Z INFO DCS-K8S podlist: 3 2024-09-30T03:18:53Z DEBUG checkrole check member {"member": "mongo-bk-mongodb-0", "role": ""} 2024-09-30T03:18:53Z DEBUG checkrole check member {"member": "mongo-bk-mongodb-1", "role": ""} 2024-09-30T03:18:53Z DEBUG checkrole check member {"member": "mongo-bk-mongodb-2", "role": ""} 2024-09-30T03:18:53Z INFO event send event: map[event:Success operation:checkRole originalRole:waitForStart role:{"term":"1727666333036028","PodRoleNamePairs":[{"podName":"mongo-bk-mongodb-0","roleName":"primary","podUid":"60d1e300-1f31-4f60-b3f1-9c94aa10f19a"}]}] 2024-09-30T03:18:53Z INFO event send event success {"message": "{\"event\":\"Success\",\"operation\":\"checkRole\",\"originalRole\":\"waitForStart\",\"role\":\"{\\"term\\":\\"1727666333036028\\",\\"PodRoleNamePairs\\":[{\\"podName\\":\\"mongo-bk-mongodb-0\\",\\"roleName\\":\\"primary\\",\\"podUid\\":\\"60d1e300-1f31-4f60-b3f1-9c94aa10f19a\\"}]}\"}"}
kubectl logs mongo-bk-mongodb-1 lorry 2024-09-30T03:17:52Z INFO Initialize DB manager 2024-09-30T03:17:52Z INFO KB_WORKLOAD_TYPE ENV not set 2024-09-30T03:17:52Z INFO Volume-Protection succeed to init volume protection {"pod": "mongo-bk-mongodb-1", "spec": {"highWatermark":"0","volumes":[]}} 2024-09-30T03:17:52Z INFO HTTPServer Starting HTTP Server 2024-09-30T03:17:52Z INFO HTTPServer API route path {"method": "POST", "path": ["/v1.0/rebuild", "/v1.0/createuser", "/v1.0/datadump", "/v1.0/exec", "/v1.0/volumeprotection", "/v1.0/grantuserrole", "/v1.0/checkrunning", "/v1.0/getlag", "/v1.0/switchover", "/v1.0/deleteuser", "/v1.0/joinmember", "/v1.0/leavemember", "/v1.0/lockinstance", "/v1.0/postprovision", "/v1.0/preterminate", "/v1.0/dataload", "/v1.0/unlockinstance", "/v1.0/revokeuserrole"]} 2024-09-30T03:17:52Z INFO HTTPServer API route path {"method": "GET", "path": ["/v1.0/listsystemaccounts", "/v1.0/healthycheck", "/v1.0/getrole", "/v1.0/query", "/v1.0/checkrole", "/v1.0/describeuser", "/v1.0/listusers"]} 2024-09-30T03:17:52Z INFO cronjobs env is not set {"env": "KB_CRON_JOBS"} 2024-09-30T03:18:02Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:03Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:05Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:07Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:09Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:11Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:13Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:15Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:17Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:19Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} ...
kubectl logs mongo-bk-mongodb-2 lorry 2024-09-30T03:18:07Z INFO Initialize DB manager 2024-09-30T03:18:07Z INFO KB_WORKLOAD_TYPE ENV not set 2024-09-30T03:18:07Z INFO Volume-Protection succeed to init volume protection {"pod": "mongo-bk-mongodb-2", "spec": {"highWatermark":"0","volumes":[]}} 2024-09-30T03:18:07Z INFO HTTPServer Starting HTTP Server 2024-09-30T03:18:07Z INFO HTTPServer API route path {"method": "POST", "path": ["/v1.0/postprovision", "/v1.0/getlag", "/v1.0/joinmember", "/v1.0/preterminate", "/v1.0/unlockinstance", "/v1.0/checkrunning", "/v1.0/rebuild", "/v1.0/exec", "/v1.0/revokeuserrole", "/v1.0/leavemember", "/v1.0/switchover", "/v1.0/lockinstance", "/v1.0/volumeprotection", "/v1.0/createuser", "/v1.0/deleteuser", "/v1.0/grantuserrole", "/v1.0/datadump", "/v1.0/dataload"]} 2024-09-30T03:18:07Z INFO HTTPServer API route path {"method": "GET", "path": ["/v1.0/describeuser", "/v1.0/listsystemaccounts", "/v1.0/getrole", "/v1.0/healthycheck", "/v1.0/query", "/v1.0/checkrole", "/v1.0/listusers"]} 2024-09-30T03:18:07Z INFO cronjobs env is not set {"env": "KB_CRON_JOBS"} 2024-09-30T03:18:17Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:19Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:21Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:23Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:25Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:27Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:29Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:31Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:33Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:35Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:37Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:39Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} 2024-09-30T03:18:41Z INFO MongoDB DB is not ready {"error": "server selection error: context deadline exceeded, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: dial tcp [::1]:27017: connect: connection refused }, ] }"} ...