Open Lily2025 opened 5 months ago
1、create changefeed 2、run cdc boundary workload which exist big message /workload --database-host=tc-tidb.endless-ha-test-ticdc-simple-protocol-tps-7545174-1-679 --database-port=4000 --database-db-name=cdc_boundary --database-user=root --workload-type=large_row --tps=1000 --row-count=10000000 --table-count=16 --large-row-size=1048576 --large-ratio=0.010000 --thread=16 -skip-create-table 3、consumer oom (the memory of consumer is 32GB)
no oom
consumer oom when progress big message
[2024/06/15 17:36:27.810 +08:00] [INFO] [version.go:47] ["Welcome to kafka consumer"] [release-version=v8.2.0-master] [git-hash=854a4abb24eb486ad026a6b95a0215a05224f8ed] [git-branch=HEAD] [utc-build-time="2024-06-11 06:45:38"] [go-version="go version go1.21.11 linux/amd64"] [failpoint-build=false] [2024/06/15 17:36:27.812 +08:00] [INFO] [tz.go:35] ["Use the timezone of the TiCDC server machine"] [timezoneName=System] [timezone=Asia/Shanghai]
query-status <task-name>
No response
/remove-area dm /area ticdc
/assign 3AceShowHand
/severity moderate
What did you do?
1、create changefeed 2、run cdc boundary workload which exist big message /workload --database-host=tc-tidb.endless-ha-test-ticdc-simple-protocol-tps-7545174-1-679 --database-port=4000 --database-db-name=cdc_boundary --database-user=root --workload-type=large_row --tps=1000 --row-count=10000000 --table-count=16 --large-row-size=1048576 --large-ratio=0.010000 --thread=16 -skip-create-table 3、consumer oom (the memory of consumer is 32GB)
What did you expect to see?
no oom
What did you see instead?
consumer oom when progress big message
Versions of the cluster
[2024/06/15 17:36:27.810 +08:00] [INFO] [version.go:47] ["Welcome to kafka consumer"] [release-version=v8.2.0-master] [git-hash=854a4abb24eb486ad026a6b95a0215a05224f8ed] [git-branch=HEAD] [utc-build-time="2024-06-11 06:45:38"] [go-version="go version go1.21.11 linux/amd64"] [failpoint-build=false] [2024/06/15 17:36:27.812 +08:00] [INFO] [tz.go:35] ["Use the timezone of the TiCDC server machine"] [timezoneName=System] [timezone=Asia/Shanghai]
current status of DM cluster (execute
query-status <task-name>
in dmctl)No response