pingcap / tiflow

This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
Apache License 2.0
430 stars 286 forks source link

consumer oom when progress big message #11322

Open Lily2025 opened 5 months ago

Lily2025 commented 5 months ago

What did you do?

1、create changefeed 2、run cdc boundary workload which exist big message /workload --database-host=tc-tidb.endless-ha-test-ticdc-simple-protocol-tps-7545174-1-679 --database-port=4000 --database-db-name=cdc_boundary --database-user=root --workload-type=large_row --tps=1000 --row-count=10000000 --table-count=16 --large-row-size=1048576 --large-ratio=0.010000 --thread=16 -skip-create-table 3、consumer oom (the memory of consumer is 32GB)

What did you expect to see?

no oom

What did you see instead?

consumer oom when progress big message

Versions of the cluster

[2024/06/15 17:36:27.810 +08:00] [INFO] [version.go:47] ["Welcome to kafka consumer"] [release-version=v8.2.0-master] [git-hash=854a4abb24eb486ad026a6b95a0215a05224f8ed] [git-branch=HEAD] [utc-build-time="2024-06-11 06:45:38"] [go-version="go version go1.21.11 linux/amd64"] [failpoint-build=false] [2024/06/15 17:36:27.812 +08:00] [INFO] [tz.go:35] ["Use the timezone of the TiCDC server machine"] [timezoneName=System] [timezone=Asia/Shanghai]

current status of DM cluster (execute query-status <task-name> in dmctl)

No response

Lily2025 commented 5 months ago

/remove-area dm /area ticdc

Lily2025 commented 5 months ago

/assign 3AceShowHand

fubinzh commented 5 months ago

/severity moderate