pingcap / tiflow

This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
Apache License 2.0
417 stars 272 forks source link

consumer oom when progress big message #11322

Open Lily2025 opened 2 weeks ago

Lily2025 commented 2 weeks ago

What did you do?

1、create changefeed 2、run cdc boundary workload which exist big message /workload --database-host=tc-tidb.endless-ha-test-ticdc-simple-protocol-tps-7545174-1-679 --database-port=4000 --database-db-name=cdc_boundary --database-user=root --workload-type=large_row --tps=1000 --row-count=10000000 --table-count=16 --large-row-size=1048576 --large-ratio=0.010000 --thread=16 -skip-create-table 3、consumer oom (the memory of consumer is 32GB)

What did you expect to see?

no oom

What did you see instead?

consumer oom when progress big message

Versions of the cluster

[2024/06/15 17:36:27.810 +08:00] [INFO] [version.go:47] ["Welcome to kafka consumer"] [release-version=v8.2.0-master] [git-hash=854a4abb24eb486ad026a6b95a0215a05224f8ed] [git-branch=HEAD] [utc-build-time="2024-06-11 06:45:38"] [go-version="go version go1.21.11 linux/amd64"] [failpoint-build=false] [2024/06/15 17:36:27.812 +08:00] [INFO] [tz.go:35] ["Use the timezone of the TiCDC server machine"] [timezoneName=System] [timezone=Asia/Shanghai]

current status of DM cluster (execute query-status <task-name> in dmctl)

No response

Lily2025 commented 2 weeks ago

/remove-area dm /area ticdc

Lily2025 commented 2 weeks ago

/assign 3AceShowHand

fubinzh commented 2 weeks ago

/severity moderate