pingcap / tiflow

This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
Apache License 2.0
424 stars 283 forks source link

kafka consumer hangs sometimes #10223

Open fubinzh opened 10 months ago

fubinzh commented 10 months ago

What did you do?

  1. run kafka consumer to consumer kafka messages received from cdc

What did you expect to see?

consumer should not hang

What did you see instead?

kafka consumer hangs

cdc.gorountine.txt

Versions of the cluster

kafka consumer: [2023/12/01 06:06:40.001 +00:00] [INFO] [version.go:47] ["Welcome to kafka consumer"] [release-version=v7.5.0-master-dirty] [git-hash=16be21db2811ba50f2846851cffe796213d6531a] [git-branch=canal-json-decoder-reduce-memory] [utc-build-time="2023-11-03 10:34:54"] [go-version="go version go1.21.3 linux/amd64"] [failpoint-build=false]

fubinzh commented 10 months ago

/severity moderate