search

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.16k stars 855 forks source link

[Bug] In cdc database synchronization, data changes to new tables using the combined mode are not monitored, and the job needs to be restarted #3511

Open dsanww opened 1 month ago

dsanww commented 1 month ago

Search before asking

Paimon version

paimon-flink-1.18-0.9-20240610.002222-13 paimon-flink-action-0.9-20240610.002222-13

Compute Engine

flink1.18

Minimal reproduce step

In the cdc database synchronization, the combined mode synchronizes new tables, but does not monitor data changes to the new tables, so the job needs to restart

What doesn't meet your expectations?

I want to dynamically listen to the binlog of new table data without restarting the job

Anything else?

No response

Are you willing to submit a PR?

xingqing commented 40 minutes ago

I encountered the same issue. I only saw the schema was synchronized, but the data was not synchronized.