apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.1k stars 834 forks source link

[cdc] Database sync initializes the set of existed tables #3621

Open yuzelin opened 5 days ago

yuzelin commented 5 days ago

Purpose

One of #2706 The scenario is user might create tables before submitting cdc job, so if we doesn't collect them, the job may fail when processing records of the existed tables.

Tests

API and Format

Documentation