search

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.13k stars 842 forks source link

[cdc] Database sync supports specify partition keys and primary keys #3559

Closed yuzelin closed 2 weeks ago

yuzelin commented 2 weeks ago

Purpose

Specified keys if not exist in source table, we will try to set keys from source table or doesn't set keys.

Tests

MySqlSyncDatabaseActionITCase#testSpecifyKeys KafkaCanalSyncDatabaseActionITCase#testSpecifyKeys

API and Format

database sync supports: --primary-keys --partition-keys

Documentation