Proposal to use ReplacingMergeTree for handling updates/deletes.

itinycheng / flink-connector-clickhouse

Flink SQL connector for ClickHouse. Support ClickHouseCatalog and read/write primary data, maps, arrays to clickhouse.

Apache License 2.0

373 stars 156 forks source link

Open subkanthi opened 1 year ago

subkanthi commented 1 year ago

We have an implemention in the https://github.com/Altinity/clickhouse-sink-connector Kafka sink connector where updates/deletes are handled in ReplacingMergeTree.

Deletes can be handled on the newer ReplacingMergeTree with the is_deleted column.

Happy to submit PR.

itinycheng commented 1 year ago

@subkanthi Thank you, I will study it.