search

itinycheng / flink-connector-clickhouse

Flink SQL connector for ClickHouse. Support ClickHouseCatalog and read/write primary data, maps, arrays to clickhouse.
Apache License 2.0
346 stars 148 forks source link

flink cdc to clickhouse #113

Closed fancky2019 closed 7 months ago

fancky2019 commented 7 months ago

this is my config below

CREATE TABLE demo (

) WITH ( 'connector' = 'clickhouse', 'url' = 'clickhouse://172.16.112.137:8123', 'database-name' = 'default', 'table-name' = 'demo', 'sink.batch-size' = '500', 'sink.flush-interval' = '1000', 'sink.ignore-delete'='false', 'sink.update-strategy'='update', 'sink.max-retries' = '3' );

when I execute delete or update statement in mysql ,clickhouse data do not change. can you help me?

itinycheng commented 7 months ago

Hi @fancky2019

Your configs look fine, it's better to do some breakpoint testing, the code for update/delete is here: https://github.com/itinycheng/flink-connector-clickhouse/blob/master/flink-connector-clickhouse/src/main/java/org/apache/flink/connector/clickhouse/internal/executor/ClickHouseUpsertExecutor.java