Config to set ID columns for CDC/upsert

tabular-io / iceberg-kafka-connect

Apache License 2.0

192 stars 41 forks source link

Config to set ID columns for CDC/upsert #78

Closed bryanck closed 11 months ago

bryanck commented 11 months ago

Currently, the sink requires that the Iceberg identifier fields be set on the table to identify a row for CDC and upsert operations. This PR adds a new configuration option that allows the ID columns to be set via the config, in cases when the identifier fields are not set on a table.