search

databricks / iceberg-kafka-connect

Apache License 2.0
213 stars 47 forks source link

Adding Transaction id into _cdc_ metadata field #272

Open syook-r7 opened 3 months ago

syook-r7 commented 3 months ago

cdc metadata field missing txid which could be very critical information to check if certain transaction includes all required events. This will be a starting point to solve data gremlin issues.

the PR is currently being used in our production env.

https://github.com/tabular-io/iceberg-kafka-connect/pull/271