search

databricks / iceberg-kafka-connect

Apache License 2.0
220 stars 49 forks source link

Adding Transaction id into _cdc_ metadata field #272

Open syook-r7 opened 4 months ago

syook-r7 commented 4 months ago

cdc metadata field missing txid which could be very critical information to check if certain transaction includes all required events. This will be a starting point to solve data gremlin issues.

the PR is currently being used in our production env.

https://github.com/tabular-io/iceberg-kafka-connect/pull/271