Option to inject kafka metadata

databricks / iceberg-kafka-connect

Apache License 2.0

219 stars 49 forks source link

Closed tabmatfournier closed 7 months ago

tabmatfournier commented 8 months ago

adds KafkaMetadataTransform to inject metadata to Struct/Map records
adds option to inject Kafka metadata to both DMS and Debezium SMTs w/o an additional record copy (using an internally nested KafkaMetadataAppender)
can be configured to inject an (optional) static field such as the (external) kafka cluster address/name

tabmatfournier commented 7 months ago

Quite close, think we can wrap this up today. The only major comment is I don't think offset field should be optional.

Addressed all of this.