10xfuturetechnologies / kafka-connect-iceberg

Kafka Connector for Iceberg tables
Apache License 2.0
16 stars 5 forks source link

Improve schema conversion #8

Open ddcprg opened 1 year ago

ddcprg commented 1 year ago

At the moment we rely on Avro Schemas as an intermediate format between Kafka Connect Schemas and Iceberg Schemas. This conversion is a good start but it isn't an efficient conversion - despite we cache converted schemas.

This issue is to look into building a more efficient Schema transformation