databricks / iceberg-kafka-connect

Apache License 2.0
219 stars 49 forks source link

Fixes for schema evolution with structs in collections #167

Closed bryanck closed 11 months ago

bryanck commented 11 months ago

This PR fixes schema evolution for list types with struct element types and map types with struct value types. Previously, add column commands were generated for each struct element in the collection. If the collection size was greater than one, then multiple add column commands were generated for the same struct. The schema update would then fail due to duplicate column names.