tabular-io / iceberg-kafka-connect

Apache License 2.0
203 stars 46 forks source link

Add config to force optional cols on auto create and schema evolution #138

Closed bryanck closed 11 months ago

bryanck commented 11 months ago

This PR adds a new config option, iceberg.tables.schema-force-optional, that will set all columns to optional during table auto creation and schema evolution. The default for this is false so the required flag from the schema will be respected. This can be useful in cases where multiple topics with different schemas are being combined into a single table.