This PR updates auto table create so the required/optional flag from the record schema is applied. Also, changing a required field to optional will be applied to the Iceberg schema.
The optional flag from the record schema is ignored when it is incompatible. For example, adding a column always adds it as optional. Updating a field from optional to required is ignored.
This PR updates auto table create so the required/optional flag from the record schema is applied. Also, changing a required field to optional will be applied to the Iceberg schema.
The optional flag from the record schema is ignored when it is incompatible. For example, adding a column always adds it as optional. Updating a field from optional to required is ignored.