devinrsmith
commented
6 days ago https://github.com/apache/iceberg/blob/main/format/spec.md#schema-evolution should be consulted in general for issues about how schema evolution and tracking is supposed to happen.
https://www.mail-archive.com/dev@iceberg.apache.org/msg02236.html also talks a bit about Iceberg field-id and Parquet field_id.
Deephaven does not currently handle Iceberg column renames.
Here is an example to produce a set of data that illustrates the issue https://gist.github.com/devinrsmith/a6d537e5dce3ff0b25ba4b9c62d80ada which will first create the table, add some data, rename a column, and add some more data.
When read into Deephaven, only the latest data files have their data represented: