apache / parquet-format

Apache Parquet Format
https://parquet.apache.org/
Apache License 2.0
1.69k stars 422 forks source link

PARQUET-2139: Deprecate ColumnChunk::file_offset field #440

Open etseidl opened 1 week ago

etseidl commented 1 week ago

An alternative to #439

Related to parquet-java/#2678 and https://github.com/apache/parquet-java/pull/1369

See mailing list discussion at https://lists.apache.org/thread/r6r2cvzrdoorq6h6gqwh0b1hbfbhxv29

Jira

etseidl commented 6 days ago

Thanks all for the good discussion here and on the mailing list. @wgtmac when you have time could you also take a look? If this is adopted it will allow https://github.com/apache/parquet-java/pull/1369 to move forward. 🙏

alkis commented 5 days ago

With the default in thrift IDL do we need to set this at all?