Is your feature request related to a problem or challenge? Please describe what you are trying to do.
6431 adds a new API for obtaining Parquet metadata. To reduce code duplication and confusion, older APIs should be deprecated and eventually removed. Uses of these older APIs within the parquet crate should be converted to the new API.
This issue will track progress of conversion to the new ParquetMetaDataReader API.
Non breaking changes
[x] Deprecate methods in parquet/src/file/footer.rs (parse_metadata, decode_metadata, decode_footer) #6451
[x] Deprecate MetadataLoader #6474
[x] Workaround missing page index inconsistencies (see comment) #6450
Breaking changes
[ ] Add new enum value to ParquetError to signal need for more data #6630
[ ] Leave page index structures as None (rather than empty vectors) if page indexes are not present in the file #6639
[ ] Add async API that supports suffix reads (depends on #6157)
etseidl
commented
1 month ago
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
6431 adds a new API for obtaining Parquet metadata. To reduce code duplication and confusion, older APIs should be deprecated and eventually removed. Uses of these older APIs within the parquet crate should be converted to the new API.
This issue will track progress of conversion to the new
ParquetMetaDataReaderAPI.Non breaking changes
parquet/src/file/footer.rs(parse_metadata,decode_metadata,decode_footer) #6451MetadataLoader#6474Breaking changes
ParquetErrorto signal need for more data #6630None(rather than empty vectors) if page indexes are not present in the file #6639