search

deephaven / deephaven-core

Deephaven Community Core
Other
251 stars 80 forks source link

Parquet: Support v2 Pages #944

Open rcaudy opened 3 years ago

rcaudy commented 3 years ago

Our existing Parquet reading code does not support v2 pages:

As far as we can tell, v2 pages are not quite stable, not ready for primetime, and not commonly used. The following thread gives some context: https://www.mail-archive.com/dev@parquet.apache.org/msg13264.html

When/if the situation changes, we should add support and consider whether we want to start (optionally) writing v2 pages as well.

malhotrashivam commented 1 month ago

Added support to read V2 pages as part of https://github.com/deephaven/deephaven-core/pull/5508