apache / parquet-format

Apache Parquet Format
https://parquet.apache.org/
Apache License 2.0
1.81k stars 432 forks source link

Simplify Variant shredding and refactor for clarity #461

Open rdblue opened 4 weeks ago

rdblue commented 4 weeks ago

Rationale for this change

Updating the Variant and shredding specs from a thorough review.

What changes are included in this PR?

Spec updates, mostly to the shredding spec to minimize it and make it clear. This also attempts to make the variant spec more consistent (for example, by using value in both).

Do these changes have PoC implementations?

No.