jorgecarleitao / parquet2

Fastest and safest Rust implementation of parquet. `unsafe` free. Integration-tested against pyarrow
Other
356 stars 59 forks source link

Improve deserialize API #192

Open jorgecarleitao opened 2 years ago

jorgecarleitao commented 2 years ago

This PR significantly expands the deserialize API to cover the possible variations of pages that exist.

The example demos how it can be used.

codecov-commenter commented 2 years ago

Codecov Report

Merging #192 (2deb916) into main (52756d1) will decrease coverage by 3.14%. The diff coverage is 35.04%.

@@            Coverage Diff             @@
##             main     #192      +/-   ##
==========================================
- Coverage   85.64%   82.49%   -3.15%     
==========================================
  Files          84       86       +2     
  Lines        8248     8616     +368     
==========================================
+ Hits         7064     7108      +44     
- Misses       1184     1508     +324     
Impacted Files Coverage Δ
src/deserialize/integer.rs 0.00% <0.00%> (ø)
src/encoding/plain_byte_array.rs 84.00% <ø> (ø)
src/deserialize/binary.rs 13.63% <9.09%> (-61.37%) :arrow_down:
src/deserialize/native.rs 33.33% <20.00%> (-30.31%) :arrow_down:
src/deserialize/fixed_binary.rs 21.66% <21.66%> (ø)
src/deserialize/boolean.rs 27.02% <24.24%> (-45.20%) :arrow_down:
src/deserialize/utils.rs 65.45% <66.16%> (-24.21%) :arrow_down:
src/deserialize/values.rs 69.56% <69.56%> (ø)
src/deserialize/hybrid_rle.rs 38.37% <0.00%> (-22.10%) :arrow_down:
... and 3 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.