jorgecarleitao / arrow2

Transmute-free Rust library to work with the Arrow format
Apache License 2.0
1.06k stars 223 forks source link

Added support for MapArray read and write to parquet #1419

Closed b41sh closed 1 year ago

b41sh commented 1 year ago

implement Map data type read and write for parquet

codecov[bot] commented 1 year ago

Codecov Report

Base: 83.66% // Head: 83.63% // Decreases project coverage by -0.03% :warning:

Coverage data is based on head (c6cc76f) compared to base (c877287). Patch coverage: 87.04% of modified lines in pull request are covered.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #1419 +/- ## ========================================== - Coverage 83.66% 83.63% -0.03% ========================================== Files 373 374 +1 Lines 40340 40603 +263 ========================================== + Hits 33749 33960 +211 - Misses 6591 6643 +52 ``` | [Impacted Files](https://codecov.io/gh/jorgecarleitao/arrow2/pull/1419?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Jorge+Leitao) | Coverage Δ | | |---|---|---| | [src/array/fmt.rs](https://codecov.io/gh/jorgecarleitao/arrow2/pull/1419?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Jorge+Leitao#diff-c3JjL2FycmF5L2ZtdC5ycw==) | `64.70% <0.00%> (-0.97%)` | :arrow_down: | | [src/array/growable/mod.rs](https://codecov.io/gh/jorgecarleitao/arrow2/pull/1419?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Jorge+Leitao#diff-c3JjL2FycmF5L2dyb3dhYmxlL21vZC5ycw==) | `83.09% <0.00%> (ø)` | | | [src/array/map/mod.rs](https://codecov.io/gh/jorgecarleitao/arrow2/pull/1419?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Jorge+Leitao#diff-c3JjL2FycmF5L21hcC9tb2QucnM=) | `62.13% <ø> (ø)` | | | [src/io/parquet/read/mod.rs](https://codecov.io/gh/jorgecarleitao/arrow2/pull/1419?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Jorge+Leitao#diff-c3JjL2lvL3BhcnF1ZXQvcmVhZC9tb2QucnM=) | `100.00% <ø> (ø)` | | | [src/io/parquet/write/mod.rs](https://codecov.io/gh/jorgecarleitao/arrow2/pull/1419?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Jorge+Leitao#diff-c3JjL2lvL3BhcnF1ZXQvd3JpdGUvbW9kLnJz) | `86.77% <0.00%> (-1.06%)` | :arrow_down: | | [src/io/parquet/read/indexes/mod.rs](https://codecov.io/gh/jorgecarleitao/arrow2/pull/1419?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Jorge+Leitao#diff-c3JjL2lvL3BhcnF1ZXQvcmVhZC9pbmRleGVzL21vZC5ycw==) | `80.71% <66.66%> (-0.22%)` | :arrow_down: | | [src/io/parquet/read/deserialize/mod.rs](https://codecov.io/gh/jorgecarleitao/arrow2/pull/1419?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Jorge+Leitao#diff-c3JjL2lvL3BhcnF1ZXQvcmVhZC9kZXNlcmlhbGl6ZS9tb2QucnM=) | `75.73% <80.76%> (+1.18%)` | :arrow_up: | | [src/array/growable/map.rs](https://codecov.io/gh/jorgecarleitao/arrow2/pull/1419?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Jorge+Leitao#diff-c3JjL2FycmF5L2dyb3dhYmxlL21hcC5ycw==) | `85.91% <85.91%> (ø)` | | | [src/io/parquet/write/pages.rs](https://codecov.io/gh/jorgecarleitao/arrow2/pull/1419?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Jorge+Leitao#diff-c3JjL2lvL3BhcnF1ZXQvd3JpdGUvcGFnZXMucnM=) | `95.84% <94.82%> (-0.29%)` | :arrow_down: | | [src/io/parquet/read/deserialize/nested.rs](https://codecov.io/gh/jorgecarleitao/arrow2/pull/1419?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Jorge+Leitao#diff-c3JjL2lvL3BhcnF1ZXQvcmVhZC9kZXNlcmlhbGl6ZS9uZXN0ZWQucnM=) | `72.96% <100.00%> (-0.32%)` | :arrow_down: | | ... and [10 more](https://codecov.io/gh/jorgecarleitao/arrow2/pull/1419?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Jorge+Leitao) | | Help us with your feedback. Take ten seconds to tell us [how you rate us](https://about.codecov.io/nps?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Jorge+Leitao). Have a feature suggestion? [Share it here.](https://app.codecov.io/gh/feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Jorge+Leitao)

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.