jorgecarleitao / arrow2

Transmute-free Rust library to work with the Arrow format
Apache License 2.0
1.07k stars 221 forks source link

Add Float16/Half-float logical type to Parquet #1585

Open anjakefala opened 8 months ago

anjakefala commented 8 months ago

Hi!

I wanted to let you know that there is a proposal for an addition of Logical Float-16 (with Fixed Length Byte Array physical typed) to the Parquet Format: https://github.com/apache/parquet-format/pull/184.

The vote has passed. Close to completion are a https://github.com/apache/parquet-mr/pull/1142, https://github.com/apache/arrow/pull/36073, and a https://github.com/apache/arrow/pull/37599. AFAICT, there is no implementation that has been begun in arrow-rs. I opened an issue there too.

Float-16 is supported in https://github.com/jorgecarleitao/arrow2/issues/1050, and it would be great to expand that support to Rust Parquet.