G-Research / ParquetSharp

ParquetSharp is a .NET library for reading and writing Apache Parquet files.
Apache License 2.0
183 stars 49 forks source link

Support reading and writing decimals with arbitrary length fixed-length byte array columns and writing with int32 or int64 #482

Closed adamreeve closed 2 months ago

adamreeve commented 2 months ago

Fixes #252

This adds a new DecimalConverter class that works with arbitrary length fixed-length byte array columns (as long as values are still representable by a .NET decimal), while keeping the existing Decimal128 class for backwards compatibility and improved performance. I've also added support for writing decimal columns backed by the int32 and int64 physical types.