search

aloneguid / parquet-dotnet

Fully managed Apache Parquet implementation
https://aloneguid.github.io/parquet-dotnet/
MIT License
542 stars 140 forks source link

[BUG]: DataFrame loading doesn't support short (int16) columns. #469

Closed mateli closed 2 months ago

mateli commented 5 months ago

Library Version

4.23.3

OS

Windows/Debian

OS Architecture

64 bit

How to reproduce?

Load any parquet file with a Int16 column into a dataframe.

GetTypedDataFast() would need:

            if(col.DataType == typeof(short)) {
                return ((PrimitiveDataFrameColumn<short>)col).ToArray();
            }
            if(col.DataType == typeof(ushort)) {
                return ((PrimitiveDataFrameColumn<ushort>)col).ToArray();
            }

Failing test

No response

mateli commented 5 months ago

Also the new DateOnly datatype is missing in bot serialization and deserialization.