search

apache / iceberg-rust

Apache Iceberg
https://rust.iceberg.apache.org/
Apache License 2.0
673 stars 159 forks source link

bug: ArrowSchemaConverter can't handle unsigned datatypes from arrow #675

Open sundy-li opened 1 month ago

sundy-li commented 1 month ago

error throws for unsigned types 

  _ => Err(Error::new(
                ErrorKind::DataInvalid,
                format!("Unsupported Arrow data type: {p}"),
            )),

cc @Xuanwo

Xuanwo commented 1 month ago

Thank you for the report. I will take a look.

liurenjie1024 commented 2 weeks ago

Iceberg has no built in support for unsigned data types, and I think we could handle this by storing signed value and do byte to byte conversion in read time.