Convert date/timestamp data direct to arrow without chrono

datafusion-contrib / datafusion-orc

Implementation of Apache ORC file format use Apache Arrow in-memory format

Apache License 2.0

30 stars 8 forks source link

Convert date/timestamp data direct to arrow without chrono #34

Closed Jefffrey closed 7 months ago

Jefffrey commented 7 months ago

Currently in the date and timestamp arrow readers, we are reading the values then converting them to NaiveDate/NaiveDateTime's before these are then used to construct the relevant arrow arrays

We can omit this step to chrono types and instead convert the ORC date/timestamp values direct into the arrow underlying representation for dates/timestamps (with any necessary bit/byte manipulation)