search

apache / arrow-julia

Official Julia implementation of Apache Arrow
https://arrow.apache.org/julia/
Other
285 stars 60 forks source link

Reading/writing Dec128 #228

Open IsmamHuda opened 3 years ago

IsmamHuda commented 3 years ago

Hi,

Noticed some odd behaviour with reading/writing Dec128 data types. Just documenting in case this is an issue (and not me making a mistake).

I have some data (from SQL) in Dec128 format, which I write into an arrow table with: Arrow.write("file.arrow", df) image

When re-read with df2 = Arrow.Table("file.arrow") |> DataFrame(_) image The data is read as float64 and scrambled.

And reading https://arrow.apache.org/docs/python/api/datatypes.html , I thought that Arrow is trying to support Dec128 types.

Hope you find that helpful.

quinnj commented 3 years ago

Thanks for reporting! Can you clarify where the data is coming from/how it's getting constructed? Hopefully by sharing a code snippet we can use to reproduce the issue? That would help a lot in diagnosing what's wrong here. Thanks!