TypeError: Object of type int64 is not JSON serializable when writing using a Pandas dataframe

delta-io / delta-rs

A native Rust library for Delta Lake, with bindings into Python

https://delta-io.github.io/delta-rs/

Apache License 2.0

2.2k stars 395 forks source link

Closed djouallah closed 4 months ago

djouallah commented 4 months ago

can't write to delta using Pandas, I added a reproducible example in this notebook

ion-elgreco commented 4 months ago

That's a pyarrow pandas compatiblity issue because it fails at dataframe_to_arrays. So you should create an issue at PyArrow repo : )

djouallah commented 4 months ago

thanks