sunng87 / datafusion-postgres

Serving any JSON/CSN/Parquet/Arrow files like Postgres tables with Datafusion
Apache License 2.0
23 stars 3 forks source link

Support encoding / decoding binary fields #27

Open mdwaud opened 3 months ago

mdwaud commented 3 months ago

When attempting to return binary data I'm getting Unsupported Datatype Binary and array BinaryArray. It looks like except for into_pg_type binaries aren't really implemented yet.

sunng87 commented 3 months ago

Yes we have a few types to be covered in the conversion module. And I'm thinking about extracting a new crate for conversion between postgres type and arrow.

mdwaud commented 2 months ago

I gave a quick try of the latest release and it looks good so far! Will report back if I encounter any issues.

sunng87 commented 2 months ago

The new version just brings initial support for binary field. But with our experience in GreptimeDB, there are some more binary serieliazation options to support for full postgres compatibility.