Convert: Compression toggle doesn't work?

planetlabs / gpq

Utility for working with GeoParquet

https://planetlabs.github.io/gpq/

Apache License 2.0

144 stars 8 forks source link

Convert: Compression toggle doesn't work? #46

Closed m-mohr closed 11 months ago

m-mohr commented 1 year ago

I ran the following commands:

gpq convert C:\Dev\rapidai4eo\stac-v1.0\rapidai4eo_v1_source_pf\pf.parquet rapidai4eo_v1_source_pf_snappy.geoparquet
gpq convert C:\Dev\rapidai4eo\stac-v1.0\rapidai4eo_v1_source_pf\pf.parquet rapidai4eo_v1_source_pf_snappy.geoparquet --compression="snappy"

The files I get are exactly the same. I suspect both files are gzip compressed and the compression parameter was not taken into account.

tschaub commented 1 year ago

Thanks for the report. I noticed the same recently and meant to ticket it. The compression is not taken into account when converting Parquet to GeoParquet, but it is when converting GeoJSON to GeoParquet. There are other issues to work out with the Parquet -> GeoParquet transform (e.g. when going from WKT to WKB, the schema is not updated). This issue can be addressed along with the other transform issues.