search

planetlabs / gpq

Utility for working with GeoParquet
https://planetlabs.github.io/gpq/
Apache License 2.0
156 stars 8 forks source link

Add parquet compression option for converting geojson to parquet files #17

Closed jtmiclat closed 1 year ago

jtmiclat commented 1 year ago

Hi!

I added an option to specify a compression option for converting geojson to parquet.

I ended up not including LZO as it was not supported by parquet-go library and lz4 as it is considered deprecated in parquet spec.

gbq convert --compression uncompressed sample.geojson sample-uncompressed.parquet

Ive also added some basic tests to ensure it actually works.

Would appreciate feedback on this if i missed something as im not to familair with golang as a language!

tschaub commented 1 year ago

Thank you for this contribution, @jtmiclat! This looks great.

I added a commit that makes it so the compression enum values are included in the gqp convert --help docs (the CLI library doesn't do this by default).

tschaub commented 1 year ago

I'll cut a release in the next day or so that will include this change. Thanks again for the contribution.