cloudnativegeo / cloud-optimized-geospatial-formats-guide

https://guide.cloudnativegeo.org
Creative Commons Attribution 4.0 International
132 stars 19 forks source link

duckdb /duckdb-spatial example for geoparquet? #92

Open cboettig opened 1 year ago

cboettig commented 1 year ago

Thanks for this guide, it's amazing.

It would be great to see an example using duckdb (with or without the spatial extension) in the geoparquet docs! (I have a very basic example with the ~ 200GB of GBIF occurrence data here if it's helpful.

I like the ibis integration with duckdb as I find pure SQL cumbersome and not very pythonic (okay truth I'm actually an R dev and only speak dplyr). This example shows range-based requests but was before the spatial extension for duckdb came out, which is just awesome.

wildintellect commented 1 year ago

That would seem reasonable for such an example to exist, a spatial example being of most relevance. We also don't want to duplicate the depth of https://geog-414.gishub.org/book/duckdb/06_geometries.html

Also will be slightly more relevant when

And DuckDB should support native GeoParquet output at some point, https://medium.com/radiant-earth-insights/performance-explorations-of-geoparquet-and-duckdb-84c0185ed399