Postgres/PostGIS integration

alxmrs / xarray-sql

An experiment to query Xarray datasets with SQL

Apache License 2.0

24 stars 3 forks source link

Postgres/PostGIS integration #57

Open alxmrs opened 1 week ago

alxmrs commented 1 week ago

https://overcast.fm/+AAU1XJb7r0Y/9:25

Can Xarrat/Zarr be hooked up to PostGIS as out DB rasters?

Some notes:

raster2pg
8kb page size, 32x32 pixels.
Want a tile size to match your expected query size

alxmrs commented 1 week ago

postgisRaster

alxmrs commented 1 week ago

Storage module (tiles) is bottleneck; lack of elastic parallelism.

https://overcast.fm/+AAU1XJb7r0Y/23:07

alxmrs commented 1 week ago

Further down this clip: row focus in query plan means a lack of efficient parallelism with raster data. To me, there is an analogy with Dask indexes, and the creation of special “pivoted raster” indexes as in https://github.com/alxmrs/xarray-sql/issues/26#issuecomment-1970822449.