integrate performance improvement for sparse sampling

Open-EO / openeo-geopyspark-driver

OpenEO driver for GeoPySpark (Geotrellis)

Apache License 2.0

25 stars 4 forks source link

integrate performance improvement for sparse sampling #740

Closed jdries closed 2 months ago

jdries commented 3 months ago

See: https://github.com/WorldCereal/worldcereal-classification/pull/36#issuecomment-2019557858

ToDO:

[x] throw error if mask_scl_dilation is attempted to be used, users should use to_mask_scl_dilation
[x] check if we respect buffering parameters in this new method
[x] test performance for regular data access
[x] support reading many bands for large areas -> read bands separately
[x] enable by default, for cases where we see a speed-up

jdries commented 3 months ago

Comparison for a case where we are not sampling the data, new code path seems to be better on CDSE. For Terrascope, old approach seemed to be better...

Original:

New: