bopen / sarsen

Algorithms and utilities for Synthetic Aperture Radar (SAR) sensors
Apache License 2.0
271 stars 26 forks source link

Make processing dask-friendly to allow larger-than-memory and parallel processing #25

Closed alexamici closed 2 years ago

alexamici commented 2 years ago

Almost all operations can be chunked via the DEM chunks (not the image ones).

This includes:

The main source of dask-unfriendliness is the wide spread use of DataArray.interp with the target values on the DEM coordinates. All operations (except the gamma flattening) can be performed on ("x", "y") blocks exactly.