Open-EO / openeo-processes-python

A Python representation of (most) openEO processes
Apache License 2.0
11 stars 4 forks source link

Tiling by EQUI7 #108

Closed SerRichard closed 2 years ago

SerRichard commented 2 years ago

Currently the save results puts spatial extent into a single file, this consumes too much memory in the back-end per worker. This adds some default tiling so that computation is only done for extents which can be held in memory. This is also a first step towards supporting other tile grids.

LukeWeidenwalker commented 2 years ago

Bunch of comments - I've had a short read over the previous implementation and tried to figure out what was essential and what wasn't, but my current understanding of the odc setup isn't good enough to accurately judge whether this is missing anything crucial. @ValentinaHutter is probably in a better position to review these aspects, my approval on this one isn't that valuable!