casangi / xradio

Xarray Radio Astronomy Data IO
Other
9 stars 5 forks source link

selection applied to load_image() at end, needs to be applied earlier #129

Closed dmehring closed 6 months ago

dmehring commented 6 months ago

The selection (block_des) applied by load_image() is done at the very end once the entire xds has been read (and manipulated by the lower level zarr handling code). This is the very wrong way to do that. The selection should be done as early as possible to avoid loading unnecessary large pieces of data into memory