weiji14 / foss4g2023oceania

The ecosystem of geospatial machine learning tools in the Pangeo world.
https://hackmd.io/@weiji14/foss4g2023oceania
GNU Lesser General Public License v3.0
11 stars 1 forks source link

:art: Add figure showing xbatcher's features for slicing n-dim arrays #8

Closed weiji14 closed 1 year ago

weiji14 commented 1 year ago

Illustration of xbatcher's features of slicing multi-dimensional arrays on-the-fly with named variables.

xbatcher n-dimensional slicing

This is useful for e.g. time-series or multi-variate oceanography / climate model outputs. Diagram on the left shows how a datacube is sliced, and code block on the right shows how regular slicing code compares to xbatcher.

At the bottom, more features are mentioned such as lazy loading, xarray acessors, and the experiment cache mechanism. Also mentioned upcoming roadmap like shuffling/sampling utilities and async loading of batches.

References: