search

pydata / xarray

N-D labeled arrays and datasets in Python
https://xarray.dev
Apache License 2.0
3.57k stars 1.07k forks source link

Possible autoray integration #8023

Open dcherian opened 1 year ago

dcherian commented 1 year ago

I'm opening this issue for discussion really.

I stumbled on autoray (Github) by @jcmgray which provides an abstract interface to a number of array types.

What struck me was the very general lazy compute system. This opens up the possibility of lazy-but-not-dask computation.

Related: https://github.com/pydata/xarray/issues/2298 https://github.com/pydata/xarray/issues/1725 https://github.com/pydata/xarray/issues/5081

jcmgray commented 1 year ago

Oh happy to answer any questions you might have, I'll just note there are also proper docs for the lazy computation stuff here now - https://autoray.readthedocs.io/en/latest/lazy_computation.html.