search

scverse / anndata

Annotated data.
http://anndata.readthedocs.io
BSD 3-Clause "New" or "Revised" License
581 stars 154 forks source link

fsspec support #657

Open ivirshup opened 2 years ago

ivirshup commented 2 years ago

It would be nice to have fsspec support in anndata. It would be great to be able to take advantage of these remote access capabilities with zarr and dask.

For hdf5, it would at least make accessing (then caching) whole datasets over the network easier.

A very nice feature to use here is fsspec URIs, as used by xarray (example). These look like: gcs://<bucket-name>/path.zarr or s3://<bucket-name>/path.zarr.

ivirshup commented 2 years ago

We get a bit of this for free through zarr, e.g. ad.read_zarr("http://localhost/adata.zarr") does work.