ivirshup / sc-interchange

Better interchange for single cell tools
8 stars 0 forks source link

other file formats and data models for annotated arrays #5

Open neuromusic opened 5 years ago

neuromusic commented 5 years ago

In your landscaping, it might be worth calling out other file formats for annotated arrays. Building a schema on top of these standards could facilitate interoperability.

ivirshup commented 5 years ago

Yup, a few of these had come up in previous discussion with @LTLA. The idea of Arrow/ Parquet had also come up.

I like the idea of xarray/ netCDF for the existing infrastructure, though it's unclear to me what the status is of sparse data for netCDF. There has been a little discussion of this on the xarray sparse issue (https://github.com/pydata/xarray/issues/1375).