buffer description api in neorawio and xarray reference API bridge

NeuralEnsemble / python-neo

Neo is a package for representing electrophysiology data in Python, together with support for reading a wide range of neurophysiology file formats

http://neo.readthedocs.io/en/latest/

BSD 3-Clause "New" or "Revised" License

325 stars 248 forks source link

buffer description api in neorawio and xarray reference API bridge #1513

Closed samuelgarcia closed 4 weeks ago

samuelgarcia commented 4 months ago

Given the idea of @bendichter and this gist

This is an implementation of "buffer_description_api" for reading analogsignal chunk. This 100% backward compatible.

The idea/goal is:

have a simple buffer description for analogsignal for raw binary (np.memmap) or hdf5 cases (maybe more)
this description can be exported to json
this description can be easily transformed to the xarray/zarr reference external API
make so file cloud ready for streaming chunk of traces

See also kerchunk

bendichter commented 4 months ago

Looks good!

samuelgarcia commented 1 month ago

Merci beaucoup @zm711 and @h-mayorquin for the review

samuelgarcia commented 1 month ago

@zm711 @h-mayorquin @alejoe91 This is OK on my side. test are passing I think we can merge this soon. we will be able to update stream and buffer on reader per reader basis later.

samuelgarcia commented 4 weeks ago

yeah!! merci fois pour l'aide.