search

neurolib-dev / neurolib

Easy whole-brain modeling for computational neuroscientists 🧠💻👩🏿‍🔬
MIT License
409 stars 84 forks source link

autochunk: option to save all simulated data to disk #139

Open caglorithm opened 3 years ago

caglorithm commented 3 years ago

WIP, maybe netcdf?

jajcayn commented 3 years ago

yes, that would be doable.. xarray supports saving to netcdf with a option, which is append. AFAIK, each chunk would be saved with correct time dimension with a option, and this would result in one big nc file with stitched chunks

caglorithm commented 3 years ago

Another option would be storing into HDF files btw. Will also consider it, but xarray is nice because its structured and probably more flexible.

I guess I'll get my hands dirty with xarray & netcdf then and ask for your help :)