I'd like to suggest another potential format here. Specifically, the ideas raised in the Exdir paper seem interesting. I'll this punts to numpy to address how the numerical matrices are stored, but provides a very flexible format for e.g. metadata etc., and shies away a bit from storing all of the data as a single monolithic file.
I'd like to suggest another potential format here. Specifically, the ideas raised in the Exdir paper seem interesting. I'll this punts to numpy to address how the numerical matrices are stored, but provides a very flexible format for e.g. metadata etc., and shies away a bit from storing all of the data as a single monolithic file.