binary annotation formats

LAAC-LSCP / ChildProject

Python package for the management of day-long recordings of children.

https://childproject.readthedocs.io

MIT License

13 stars 5 forks source link

binary annotation formats #228

Open lucasgautheron opened 3 years ago

lucasgautheron commented 3 years ago

(ultra low priority; proof of concept)

[ ] tests passing
[ ] documentation
[x] dynamic extension
[x] set output format an option for the merger
[x] gzip
[x] hdf5
[x] parquet

lucasgautheron commented 3 years ago

According to this benchmark, it is not worth using HDF_Fixed in any case.

So we should use HDF_Table, taking advantage of categoricals, AND maybe merging annotations from different recordings together (which will require a bit of work and will make it harder to use datasets without the python API)