Adjust the chunk size and float precision of HDF5 file - Githubissues

cositools / cosipy

The COSI high-level data analysis tools

Apache License 2.0

3 stars 16 forks source link

Adjust the chunk size and float precision of HDF5 file #110

Open israelmcmc opened 7 months ago

israelmcmc commented 7 months ago

https://github.com/cositools/cosipy/blob/a14d9667ead0206e0dbad0acf27a2ccd1cb2e14d/cosipy/response/FullDetectorResponse.py#L631

See: https://davis.lbl.gov/Manuals/HDF5-1.8.7/Advanced/Chunking/index.html

Related to compression speed discussed in #106

Screenshot 2023-11-20 at 11 04 00 AM

As for the float type, we should use float16 instead of the default 64 to save memory and disc space.