Commander is an Optimal Monte-carlo Markov chAiN Driven EstimatoR which implements fast and efficient end-to-end CMB posterior exploration through Gibbs sampling.
GNU General Public License v3.0
20
stars
14
forks
source link
Writing huffman compressed data from Commander simulations runs #128
Currently, what I've implemented in the write_huffman branch just writes uncompressed data, and I have written a python script that will compress the uncompressed data. It would be nice if this were done in Commander, but several things need to be done:
Create the huffman tree structure in commander
Encode the symbols as a binary string
Write the tree and the symbols into the output hdf5 file.
The first two just require fixing my buggy implementation, but the last one requires deleting a dataset in the existing hdf5 file, which as far as I can tell, is not actually implemented in the Fortran implementation of the hdf library.
unfunfunt
commented
2 years ago
Currently, what I've implemented in the
write_huffmanbranch just writes uncompressed data, and I have written a python script that will compress the uncompressed data. It would be nice if this were done in Commander, but several things need to be done:The first two just require fixing my buggy implementation, but the last one requires deleting a dataset in the existing hdf5 file, which as far as I can tell, is not actually implemented in the Fortran implementation of the hdf library.