search

rudi-cilibrasi / classic-complearn

The pre-2015 version of libcomplearn, a data-compression based machine learning library. Minor bugfixes for legacy code.
Other
1 stars 0 forks source link

Compressing floating point data #1

Closed arnikz closed 8 years ago

arnikz commented 8 years ago

Hi, Is there a compressor for floating point data? I would like to try NCD on a set of images. Thank you.

rudi-cilibrasi commented 8 years ago

There is no compressor that supports floating point data to my knowledge. However it is possible to decompress images (in case they are already compressed) and then use standard compressors like bzip2 or lzma on them. An example of this is given in http://homepages.cwi.nl/~paulv/papers/cluster.pdf in the handwritten digit recognition example.

arnikz commented 8 years ago

@rudi-cilibrasi Thanks for the reference. I just found that there are fpack & funpack floating-point data compressors developed by NASA https://heasarc.gsfc.nasa.gov/fitsio/fpack/adassPoster.pdf