search

fstpackage / fst

Lightning Fast Serialization of Data Frames for R
http://www.fstpackage.org/fst/
GNU Affero General Public License v3.0
619 stars 41 forks source link

compatibility with lz4 command line file format? #179

Open bwlewis opened 5 years ago

bwlewis commented 5 years ago

Just an idea, probably not really very important...

It would be nice if there were an option to output lz4-compressed data in a form compatibile with the lz4 command line file format, see for instance the examples in ?lzDecompress from the https://github.com/bwlewis/lz4 (very old and defunct) package.

MarcusKlik commented 5 years ago

Hi @bwlewis, yes indeed, that would be nice. But although the LZ4 frame format is well documented, I don't see an obvious way of generating LZ4 files from the library API without having the LZ4 command line tool installed.

If you have an idea on how to best implement that, suggestions are very welcome!

bwlewis commented 5 years ago

There is an example of that in that ancient https://github.com/bwlewis/lz4 package, see ?lzDecompress. That example shows compressing a file with the library and then reading that with the lz4 command line program. The reverse could also be possible.