extract XBRL file from zip archive and store as zstd format.

yosukesan / clfi

MIT License

0 stars 0 forks source link

extract XBRL file from zip archive and store as zstd format. #26

Open yosukesan opened 1 year ago

yosukesan commented 1 year ago

comparison of compressed and uncompressed files. The content and number of files are the same in the dirs. Consider to use more space efficient compression format like zstd.

$ du -sh XBRL_raw/
2.8M    XBRL_raw/
$ du -sh XBRL
13M XBRL

yosukesan commented 1 year ago

The reason why to choose zstd is here. brotli and zstd are faster than commonly used zip, gzip, bzip and lzma https://peazip.github.io/fast-compression-benchmark-brotli-zstandard.html