circulosmeos / gztool

extract random-positioned data from gzip files with no penalty, including gzip tailing like with 'tail -f' !
https://circulosmeos.wordpress.com/2019/08/11/continuous-tailing-of-a-gzip-file-efficiently/
127 stars 12 forks source link

use libdeflate? #19

Open mflevine opened 1 year ago

mflevine commented 1 year ago

Would implementing with libdeflate improve performance?

circulosmeos commented 1 year ago

Hi @mflevine Using and index improves performance by itself by skipping a lot of bytes. In my experience decompressing with zlib is as quick in modern cpus as to put all the load on the disk side... Is this really an issue in some environment?