Now the user can choose between ZSTD or GZIP compression format (GZIP being default) and compression level. This change is made upon #50 because it is a feature that we may really need if we use HTML output, that is considerably taking more space than only text.
The code has been changed to use boost::filtering_streambuf to easily switch between algorithms, removing the old GzipWriter class that was handling compression more manually.
Now the user can choose between ZSTD or GZIP compression format (GZIP being default) and compression level. This change is made upon #50 because it is a feature that we may really need if we use HTML output, that is considerably taking more space than only text.
The code has been changed to use
boost::filtering_streambufto easily switch between algorithms, removing the oldGzipWriterclass that was handling compression more manually.To see the real differences of this PR see https://github.com/bitextor/warc2text/pull/51/commits/53709d06456b8e357fe93ce6ebb12b078ecd3084