search

ArchiveTeam / wget-lua

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.
https://www.archiveteam.org/
GNU General Public License v3.0
99 stars 14 forks source link

Support Zstd newer than 1.4.4 #15

Open Arkiver2 opened 1 year ago

Arkiver2 commented 1 year ago

Supporting a version of Zstd requires some testing to make sure all works well.

sfan5 commented 1 year ago

Out of curiosity, what kind of problems do you expect? Every Zstd version is used on probably millions of devices so I'd think that updating e.g. within a minor version (to 1.4.9) is close to 100% safe.

TheTechRobo commented 1 year ago

@sfan5 I think one issue is compression ratios - I heard that they were worried about worse compression ratios. I'm not sure if that's the issue here or not.