BubblesInTheTub / torrent7z

A fork of torrent7z, viz a derivative of 7zip that produces invariant .7z archives for torrenting
GNU General Public License v3.0
47 stars 5 forks source link

Any chance for a version that uses a new codec? #16

Open malvarenga123 opened 2 years ago

malvarenga123 commented 2 years ago

There are 7-Zip codecs supporting Zstandard, Brotli, LZ4, LZ5, Lizard and Fast LZMA2. https://github.com/mcmilk/7-Zip-zstd https://www.tc4shell.com/en/7zip/modern7z/ Those algorithms are significantly faster in both compression and decompression compared to regular LZMA in 7-Zip.

Could torrent7z format be updated to include any of those codecs? Maybe with a different extension (zst.7z, lz4.7z, etc.). If I'm not mistaken, the format can be expanded to include XXH3 hashes, which are also much faster than SHA.

BubblesInTheTub commented 2 years ago

It's possible to add support for them with a different file extension to mark it different from the regular t7z archive. It'll take a bit though, need to cherry pick features from a newer 7z release and make them work with the older version. I'll work on this after servicing the older requests.

malvarenga123 commented 8 months ago

Hi there, @BubblesInTheTub. Any news on this? It seems .zst is the default extension for files using Zstandard: https://github.com/mcmilk/7-Zip-zstd/releases

malvarenga123 commented 3 months ago

RomVault has made a significant update to its compression options to include Zstd. You might want to take a look at it:

ZSTD Compression

So while re-working the zip format it was also possible to add the next big update to ZIP... zstd compression zip. This timing turned out to be just about perfect as MAME can now support reading zstd compressed zips! What is zstd? It is a new compression methods invented by facebook devs, compresses better that deflate, compresses faster than deflate (With multi-threading compression!), and decompresses at crazy fast speeds, so it is win, win, win all the way around. Also WinRAR 7.x and 7zUI v24.x also now support zstd compressed zips, so zstd zip is now a very well supported compression system.

So we now have what I am refering to as Structured archive formats:

These are now the 3 supported structured ZIP formats in RV, but wait... theres more.. lets not leave out 7Z!

7Z got a big upgrade also, now supporting 4 different formats:

As well as these two main features, there have been many equally imported enhancements such as better file fixing source priority selection, and better handling of zero byte files, now meaning zipmove can be used in more places. Dark UI mode has been hiding in RV for a while, but has officially been added to the config UI.

TrrntzipUI becomes S.A.M. Structured Archive Maker

With the arrival of more than just Trrtnzip, TrrntzipUI also needed an overhall, and has officially been renamed to Structred Archive Maker, It can now recompress all of the above structured archive formats. (With the exception of TDC, because you need to DAT to get the Date/time correct.) S.A.M. is now available from the RomVault top menu, and the stand alone version will be released here soon.

And..... just because people do ask for it: The command line versions for windows and Linux got an update with all the new v3.7 features.

Thanks again for all the support, and help from my great freinds over in RomVault discord This great releases would not be what it is without your help and support.