search

mcmilk / 7-Zip-zstd

7-Zip with support for Brotli, Fast-LZMA2, Lizard, LZ4, LZ5 and Zstandard
https://mcmilk.de/projects/7-Zip-zstd/
Other
4.87k stars 293 forks source link

Allow creation of '*.tar.zstd' files #305

Closed foosmate closed 1 year ago

foosmate commented 1 year ago

We process large amounts of data and it is desired that we deliver all archives in *.tar.zstd format. Unfortunately, it is not possible to create this variant in 7-Zip-zstd. It would be so convenient if we can directly create this archive format on our Windows workstations. Including basic pre-processing like sorting by file-extension and without any intermediate tar file involved.

image

mcmilk commented 1 year ago

It's possible, but you have to use 2 steps for it ... that the default behaviour in 7-Zip Standard also.

1) create the tar file 2) compress it via zstd

foosmate commented 1 year ago

Thanks for the quick reaction. Unfortunately that's not an option here since we have total file sizes > 5 TB and not enough free space (and time) for intermediate tar file creation.

mcmilk commented 1 year ago

It would be nice, if you can ask Igor here for this feature: https://sourceforge.net/p/sevenzip/discussion/45797/ So it becomes implemented in both 7-Zip versions the same.

I don't want too much differences between my version and the Standard one.

CrMaReLi commented 1 year ago

Thanks for the quick reaction. Unfortunately that's not an option here since we have total file sizes > 5 TB and not enough free space (and time) for intermediate tar file creation.

Maybe you can use 7z format with zstd compression method instead of LZMA2? And to determine them from regular 7z archives, use naming scheme like ArchiveName-zstd.7z ?

I know there are differences between how 7z and tar permissions, but maybe it is a viable option for you?