search

pete4abw / lrzip-next

Long Range Zip. Updated and Enhanced version of ckolivas' lrzip project. Lots of new features. Better compression. Actively maintained.
https://github.com/pete4abw/lrzip-next
GNU General Public License v2.0
50 stars 10 forks source link

ZPAQ Compression issue when lrizip-next block size > zpaq block size #119

Closed pete4abw closed 1 year ago

pete4abw commented 1 year ago

lrzip which uses ZPAQ 5 SDK can send large blocks to zpaq compressor and all decompresses fine. lrzip-next uses ZPAQ 7.15 SDK. This SDK introduced the StringBuffer class which accepts only block size chunks to compress. While it can be done iterativley, sending large blocks in block size chunks to the StringBuffer , for an unknown reason, something goes wrong. The decompressor can decompress the data fine, but there is corruption and the lrzip-next checksum fails. Any help in diagnosing this is appreciated. Thank you.

PS: Compression is much better when larger blocks are sent to zpaq. Right now, block sizes are limited to the zpaq block sizes, which for lower levels are smaller.

pete4abw commented 1 year ago

Item is resolved for testing in zpaq_bs_fix branch. See discussion.

pete4abw commented 1 year ago

Item is resolved for testing in zpaq_bs_fix branch. See discussion.

Changes promoted to whats-next branch.

pete4abw commented 1 year ago

Item is resolved for testing in zpaq_bs_fix branch. See discussion.

Changes promoted to whats-next branch.

Changes promoted to lzma-22.01 branch along with bzip3 updates.