search

pfalcon / uzlib

Radically unbloated DEFLATE/zlib/gzip compression/decompression library. Can decompress any gzip/zlib data, and offers simplified compressor which produces gzip-compatible output, while requiring much less resources (and providing less compression ratio of course).
Other
303 stars 82 forks source link

Small files being skipped (while using ESP32-targz) #38

Closed frankcohen closed 3 years ago

frankcohen commented 3 years ago

Hi, thanks for publishing and maintaining uzlib. I am using the branch that appears in ESP32-targz, a tar decompression utility for ESP32 devices. A decompressed archive skips a text file containing JSON encoded data. It successfully decompresses audio (.m4a) and video (.mpg) binary files in the same archive.

I am creating the TAR archive on a Mac using: COPYFILE_DISABLE=1 tar czf startup.tar.gz --exclude ".DS_Store" startup Without these flags ESP32-targz skips all files after the .DS_Store and other files beginning with a period.

Perhaps this is not a uzlib issue, I thought I would check just in case.

Thanks! -Frank

pfalcon commented 3 years ago

Glad that you find the project useful!

But, the scope of this project is compression/decompression of zlib and gzip files, nothing beyond that (e.g., no tar). So, if you're able to provide a (small) .gz file which would decompress with uzlib to something else than the standard gzip decompresses it, I can look into it. Otherwise, I'd suggest to report issue to ESP32-targz first.

frankcohen commented 3 years ago

Thanks for the reply. I've been debugging ESP32-targz. I'm pretty sure the problem is in the way it handles tar extended data structures for multiple files. I haven't found it yet, still looking. Once I find and fix it I will be publishing my developer journal to Reddit. The combo of uzlib and untar is great! -Frank

frankcohen commented 3 years ago

I found the problem and posted a patch to the ESP32-targz library as Issue #33. Also I posted to Reddit my developer journal of using ESP32-targz with uzlib as Using TAR files in ESP32 with SD applications for easy multiple file transfers

pfalcon commented 3 years ago

Nice work! I assume this can be closed, feel free to reopen if an issue will be found on uzlib side.