Conceptual connections to Mozilla's "optimized zip"

sozip / sozip-spec

Specification of seek-optimized zip file profile

https://sozip.org

93 stars 5 forks source link

Conceptual connections to Mozilla's "optimized zip" #13

Open vadimkantorov opened 2 months ago

vadimkantorov commented 2 months ago

I wonder if you have stumbled on https://taras.glek.net/post/optimized-zip-format/ . Are the stated goals of SOZip and "optimized zip" similar or different?

"optimized zip" stresses suitability to OS's read-ahead functionality and sequential scan and SOZip seems to stress perf of random access, so it seems different goals to me, but maybe I'm mistaken.

Thanks!

rouault commented 3 weeks ago

No, Mozilla's optimized zip is a trick to move the "file directory" at the beginning of the zip file, and place frequently accessed files toward the beginning. SOZip goal is to help you to quickly access any part of a typically gigabyte-large file compressed in a ZIP.

Both optimizations are actually "orthogonal", i.e. you could combine them