search

OpenAddressesUK / hippodamus

Open Addresses' publishing scripts that create the downloadable versions of Open Addresses' database.
http://openaddressesuk.org/docs/
MIT License
0 stars 0 forks source link

Why do we need the inner .zip files? #3

Open giacecco opened 9 years ago

giacecco commented 9 years ago

I am sure that the "Russian doll" structure of the current downloadable files will get lots of gratuitous criticism we may avoid, to ask our audience to focus on the real problems instead.

We need the topmost zip because of how AWS bittorrent support works, but why do we need the inner zips? The files are not getting any smaller anyway.

Is there some reason I am missing? Thanks.

pezholio commented 9 years ago

It's to cut down on storage space. Zipping everything in one file results in a file size of 78.1MB (for the full JSON version), but the Russian Doll structure results in a file that's 64.5MB.

Obviously, that's not a HUGE space saving at the moment, but as we get more addresses when we go into beta, this will increase exponentially.