Utilize Zip format for index folder

xcube-dev / xcube-smos

Experimental xcube support for ESA EE SMOS Level-2 data

https://xcube-dev.github.io/xcube-smos/

MIT License

0 stars 0 forks source link

Utilize Zip format for index folder #8

Closed forman closed 11 months ago

forman commented 11 months ago

The index is a directory with 250,000+ files, several GB in size. However, it compresses well, therefore consider a single Zip archive or annual/monthly Zip archives. Note, a monthly Zip archive can be updated more efficiently.