search

conformal / cyphertite

A high-security scalable solution for online backups.
https://www.cyphertite.com/
46 stars 8 forks source link

cache list of metadata files, use sha or revno to discern need to re-download #52

Open toddfries opened 11 years ago

toddfries commented 11 years ago

it takes a while to retrieve a large list of metadata files, and for every cyphertite operation to require the download of this list is rather encumbering:

$ time ct -mt 2>&1 | wc -l
2143 0m15.53s real 0m0.19s user 0m0.06s system

toddfries commented 11 years ago

See issue #58 .. if the `list' is treated as a file (whether it is stored in the sqlite db or directly in the fs is an implementation detail) then one can avoid downloading the list if the list matches the block(s) already in the metadata store and use the locally cached version.