search

ropensci / bowerbird

Keep a collection of sparkly data resources
https://docs.ropensci.org/bowerbird
Other
47 stars 6 forks source link

Can GHRSST handler be made faster by using the remote md5 hashes? #5

Closed raymondben closed 7 years ago

raymondben commented 7 years ago

Suspect not, the slow speed is likely due to the workaround for the symlinks/wget issue.

raymondben commented 7 years ago

No. Because of the symlinks/wget issue, we have to iterate through all files, and timestamped-wget is no slower than getting the md5 and testing it against the local hash.