search

yadayada / acd_cli

An unmaintained command line interface and FUSE filesystem for Amazon (Cloud) Drive
Other
1.35k stars 167 forks source link

How to validate local folder with amazon drive? #552

Open 0xFEEDC0DE64 opened 7 years ago

0xFEEDC0DE64 commented 7 years ago

I now uploaded my first Terrabytes of files (encoded as pictures), but I just found random upload errors (mostly timeouts and Http-Error 505).

I ran a acd_cli sync and tried uploading again, but the files that had a timeout were not uploaded again, because they already existed in the cloud! I am not sure if they were uploaded correctly.

How can I validate all my local files with those in the cloud and reupload those which are not 100% correct? I know from the windows client that amazon keeps a MD5 hash and filesize.

So I would like to see a validate option for acd_cli to validate a local folder with a folder in the cloud. Is this easily archievable?

vb0 commented 7 years ago

It can be done for sure, see "rclone check" (this would be the easiest way but rclone isn't working anymore unless you have your own keys or borrow a token from some other app - DON'T do that!).

acd_cli is getting the md5s in the nodes.db. So it shouldn't be an issue to get the local md5s and then dump the list from nodes.db and compare. There is also "acdcli find-md5" but it seems to take a lot of time if you have a large(ish) db even for one file so probably not the right way to go.