Jandalf81 / rclone_script

Script to setup cloud synchronization on your RetroPie
79 stars 17 forks source link

Extended remote folder read time (probably due to rate limiting by dropbox) #10

Open Blakestr opened 6 years ago

Blakestr commented 6 years ago

Not sure what to do about this. Wouldn't be an issue if it was only a one time thing. Assuming every time this installer script is run as a new install it has to read the folders. A 100 gb dropbox with 51,633 Files, 16,844 Folders (minus whatever Rclone created) took approximately 1 hour.

Jandalf81 commented 6 years ago

Might be related to https://github.com/ncw/rclone/issues/1788

Jandalf81 commented 6 years ago

Possible solution: change the way remote directories are checked

Now: get a list of all folders, check each entry in that list if it's the configured remote base dir Better: Make it a direct check if the remote base dir exists (like if [ -d /path/to/dir ]; then...)

Jandalf81 commented 6 years ago

Changed the way the script checks for the remote base directory with commit a8564b2022bdf794e6e848f766b0d28dd73ae077. Now it tries to list the contents of remotebasedir which

That should be way faster as there's no listing of all directories in the DropBox account involved