icewind1991 / files_external_dropbox

External Storage backend for Dropbox
GNU Affero General Public License v3.0
56 stars 19 forks source link

Some subfolders will never sync #18

Open GAS85 opened 6 years ago

GAS85 commented 6 years ago

Hi, I noticed that after latest master upgrade, root sync issue was solved, but I've noticed that API2 Dropbox folder is smaller than it should be... image

The thing is - I still have APIv1 enabled and use both of them, but it is time limited: image

If I discover subfolders, some of them has different size. I could not really find what exactly is wrong with not synced folders, like path is too long or files fas some strange symbols in names, nothing. image

php occ files:scan --all was executed many times, does not solve the issue.

edited: Just checked statistic and new App with APIv2 creates around 5k API calls per day, and App with APIv1 around 300 API calls per day. image image

icewind1991 commented 6 years ago

Can you provide the names of some of the incorrect folders?

GAS85 commented 6 years ago

I found some interesting thing, all corrupted folder are listed on APIv2 with creation date 01.01.1970: This I can see only if connect via webdav

... webdav/Dropbox-gas_A2/Other/OLD$ ls -la
итого 1080
drwx------ 1 user user      0 Dez 29 11:38 .
drwx------ 1 user user      0 Dez 29 11:38 ..
...
drwx------ 1 user user      0 Jan  1  1970 Hurgada
...
drwx------ 1 user user      0 Jan  1  1970 Nsk 22122013

So path will be like .../Dropbox-gas_A2/Other/OLD/Hurgada

Or this is other examples:

webdav/Dropbox-gas_A2/Other/OLD$ ls -la ../../Share/ | grep 1970
drwx------ 1 user user        0 Jan  1  1970 Knaus

path is /Dropbox-gas_A2/Share/Knaus and /Dropbox-gas_A2/Share/Master Nothing special - 0 Files.

I will try to recreate APIv2 Dropbox. Could it be that issue comes because of update of this app?

realslacker commented 6 years ago

I seem to be seeing this as well. In my case it's files in my YNAB folder.

Dropbox:\Apps\... (these are ok)
Dropbox:\Camera Uploads\... (these are ok)
Dropbox:\YNAB\Exports\... (files missing, directory empty)
Dropbox:\YNAB\Lisa's Budget 2018~5F8411EF.ynab4\... (files and direcotries missing, directory empty)
Dropbox:\YNAB\My Budget 2018~9D9A9073.ynab4\... (files and direcotries missing, directory empty)
Dropbox:\YNAB\My Budget~C022A36D.ynab4\... (files and direcotries missing, directory empty)
GAS85 commented 6 years ago

Just checked with other user that we have Dropbox shares... The same folder is corrupted "/Share/Master". But for me it is empty, and for user 2 it contains subfolders, but 0 files at all. Originally it has subfolders and files everywhere.

Flori1989 commented 6 years ago

It looks like all directories whose names begin with uppercase letters are not synced. Can anyone confirm that?

GAS85 commented 6 years ago

Not really, I have more folders with uppercase letters at the begging, but not all of them have trouble.

icewind1991 commented 6 years ago

Can you try re-scanning the storage.

occ files:scan --path /$user/files/Path/To/Dropbox
GAS85 commented 6 years ago

I did it before and I have a cron job twice a day to run this rescan scrip: https://github.com/GAS85/nextcloud_scripts/blob/master/nextcloud-file-sync.sh there was no positive effect at all. I will try to run command manually this evening to do the test.

hpfmn commented 6 years ago

For me is also one folder not synced and this is a folder that is also synced with another app. It is all small letters - so it has nothing to do with capital letters.

hpfmn commented 6 years ago

If it is of any interest I used the owncloud version of this plugin and didn't have the issue for me.

GAS85 commented 6 years ago

Size is still 0 for same folders.

zpv commented 6 years ago

@GAS85 I took the latest plugin from ownCloud and made it compatible with Nextcloud using icewind1991's original patch.

https://github.com/zpv/files_external_dropbox

It has been working fine for me so far and fixes the missing files/subdirectories the current version of this experiences.

hpfmn commented 6 years ago

@zpv it is not possible to activate your plugin... but if just updating the base helps maybe @icewind1991 should consider this?

zpv commented 6 years ago

@hpfmn Latest commit should be working now. Forgot to remove a line in the metadata regarding ownCloud dependency.

hpfmn commented 6 years ago

I think the problem is commit 03ba610c21197453800d8f805a1e29f55c98f4e8 - for some reason it helps to put everything to lower case.