cjnaz / rclonesync-V2

A Bidirectional Cloud Sync Utility using rclone
MIT License
357 stars 39 forks source link

Sync problem with NextCloud #15

Closed xaviercm63 closed 5 years ago

xaviercm63 commented 6 years ago

Hi,

I'm trying to setup a sync between a "Windows 2012R2 server" and NextCloud (v14.0.3) running on a Linux server.

I've already ran a (succesfully) rclone sync (one way) from Path 1 to Path 2 (not with "rclonesync" just "rclone").

Now, i try to run rclonesync in "dry-run" mode and the sync failed systematically (after about 30 mn) whith these error :

8<------------------------------------------------------------- 2018/10/31 15:12:28 ERROR : DirectoryName/SubDirectoryName error listing: couldn't list files: read tcp 192.168.0.1:50073->AAA.BBB.CCC.DDD:443: wsarecv: An existing connection was forcibly closed by the remote host.

2018/10/31 15:12:28 Failed to lsl: couldn't list files: read tcp 192.168.0.1:49817->AAA.BBB.CCC.DDD:443: wsarecv: An existing connection was forcibly closed by the remote host.

2018-10-31 15:12:28,076: WARNING rclone lsl try 1 failed. - ABC_DISTANT:/DATAS-ABC/

... ...

2018-10-31 16:13:32,301: WARNING rclone lsl try 3 failed. - ABC_DISTANT:/DATAS-ABC/2018-10-31 16:13:32,303: ERROR rclone lsl failed. Specified path invalid? (Line 152) - ABC_DISTANT:/DATAS-ABC/

2018-10-31 16:13:32,303: Critical Error Abort - Must run --first-sync to recover. See README.md 8<-------------------------------------------------------------

I used this command to start the sync :

python rclonesync.py --dry-run --first-sync --max-deletes 1 --rclone C:\rclone\rclone.exe E:\ABC ABC_DISTANT:/DATAS-ABC

I got this output (before errors occur) :

8<------------------------------------------------------------- 2018-10-31 14:42:06,160: BiDirectional Sync for Cloud Services using rclone 2018-10-31 14:42:08,572: Synching Path1 <E:\ABC/> with Path2 <ABC_DISTANT:/DATAS-ABC/> 2018-10-31 14:42:08,572: Command line: <Namespace(Path1='E:\ABC', Path2='ABC_DISTANT:/DATAS-ABC', check_access=False, check_filename='RCLONE_TEST', dry_run=True, filters_file=None, first_sync=True, force=False, max_deletes=1, no_datetime_log=False, rc_verbose=None, rclone='C:\rclone\rclone.exe', remove_empty_directories=False, verbose=False, workdir='C:\Users\Administrateur/.rclonesyncwd')> 2018-10-31 14:42:08,573: >>>>> --first-sync copying any unique Path2 files to Path1 8<-------------------------------------------------------------

Any ideas ?

/Xavier

cjnaz commented 6 years ago

Hi Xavier, I was away on vacation and just noticed your posted issue. The date stamps with '/' are from rclone.exe itself. It appears that the rclone lsl is failing.

A few Qs 1 - if you issue a manual rclone lsl ABC_DISTANT:/DATAS-ABC/, how long does it take to complete? If the lsl finishes quickly then the issue may be in how rlconesync is issuing the rclone command.
2 - about how many files are on the remote? rclonesync attempts to read the entire file list into memory, and possibly may be exploding the working memory to the point of failure. 3 - couldn't list files: read tcp 192.168.0.1:50073->AAA.BBB.CCC.DDD:443 - This looks odd. Do you have some type of port forwarding set up? The next line refers to port 49817. Hum... I'm not familiar with Windows wsarecv, fyi. Try asking in the rlcone github issues/forum.

cjnaz commented 6 years ago

Hello Xavier, Any update, or shall I close this issue? cjn

cjnaz commented 5 years ago

Nothing heard.