search

l3uddz / cloudplow

Automatic rclone remote uploader, with support for multiple remote/folder pairings. UnionFS Cleaner functionality: Deletion of UnionFS whiteout files and their corresponding files on rclone remotes. Automatic remote syncer: Sync between different remotes via a Scaleway server instance, that is created and destroyed at every sync.
GNU General Public License v3.0
338 stars 48 forks source link

Files deleted despite "Not deleting source as copy failed" reported #83

Closed kultigspritzig closed 4 years ago

kultigspritzig commented 4 years ago

Describe the bug I noticed that some of the movies went missing. Upon inspecting the logs I noticed the following:


2020-03-12 22:45:50,142 - INFO       - process              - execute                        - 2020/03/12 22:45:50 INFO  :
2020-03-12 22:45:50,143 - INFO       - process              - execute                        - Transferred:        32.345G / 32.338 GBytes, 100%, 2.209 MBytes/s, ETA -
2020-03-12 22:45:50,143 - INFO       - process              - execute                        - Checks:                 4 / 5, 80%
2020-03-12 22:45:50,143 - INFO       - process              - execute                        - Deleted:                2
2020-03-12 22:45:50,143 - INFO       - process              - execute                        - Transferred:            2 / 3, 67%
2020-03-12 22:45:50,143 - INFO       - process              - execute                        - Elapsed time:    4h9m56.0s
2020-03-12 22:45:50,144 - INFO       - process              - execute                        - Checking:
2020-03-12 22:45:50,144 - INFO       - process              - execute                        - Transferring:
2020-03-12 22:45:50,144 - INFO       - process              - execute                        - * Movies/movie/movie.mkv:100% /29.365G, 352/s, -
2020-03-12 22:46:08,566 - INFO       - process              - execute                        - 2020/03/12 22:46:08 NOTICE: xxxx/yyyy/zzzz: Failed to cancel multipart upload: itemNotFound: The resource could not be found.
2020-03-12 22:46:08,676 - INFO       - process              - execute                        - 2020/03/12 22:46:08 ERROR : Movies/movie/movie.mkv: Failed to copy: unexpected end of JSON input
2020-03-12 22:46:08,697 - INFO       - process              - execute                        - 2020/03/12 22:46:08 ERROR : Movies/movie/movie.mkv: Not deleting source as copy failed: unexpected end
of JSON input
2020-03-12 22:46:08,736 - INFO       - process              - execute                        - 2020/03/12 22:46:08 ERROR : Attempt 1/3 failed with 1 errors and: unexpected end of JSON input
2020-03-12 22:46:50,159 - INFO       - process              - execute                        - 2020/03/12 22:46:50 INFO  :
2020-03-12 22:46:50,159 - INFO       - process              - execute                        - Transferred:        32.345G / 32.345 GBytes, 100%, 2.206 MBytes/s, ETA 0s
2020-03-12 22:46:50,159 - INFO       - process              - execute                        - Checks:                 5 / 5, 100%
2020-03-12 22:46:50,159 - INFO       - process              - execute                        - Deleted:                2
2020-03-12 22:46:50,160 - INFO       - process              - execute                        - Transferred:            2 / 2, 100%
2020-03-12 22:46:50,160 - INFO       - process              - execute                        - Elapsed time:   4h10m14.6s
2020-03-12 22:47:18,654 - INFO       - process              - execute                        - 2020/03/12 22:47:18 INFO  : Movies/movie/movie.mkv: Deleted```

**Expected behavior**
After the ``Not deleting source as copy failed`` was reported, the file should not be deleted.

**System Information**

 - Cloudplow Version: cloudbox's most recent, rclone v1.51.0-076-g38a4d50e-beta 
 - Operating System: Ubuntu 18.04.4 LTS
kultigspritzig commented 4 years ago

Could not reproduce with rclone 1.51 release.