rsync failing with I/O error when copying to rclone mount

[pkishino]

I keep getting the following when trying to copy to an rclone mount since I recently switched to this fuse version: Using latest release 1.0.27 installed via brew

rsync: writefd_unbuffered failed to write 32768 bytes [sender]: Broken pipe (32)
rsync: write failed on "/Users/patrick/plex_crypt/sports/Formula 1/Formula.1.2023.Round.14.DutchGP.Qualifying.F1.Live.1080p.SS/Formula.1.2023.Round.14.DutchGP.Qualifying.F1.Live.1080p.SS.mkv": Input/output error (5)
rsync error: error in file IO (code 11) at /AppleInternal/Library/BuildRoots/d9889869-120b-11ee-b796-7a03568b17ac/Library/Caches/com.apple.xbs/Sources/rsync/rsync/receiver.c(268) [receiver=2.6.9]
rsync: connection unexpectedly closed (207 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at /AppleInternal/Library/BuildRoots/d9889869-120b-11ee-b796-7a03568b17ac/Library/Caches/com.apple.xbs/Sources/rsync/rsync/io.c(453) [generator=2.6.9]
rsync: connection unexpectedly closed (30 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at /AppleInternal/Library/BuildRoots/d9889869-120b-11ee-b796-7a03568b17ac/Library/Caches/com.apple.xbs/Sources/rsync/rsync/io.c(453) [sender=2.6.9]

any suggestions? with the old kex macfuse version this wasn't a problem.

[macos-fuse-t]

Steps to reproduce?

[pkishino]

actually, after I uninstalled, re-installed, rebooted it seems to not occur again.. I'll close for now.

[pkishino]

since today, suddenly this keeps re-occuring.

rsync ~/Music/J.\ R.\ R.\ Tolkien\ -\ The\ Hobbit\ \[BBC\ Radio\ Drama].m4b .
sending incremental file list
J. R. R. Tolkien - The Hobbit [BBC Radio Drama].m4b
         32,768   0%    0.00kB/s    0:00:00  rsync: [receiver] write failed on "/Users/patrick/gdrive_crypt/audiobooks/m4b/J. R. R. Tolkien/The Hobbit/J. R. R. Tolkien - The Hobbit [BBC Radio Drama].m4b": Input/output error (5)
rsync error: error in file IO (code 11) at receiver.c(380) [receiver=3.2.7]

rsync: [sender] write error: Broken pipe (32)

this is the rclone mount command:

/usr/local/bin/rclone --config=/Users/Patrick/.config/rclone/rclone.conf mount $mount: /Users/Patrick/$mount --allow-other --poll-interval 10s --drive-pacer-min-sleep 10ms --drive-pacer-burst 1000 --volname $mount --daemon

[macos-fuse-t]

is it over the network? please attach the logs from ~/Library/Application\ Support/fuse-t/logs/nfsv4-go.log

[pkishino]

Yes, connected to gdrive.. Logs are pretty huge but it looks like this continuously:

time="2023-09-20T13:46:26+09:00" level=warning msg="fuse listxattr returned error: -7
8"
time="2023-09-20T13:46:26+09:00" level=warning msg="fuse listxattr returned error: -7
8"
time="2023-09-20T13:50:13+09:00" level=error msg="txOpenExisting: 108, Brian Herbert 
and Kevin J. Anderson - Mentats of Dune.m4b: lookup failed"
time="2023-09-20T13:50:13+09:00" level=error msg="txOpenExisting: 108, Brian Herbert 
and Kevin J. Anderson - Mentats of Dune.m4b: lookup failed"
time="2023-09-20T14:04:30+09:00" level=warning msg="fuse listxattr returned error: -7
8"
time="2023-09-20T14:04:31+09:00" level=warning msg="fuse listxattr returned error: -7
8"
time="2023-09-20T14:04:31+09:00" level=warning msg="fuse listxattr returned error: -7
8"
time="2023-09-20T14:04:46+09:00" level=warning msg="fuse listxattr returned error: -7
8"
time="2023-09-20T14:04:46+09:00" level=warning msg="fuse listxattr returned error: -7
8"
time="2023-09-20T14:04:46+09:00" level=warning msg="fuse listxattr returned error: -7
8"

I can’t see anything except above warning and occasionally those lookup errors

[macos-fuse-t]

Since it's over the network it can be related to lost connectivity or timeouts while writing. If it's a fuse-t issue there should be a relevant error in the log. Please attach the full log file or send it to me by email. If there are no relevant errors, you should probably ask the rclone author for further instructions.

[pkishino]

https://file.io/E28IPgYzA2Dm Please check there.. I’ll also check with rclone issues

[pkishino]

I’ll try tuning the rclone mount and report back if it fixes the issue

[macos-fuse-t]

I can see a few errors "Read failed with IO" and "Write failed with IO" that can be network related You need to ask the rclone authors