search

hjmangalam / parsyncfp2

MultiHost parallel rsync wrapper
Other
52 stars 6 forks source link

Possibility of using rclone in place of rsync? #3

Closed novosirj closed 1 year ago

novosirj commented 2 years ago

We have mostly stopped using parsyncfp (we haven't yet used version 2, for example) because we've switched mostly to cloud storage, which does not support rsync. We can connect to them with rclone (https://rclone.org), however, which is really similar as far as the command line, etc. goes. Do you imagine this would be possible?

hjmangalam commented 2 years ago

It would be clearly be possible but it would require some reworking to support and check all the options, etc. I'm currently building a house, so I can't do anything before that. I can look at anything before December.

I seem to remember that rclone uses a parallel approach anyway tho . Is that not the case?

Harry

On Thu, Oct 13, 2022, 2:17 AM Ryan Novosielski @.***> wrote:

We have mostly stopped using parsyncfp (we haven't yet used version 2, for example) because we've switched mostly to cloud storage, which does not support rsync. We can connect to them with rclone (https://rclone.org), however, which is really similar as far as the command line, etc. goes. Do you imagine this would be possible?

— Reply to this email directly, view it on GitHub https://github.com/hjmangalam/parsyncfp2/issues/3, or unsubscribe https://github.com/notifications/unsubscribe-auth/AASF3Y6A7HEYA2YHIZAXYRTWC6LNBANCNFSM6AAAAAARD4WFII . You are receiving this because you are subscribed to this thread.Message ID: @.***>

hjmangalam commented 1 year ago

The use of rclone and other transport mechanisms (netcat, UDR, etc) using pfp2's multiple spawn approach is on my TODO list, but far enough out that I'm not going to keep the issue open for now.