martymac / fpart

Sort files and pack them into partitions
https://www.fpart.org/
BSD 2-Clause "Simplified" License
231 stars 39 forks source link

Support remote url for source directory in fpsync #3

Closed etopylight closed 6 years ago

etopylight commented 6 years ago

Hi, thanks for maintaining such great tool. I was wondering if it is possible to support remote url for the source directory? e.g.

fpsync user@host:data/ /mnt/data/

I noticed that a remote url can be in the dst_dir but not in the src_dir. Since there are cases in which a remote server cannot directly access a local computer due to NAT or other firewall settings, it can make fpsync somehow impractical to use in such case if I want to pull data from remote servers.

In rsync, I believe remote urls are both supported in src_dir and dst_dir as long as rsync is installed on both machines. Would it also be possibile for fpsync? e.g.

rsync user@host:data/ /mnt/data/
martymac commented 6 years ago

Hi,

Unfortunately, supporting remote URL for the source directory is not possible as fpsync relies on fpart, which itself needs a local (VFS) access to filesystem to produce file partitions.

Hope this clarifies the situation :)

Best regards,

Ganael.

etopylight commented 6 years ago

Thanks for the explanation.

It's a pity that it isn't supported, maybe a daemon mode for fpart is needed to make it possible I guess? Eventually I've found a workaround by using lftp with the parallel option to pull data :)

Best