hjmangalam / parsyncfp2

MultiHost parallel rsync wrapper
Other
52 stars 6 forks source link

parsyncfp2 can't find the last fpart file. #21

Closed rapier1 closed 2 months ago

rapier1 commented 2 months ago

I'm running the following command with version 2.59 and running into an error:

parsyncfp2/parsyncfp2 --ro='-a -s --rsh=/usr/bin/hpnssh' --maxload=5.5 --NP=5 --chunksize=1T --startdir=/local_mount/space/buffer/ LUN5 rapier@dtn02.xxx.xxx.edu:/xxx/proj/xxxxx

The text of the error is :

yoda WARN: Chunk file [/home/crapier/.pfp2/fpcache/f.38] isn't ready; skipping..

yoda WARN: fpart has finished and the calculated chunk file [/home/crapier/.pfp2/fpcache/f.38] doesn't exist. At this point, the number of chunk files (NBR_FP_FLES) = [38]. Unless there's valid reason to continue, you should consider killing this run and filing a bug. I verified that f.38 does not exist in the specified location. I have everything up to f.37. I'm wondering if there is a fencepost error somewhere.

I tried increasing the chunksize to 2T and I'm getting a very similar error where it's now saying it can't find f.20 (which would be the last in the series). So it really looks like a fencepost error.

As a note: I also tried running it without the rsyncopts, so just using the defaults, and I'm seeing the same issue.

Source OS: Ubuntu 22.04 LTS fpart: V 1.4.0 Dest OS: RHEL 9.4

rapier1 commented 2 months ago

More information: I turned on debug mode and ran the fpart command manually. I'm getting fpart files numbers f.0 to f.37. It's not creating an f.38 file.

rapier1 commented 2 months ago

Turns out the problem is that the installed version of fpart is 1.4.0 and I need 1.6.0.