search

martymac / fpart

Sort files and pack them into partitions
https://www.fpart.org/
BSD 2-Clause "Simplified" License
230 stars 39 forks source link

FPSync not passing exclude options to rsync #23

Closed gamename closed 4 years ago

gamename commented 4 years ago

Hi Ganael,

Sorry to bother you again.

We are passing this invocation to FPSync (below). The content after -O and before -n 32 is quoted on the command line. Notice the "Tool options:" don't show any exclusions. 

 | 2020-07-27T11:39:07.755-05:00 | /usr/bin/fpsync -O -X /ebs/geisprd/.glusterfs -X ./.root -n 32 -f 500000 -vvvv /ebs/geisprd/ /efs/nv-wc-geis-prd/vault11/
  | 2020-07-27T11:39:07.755-05:00 | 1595867947 =====> [9389] Syncing /ebs/geisprd/ => /efs/nv-wc-geis-prd/vault11/
  | 2020-07-27T11:39:07.755-05:00 | 1595867947 ===> Job name: 1595867947-9389
  | 2020-07-27T11:39:07.755-05:00 | 1595867947 ===> Start time: Mon Jul 27 16:39:07 UTC 2020
  | 2020-07-27T11:39:07.755-05:00 | 1595867947 ===> Concurrent sync jobs: 32
  | 2020-07-27T11:39:08.005-05:00 | 1595867947 ===> Workers: local
  | 2020-07-27T11:39:08.005-05:00 | 1595867947 ===> Shared dir: /tmp/fpsync
  | 2020-07-27T11:39:08.005-05:00 | 1595867947 ===> Temp dir: /tmp/fpsync
  | 2020-07-27T11:39:08.005-05:00 | 1595867947 ===> Tool name: "rsync"
  | 2020-07-27T11:39:08.005-05:00 | 1595867947 ===> Tool options: "-lptgoD -v --numeric-ids"     <====
  | 2020-07-27T11:39:08.005-05:00 | 1595867947 ===> Max files or directories per sync job: 500000
  | 2020-07-27T11:39:08.005-05:00 | 1595867947 ===> Max bytes per sync job: 4294967296

I also confirmed there aren't any exclusions with the running jobs (via ps -ef):

root      1723  8811  0 Jul27 ?        00:00:00 /bin/sh /tmp/fpsync/work/1595854539-8731/3322
root      1725  1723  0 Jul27 ?        00:01:36 /usr/bin/rsync -lptgoD -v --numeric-ids -r --files-from=/tmp/fpsync/parts/1595854539-8731/part.3322 --from0 /ebs// /efs/nv-wc-xylem-prd/vault1//
root      1728  1725  0 Jul27 ?        00:00:24 /usr/bin/rsync -lptgoD -v --numeric-ids -r --files-from=/tmp/fpsync/parts/1595854539-8731/part.3322 --from0 /ebs// /efs/nv-wc-xylem-prd/vault1//
root      2292 31289  0 07:33 ?        00:00:07 /usr/bin/rsync -lptgoD -v --numeric-ids -r --files-from=/tmp/fpsync/parts/1595854539-8731/part.3805 --from0 /ebs// /efs/nv-wc-xylem-prd/vault1//

What am I doing wrong?

Thanks, -Tennis

gamename commented 4 years ago

@themedina FYI

martymac commented 4 years ago

Hello again Tennis,

Tool (rsync / cpio) options should be specified using -o (lowercase), not -O, which is reserved for fpart options.

Best regards,

Ganael.

gamename commented 4 years ago

Thanks Ganael! I'll try that.

gamename commented 4 years ago

Seems to work. :) Closing.