dmwm / CRABServer

15 stars 38 forks source link

enable FTS Reuse for FTS_ASO #8578

Open belforte opened 1 month ago

belforte commented 1 month ago

re-reading https://cern.service-now.com/service-portal?id=ticket&table=incident&n=INC2776329

it looks like we want to set reuse=True in https://github.com/dmwm/CRABServer/blob/e6227eed00e1e3a6e5bd9ec33d6db352173455d0/scripts/task_process/FTS_Transfers.py#L351

Somehow when reinstalling all schedd's via puppet the /etc/use_fts_reuse file got lost and I did not notice. We had waited too long to turn this from "experimental" to "permanent" and the file was there only as a consequence of explicit touch 3 years ago.

cleanup will be needed in https://github.com/dmwm/CRABServer/blob/e6227eed00e1e3a6e5bd9ec33d6db352173455d0/scripts/task_process/FTS_Transfers.py#L86 https://github.com/dmwm/CRABServer/blob/e6227eed00e1e3a6e5bd9ec33d6db352173455d0/scripts/task_process/FTS_Transfers.py#L480 and https://github.com/dmwm/CRABServer/blob/e6227eed00e1e3a6e5bd9ec33d6db352173455d0/scripts/dag_bootstrap_startup.sh#L173-L180

belforte commented 1 month ago

Of course we need to use current mechanism to enable Reuse on a couple of schedd's for a month or so before switching everything.

belforte commented 1 month ago

I have enabled FTS_REUSE on


belforte@aiadm43/~> wassh -c vocmsglidein/crabsched ls /etc/use_fts_reuse
crab-preprod-scd03.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
crab-sched-901.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
crab-sched-903.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
vocms0106.cern.ch: /etc/use_fts_reuse
vocms0107.cern.ch: /etc/use_fts_reuse
vocms0119.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
vocms0120.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
vocms0121.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
vocms0122.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
vocms0137.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
vocms0144.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
vocms0155.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
vocms0194.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
vocms0195.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
vocms0196.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
vocms0197.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
vocms0198.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
vocms0199.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
vocms059.cern.ch: /etc/use_fts_reuse
vocms068.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
vocms069.cern.ch: ls: cannot access '/etc/use_fts_reuse': No such file or directory
belforte@aiadm43/~>