dmwm / CRABServer

15 stars 37 forks source link

automatic splitting does not work anymore #8464

Closed belforte closed 4 weeks ago

belforte commented 4 weeks ago

after last changes for modern HTCondor the main dag in automatic splitting writes in task_process/RestInfoForFileTransfers.json

{'host': 'cmsweb-testbed.cern.ch:8443', 'dbInstance': 'preprod', 'proxyfile': '/data/srv/glidecondor/condor_local/spool/5130/0/cluster9615130.proc0.subproc0/e080907cad69528d423bbe562e2f8f9873b2c933'}

i.e. the full path for the proxy file, this conflicts with code in FTS_Transfers https://github.com/dmwm/CRABServer/blob/7ac2b90193632df3757bcf3bf7750ff27bf736a3/scripts/task_process/FTS_Transfers.py#L75

and the directory path is added twice making FTS calls fail.

belforte commented 4 weeks ago

The effect of this is that ASO stays in "transferring" forever, which I did not notice initially sine ASO was stuck for everybody due to #8460

belforte commented 4 weeks ago

testing fix in https://cmsweb-testbed.cern.ch/crabserver/ui/task/240603_193544%3Abelforte_crab_20240603_213540

belforte commented 4 weeks ago

test worked. Will merge and deploy to preprod for more validation