search

DUNE / data-mgmt-ops

3 stars 3 forks source link

Onboard RAL-PP as an RSE #1

Closed StevenCTimm closed 4 years ago

StevenCTimm commented 4 years ago

srm://heplnx204.pp.rl.ac.uk/pnfs/pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/dune gsiftp://mover.pp.rl.ac.uk//pnfs/pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/dune root://mover.pp.rl.ac.uk//pnfs/pp.rl.ac.uk/pnfs/pp.rl.ac.uk/data/dune

We have 200TB allocated.

wyuan-uoe commented 4 years ago

I added RAL-PP RSE, right now I can use Rucio client uploads and downloads files, but if add replica rules to transfer files to RAL-PP, the transfers are stuck. I'm wondering if RAL-PP had the proper FTS config.

StevenCTimm commented 4 years ago

Do we have the distances set correctly between RAL-PP and wherever you are trying to make the rules to transfer from?

StevenCTimm commented 4 years ago

Indeed there are not any distances set, you need to set them with rucio-admin add-distance

wyuan-uoe commented 4 years ago

OK. I found my problem. I should use add-distance instead of update-distance to set the distance for the first time.

wyuan-uoe commented 4 years ago

I've added the new RSE RAL-PP. I tested it using Rucio client to upload and get files with different protocols. I also tried to add replica rules for tansfer a small number of files. Transfers are OK now, as 

f90d68324f404c248466ee135559dbc9  dunepro    protodune-dp:np02_photon_run_number_2817                                                 OK[1/0/0]               RAL-PP                                 1                   2020-04-15 15:30:05
af34a283ccfc43108328f8f670d8e789  dunepro    protodune-dp:np02_photon_run_number_2816                                                 OK[1/0/0]               RAL-PP                                 1                   2020-04-20 10:27:51
4ff73a227e7c4ae4bc93e41b010fe21d  dunepro    protodune-sp:np04_raw_run_number_1214                                                    OK[7/0/0]               RAL-PP                                 1                   2020-04-16 15:48:43

This is the script I used :

rucio-admin --account=root rse add RAL-PP

rucio-admin --account=root rse add-protocol --hostname mover.pp.rl.ac.uk --scheme gsiftp --prefix /pnfs/pp.rl.ac.uk/data/dune --port 2811 RAL-PP --domain-json '{"wan": {"read": 1, "write": 1, "delete": 1, "third_party_copy": 1}}'
rucio-admin --account=root rse add-protocol --hostname mover.pp.rl.ac.uk --scheme root --prefix /pnfs/pp.rl.ac.uk/data/dune RAL-PP --domain-json '{"wan": {"read": 1, "write": 1, "delete": 1, "third_party_copy": 1}}'
rucio-admin --account=root rse add-protocol --hostname heplnx204.pp.rl.ac.uk --scheme srm --port 8443 --web-service-path '/srm/managerv2?SFN=' --prefix /pnfs/pp.rl.ac.uk/data/dune RAL-PP --domain-json '{"wan": {"read": 1, "write": 1, "delete": 1, "third_party_copy": 1}}'

rucio-admin --account=root rse set-attribute --rse RAL-PP --key fts --value https://fts3-public.cern.ch:8446
rucio-admin --account=root rse set-attribute --rse RAL-PP --key UK_SITES --value True
rucio-admin --account=root rse set-attribute --rse RAL-PP --key RAL-PP --value True

rucio-admin --account=root account set-limits dunepro RAL-PP 200TB

For adding the distance, I just set the follows temporarily:

rucio list-rses --expression "EUROPEAN_SITES_LARGE" | while read rse
do
  rucio-admin --account=root rse add-distance --distance 1 --ranking 1 $rse RAL-PP
done

rucio list-rses --expression "site=CERN" | while read rse
do
  rucio-admin --account=root rse add-distance --distance 2 --ranking 2 $rse RAL-PP
done

rucio list-rses --expression "site=FNAL" | while read rse
do
  rucio-admin --account=root rse add-distance --distance 3 --ranking 3 $rse RAL-PP
done
StevenCTimm commented 4 years ago

Thanks Wenlong we can close this issue.