search

DUNE / data-mgmt-ops

3 stars 3 forks source link

Commission the new CCIN2P3 cache-based Rucio element #219

Closed StevenCTimm closed 1 year ago

StevenCTimm commented 2 years ago

As a general rule at CC-IN2P3, only one storage technology is provided to one given experiment (either XRootD or dCache but not both). And CC-IN2P3 has a preference for dCache.

By the way, we noticed, from FTS3 logs, that an obsolete endpoint, namely root://ccdcacli235.in2p3.fr:1094 is still in use. Could you please update that endpoint to root://ccxrootdegee.in2p3.fr:1094 ?

In summary, depending on the protocol, the dCache endpoints to be used are : https://ccdavegee.in2p3.fr:2880/dune root://ccxrootdegee.in2p3.fr:1094

Once you solve the issues with staging from tape at Fermilab, you can test writing to dCache and let us know of any problem.

Best regards Rachid and Elisabetta

wyuan-uoe commented 2 years ago

I tested the endpoints, https works fine, xrootd directly transfers can work, xrootd tpc has some Authentication problem.

I re-configed the current DUNE_FR_CCIN2P3 RSE, amended the settings: deterministic: True, availability_read: True, availability_write: True, availability_delete True, and amended the protocols as well. I disabled xrootd tpc since we use https tpc for most instance.

rucio upload works fine for both https and root.

Settings:
=========
  availability_delete: True
  availability_read: True
  availability_write: True
  credentials: None
  delete_protocol: 1
  deterministic: True
  domain: ['lan', 'wan']
  id: 7032f00ca1fb4d29a0ed25db9c2b534e
  lfn2pfn_algorithm: hash
  qos_class: None
  read_protocol: 1
  rse: DUNE_FR_CCIN2P3
  rse_type: DISK
  sign_url: None
  staging_area: False
  third_party_copy_protocol: 1
  verify_checksum: True
  volatile: False
  write_protocol: 1
Attributes:
===========
  DUNE_FR_CCIN2P3: True
  country: FR
  fts: https://fts3-public.cern.ch:8446
  site: DUNE_FR_CCIN2P3
Protocols:
==========
  https
    domains: '{"lan": {"read": 0, "write": 0, "delete": 0}, "wan": {"read": 1, "write": 1, "delete": 1, "third_party_copy": 1}}'
    extended_attributes: None
    hostname: ccdavegee.in2p3.fr
    impl: rucio.rse.protocols.gfalv2.Default
    port: 2880
    prefix: /dune
    scheme: https
  root
    domains: '{"lan": {"read": 0, "write": 0, "delete": 0}, "wan": {"read": 1, "write": 1, "delete": 1, "third_party_copy": 0}}'
    extended_attributes: None
    hostname: ccxrootdegee.in2p3.fr
    impl: rucio.rse.protocols.gfalv2.Default
    port: 1094
    prefix: /pnfs/in2p3.fr/data/dune
    scheme: root
StevenCTimm commented 1 year ago

This is done, closing