search

DUNE / dist-comp

Action items for DUNE distributed computing, and common scripts that are used.
2 stars 0 forks source link

DUNE specific info into DUNE CRIC #10

Closed Andrew-McNab-UK closed 3 years ago

Andrew-McNab-UK commented 4 years ago

Plan for this is to create a script to take the OSG Factory XML and input it to CRIC, with help from the CRIC developers about the APIs to load extra info into the CRIC database. Then adapt an existing VO Feed script to publish this in a form suitable for the DUNE ETF. Most of the CE and SE information is already there, but having our own scripts lets us add the DUNE site name etc.

This lets us see the whole cycle of deciding a flow of information, negotiating with the CRIC developers, creating/modifying a script, testing it, and deploying it on the CRIC service operated by the developers.

Andrew-McNab-UK commented 4 years ago

https://dune-cric.cern.ch/core/experimentsite/list/ now has a list of sites supporting DUNE for compute, taken from the OSG pilot factory configuration in GitHub. The Experiment Site Name uses GLIDEIN_DUNESite where available, defaulting to GLIDEIN_Site otherwise (ie the old GLIDEIN names like London for Imperial College London, which has GLIDEIN_DUNESite = UK_Imperial-HEP)

Andrew-McNab-UK commented 4 years ago

I've made a PR in the OSG factory GitHub repo with their agreement listing the DUNESite names and adding BR for CPBF. https://github.com/opensciencegrid/osg-gfactory/pull/6

This will lead to DUNESite names appearing for all sites on the above experiment sites list in CRIC.

Andrew-McNab-UK commented 3 years ago

The VO feed has been available since last week. I've updated the CRIC page in the wiki. There are a few cosmetic improvements (eg removing empty attributes) which are deployed on the dev instance but not yet merged and deployed on the pro instance.

https://dune-cric.cern.ch/api/dune/vofeed/list/

https://wiki.dunescience.org/wiki/CRIC

Andrew-McNab-UK commented 3 years ago

Above improvements have been deployed.