search

DUNE / dist-comp

Action items for DUNE distributed computing, and common scripts that are used.
2 stars 0 forks source link

Enable the pinning feature of justIN so that we can read files directly from FNAL_DCACHE #132

Open StevenCTimm opened 4 months ago

StevenCTimm commented 4 months ago

JustIN at one point had a pinning feature for FNAL_DCACHE which is currently disabled. Please re-enable this. FNAL_DCACHE now supports the WLCG bring-online mechanism which it did not previously, which may simplify the coding.

Steve Timm

Andrew-McNab-UK commented 4 months ago

I had a look at this again during the FIFE meeting where it came up in the dCache update.

The v1 spec on the Twiki page explains it advertises the endpoint using the well-known mechanism, and it should be possible to discover the initial WebDAV URL to start with from what's in Rucio. I'll try to implement that discovery process rather than hard code everything as before. Where there is enough disk in front of the tape, this might make the justin-finder-fnal agent usable for other sites and I'll rename it to something else: like justin-finder-tape

The new API is quite close to the bulk API justin-finder-fnal used before.