DUNE / dist-comp

Action items for DUNE distributed computing, and common scripts that are used.
2 stars 0 forks source link

Access to FNAL dCache REST API end points from outside FNAL? #27

Closed Andrew-McNab-UK closed 1 year ago

Andrew-McNab-UK commented 2 years ago

This does not seem to be possible and yet is necessary to apply pins and check on their progress, or even that a file is ONLINE or not.

At FNAL, a connection is allowed but elsewhere the connection is refused:

echo | openssl s_client -connect fndca.fnal.gov:3880

StevenCTimm commented 2 years ago

I have made a query to the dCache developers about getting some documentation for this API and understanding what can/should be done.

Andrew-McNab-UK commented 2 years ago

I've been using Paul Millar's talk here:

https://indico.cern.ch/event/1006673/contributions/4225445/attachments/2188118/3697487/bulk-request.pdf

which has a link to this more detailed document, which was enough get it working with requesting pins with lifetimes and checking that they have become available (but only from FNAL):

https://docs.google.com/document/d/14sdrRmJts5JYBFKSvedKCxT1tcrWtWchR-PJhxdunT8/

StevenCTimm commented 2 years ago

OK I have talked to Dmitry..To open this port to off-site they would have to go through site computer security and request a web exemption, which they are willing to do. I guess what I am missing is the bigger picture of the file delivery workflow in the workflow allocator system.. what files are you pinning, and when. Would like to understand the bigger picture and how it compares to what the data dispatcher is doing. (guessing that that is using a legacy interface to dCache to do the staging).

StevenCTimm commented 2 years ago

Request has been filed https://fermi.servicenowservices.com/nav_to.do?uri=%2Fsc_req_item.do%3Fsys_id%3D89b86e6adbdb0d1014c35425f39619a3%26sysparm_view%3Dess%26sysparm_record_target%3Dsc_req_item%26sysparm_record_row%3D12%26sysparm_record_rows%3D13%26sysparm_record_list%3Dactive%253Dtrue%255Erequest.requested_forDYNAMIC107a23f36f9c394032544d1fde3ee43b%255Erequest.requested_for%253D32b4c7270a0a3c590054cb9fd2a1c689%255EORrequest.requested_for.manager%253D32b4c7270a0a3c590054cb9fd2a1c689%255EORcat_item%2521%253D0366e9a11b3ae01084150e9ee54bcb86%255Eu_security_related%253Dfalse%255EORwatch_listCONTAINS32b4c7270a0a3c590054cb9fd2a1c689%255EORDERBYopened_by

RITM1401000

StevenCTimm commented 1 year ago

A new port was put up especially for off-site access and it is working.