usnistgov / oar-pdr

The NIST Open Access to Research (OAR) Public Data Repository (PDR) system software
11 stars 10 forks source link

Support restricted public access in publishing workflow #229

Closed RayPlante closed 2 years ago

RayPlante commented 2 years ago

This PR addresses ODD-992 that updates the publishing system to support special processing of SIPs featuring restricted public access. SIPs from MIDAS are recognized as providing data under restricted public access when the POD includes files and an accessURL that points to the new Salesforce-connected Restricted Access Gateway; upon recognition, several bits of metadata are automatically attached to the record that are ultimately used by the Salesforce gateway. It also applies two bits of specialized handling upon preservation and ingest: the preservation bag files are sent to a special storage directory to be stored separately from the public data, and the file components are removed from the NERDm record sent to the ingest service.

RayPlante commented 2 years ago

This was tested on datapubtest with MIDAS; skipping review.

Note that the corresponding MIDAS update is tabled until January. We can still release our part; it will just go unused.