It appears that was-registrar-app is setting rights to "dark" when registering objects. As a result, crawl data isn't getting shelved properly now that we are enforcing the requirement that "dark" = "shelve=no".
If was-registrar-app registers as "citation" then crawls will get shelved properly. I've verified this by manually reaccessioning https://argo.stanford.edu/view/druid:pv053zw7687 which is a set of WARCs that came through recently and were not shelved the first time.
I think the goal of having the rights set to dark was to prevent downloading the WARCs themselves. Setting the rights to citation meets this goal, plus the was-robots set "publish=no" so the files are never listed on the resulting purl.
justinlittman
commented
2 years ago
It appears that was-registrar-app is setting rights to "dark" when registering objects. As a result, crawl data isn't getting shelved properly now that we are enforcing the requirement that "dark" = "shelve=no".
If was-registrar-app registers as "citation" then crawls will get shelved properly. I've verified this by manually reaccessioning https://argo.stanford.edu/view/druid:pv053zw7687 which is a set of WARCs that came through recently and were not shelved the first time.
I think the goal of having the rights set to dark was to prevent downloading the WARCs themselves. Setting the rights to citation meets this goal, plus the was-robots set "publish=no" so the files are never listed on the resulting purl.