[data provider issue] UCR harvesting issues - contacted UCR

[christinklez]

Request to recreate objects (or store them in "do not publish" for the moment)

Registry ID: 85

• [x] This Nuxeo type is SampleCustomPicture but object is a PDF: https://nuxeo.cdlib.org/nuxeo/nxdoc/default/9e9ce94c-31d6-463e-b4ef-993346cf170c/view_documents Request: Create a new object from scratch, as a Text type. Upload PDF. (Okay to retain the ARK.)

Updated on May 22: New object here https://nuxeo.cdlib.org/nuxeo/nxdoc/default/7cb9e861-588c-48dc-8ca7-74d1bfcb4db2/view_documents

• [x] This Nuxeo type is a CustomFile, but object is a TIF: https://nuxeo.cdlib.org/nuxeo/nxdoc/default/12d0ad97-503f-40ea-8c69-5b33064c386a/view_documents
  Options:
  • Create a new object from scratch, as a Picture type. Upload TIF. (Okay to retain the ARK.)
  • Keep this object as a Text. Replace main file with a PDF.

Updated on May 24: The went with the second option, to keep the text doc, and replace the main file with a PDF. (TIF included as a component object.)

Note: If they are unable to review these at the moment, let's ask if they can create “do not publish” and “publish” folders within this collection's folder, and move the objects to their corresponding folders. Please let us know, and we will reharvest from the updated folder.

Project folder clean-up

Registry ID: 27414

• [x] We are now picking up +3 new objects. The new objects are all named “Financial records” have no metadata in Nuxeo. https://nuxeo.cdlib.org/nuxeo/nxdoc/default/161d7615-b56b-4f31-a0e0-06bed87b69a6/view_documents Request: Please review these 3 records. If they are not intended for publication, please create “do not publish” and “publish” folders, and move the objects to their corresponding folders. Please let us know, and we will reharvest from the updated folder.

Update on May 22: They created "published" & "unpublished" folders; updated harvest extra data with the new Nuxeo path.

ARK identifier conflicts

Registry ID: 26531 & 26750 (two records in two different collections share an ARK)

• [ ] ark:/86086/n2gf0sc7 (now picked up by 26750)
  • Published in prod: 26531: https://calisphere.org/item/ark:/86086/n2gf0sc7/
    • https://nuxeo.cdlib.org/nuxeo/nxdoc/default/b2754026-dded-4ee6-b24c-2cf837f3bc00/view_documents
  • Now on stage: 26750: https://calisphere-stage.cdlib.org/item/ark:/86086/n2gf0sc7/
    • https://nuxeo.cdlib.org/nuxeo/nxdoc/default/f11fb2f8-d1b4-48f4-b9a0-3c7f09f6c1cb/view_documents

Update on May 24: The records with ARK conflicts have been moved to "unpublished" folders; UCR will continue to investigate these issues. In the meantime:

• 26750 Nuxeo path updated to: asset-library/UCR/SCUA/Archival/WRCA045/published
• 26531: Records with ARK conflicts have been moved outside, to a separate folder

Registry ID: 26531 & 26758 (two records in two different collections share an ARK)

• [ ] ark:/86086/n20z7294 (now picked up by 26758)
  • Published in prod: 26531: https://calisphere.org/item/ark:/86086/n20z7294/
    • https://nuxeo.cdlib.org/nuxeo/nxdoc/default/a63b4f83-66a8-49da-b9dc-188997e47b19/view_documents
  • Now on stage: 26758: https://calisphere-stage.cdlib.org/item/ark:/86086/n20z7294/
    • https://nuxeo.cdlib.org/nuxeo/nxdoc/default/20b0f07a-5a9a-465c-a8ab-e235f44057cb/view_documents

Update on May 24: The records with ARK conflicts have been moved to "unpublished" folders; UCR will continue to investigate these issues. In the meantime:

• 26758 Nuxeo path updated to: asset-library/UCR/SCUA/Archival/WRCA056/published
• 26531: Records with ARK conflicts have been moved outside, to a separate folder

Registry ID: 26531 (two records within the same collection share an ARK)

Update on May 24: The records with ARK conflicts have been moved to "unpublished" folders; UCR will continue to investigate these issues. In the meantime:

• 26531: Records with ARK conflicts have been moved outside, to a separate folder

• [ ] ark:/86086/n29c6wq0 (prod & stage are the same, but there is a second item in Nuxeo with that same ARK)

  • Prod: https://calisphere.org/item/ark:/86086/n29c6wq0/
  • Stage: https://calisphere-stage.cdlib.org/item/ark:/86086/n29c6wq0/
  • Published in both prod & stage: https://nuxeo.cdlib.org/nuxeo/nxdoc/default/bbe113d7-c9e2-4b5f-b2ae-5e5740ed73e9/view_documents
  • Not published & needs new ARK: https://nuxeo.cdlib.org/nuxeo/nxdoc/default/3198d056-bcca-4913-99bd-ec81e7dfea5f/view_documents

• [ ] ark:/86086/n2pc31pg (prod & stage are the same, but there is a second item in Nuxeo with that same ARK. Note that they also have the same record title, but they do have different PDFs)

  • Published in prod: https://calisphere.org/item/ark:/86086/n2pc31pg/
    • https://nuxeo.cdlib.org/nuxeo/nxdoc/default/a94ceb87-68d4-40ff-9224-af26309ee702/view_documents - possibly needs a title update?
  • New on stage: https://calisphere-stage.cdlib.org/item/ark:/86086/n2pc31pg/
    • https://nuxeo.cdlib.org/nuxeo/nxdoc/default/11110b5b-6839-4382-a874-5016d2d094c4/view_documents

• [ ] ark:/86086/n20g3jcg (prod & stage are the same, but there is a second item in Nuxeo with that same ARK. Note that they also have the same record title, but they do have different PDFs)

  • Prod: https://calisphere.org/item/ark:/86086/n20g3jcg/
  • Stage: https://calisphere-stage.cdlib.org/item/ark:/86086/n20g3jcg/
  • Published in both prod & stage: https://nuxeo.cdlib.org/nuxeo/nxdoc/default/e6b3d1cf-5dde-4ab6-b209-d6b83f398f0f/view_documents - possibly needs a title update?
  • Not published & needs new ARK: https://nuxeo.cdlib.org/nuxeo/nxdoc/default/5d57defa-a780-499f-a93a-04e05f9b8816/view_documents

• [ ] ark:/86086/n2r210kg (prod & stage are the same, but there is a second item in Nuxeo with that same ARK)

  • Prod: https://calisphere.org/item/ark:/86086/n2r210kg/
  • Stage: https://calisphere-stage.cdlib.org/item/ark:/86086/n2r210kg/
  • Published in both prod & stage: https://nuxeo.cdlib.org/nuxeo/nxdoc/default/c4cf5e7e-61d1-4286-b5f7-c304a27425e5/view_documents
  • Not published & needs new ARK: https://nuxeo.cdlib.org/nuxeo/nxdoc/default/02b77209-36fb-4a45-aff3-d66f47edaf6a/view_documents

Thumbnail cropping (just an fyi)

We're getting oddly cropped thumbnails. It may be that the first page is a different size from the other pages in the PDF.

Registry ID: 27470 - FYI (no action requested)

• [ ] https://nuxeo.cdlib.org/nuxeo/nxdoc/default/341b8843-9e8e-4b7b-a485-622eb57fcb5e/view_documents
• [ ] https://nuxeo.cdlib.org/nuxeo/nxdoc/default/a1bf5b95-8fc5-4a4d-a30f-102b12929652/view_documents

Registry ID: 26758 - FYI (no action requested)

• [ ] https://nuxeo.cdlib.org/nuxeo/nxdoc/default/5f6e4931-c381-422f-b967-af5af8ca7ec4/view_documents

Update on May 24: Zoomed with Krystal and Natalie and showed them the weirdly cropped thumbnails. They are okay with this for now, but perhaps we can look at the thumbnailer again post-mvp.

[christinklez]

For project folders & records cleanup: https://help.oac.cdlib.org/a/tickets/138406

For ARK identifiers: https://help.oac.cdlib.org/a/tickets/138407

Did not message about the cropping.

[christinklez]

UCR's notes on their ARK conflict investigation: https://docs.google.com/document/d/1x9_ocEtEQBmXtbKpWBiJFgruF5JbNN2GgyKhTinaiU4/edit#heading=h.6hpd3zl8q867

Discussed on 5/24:

• UCR will move the duplicate ARK records into a separate "unpublished" folder; will conduct investigation from there.
• UCR will let us know when this is done, and we can harvest the collections.
• Also let them know about the thumbnail croppings (as an fyi); discussed this is not a dealbreaker, can return to this thumbnailing post-mvp.

[christinklez]

Collections 85 & 27414: Both collections have both been reharvested. They are done. UCR fixed the Nuxeo doc type/file format issues, and conducted some project folder cleanup.

Collections 26750, 26531, & 26758: All three collections have been reharvested. UCR has moved records with ARK conflicts into a separate "unpublished" folder so they can investigate the issues. They will request reharvesting of these collections once the ARK conflict issues have been resolved.

Collections 27470 & 26758: Shared the fyi about the weird thumbnail cropping. This is not an issue for them. However, we should investigate this post-mvp. See #965 (post-mvp board)