scientist-softserv / adventist_knapsack

Apache License 2.0
2 stars 0 forks source link

Investigate why 20 collections did not delete (and delete them). #362

Open jillpe opened 1 year ago

jillpe commented 1 year ago

The following 20 collections did not delete via the jobs. Deleting via the UI appears to time out.

This may have to do with a combination of the large number of members and the slug logic.

["2487c594-1026-4a91-9ede-6105d5626a41", "67911ae1-8a26-4309-ba89-aca81c2fe3be", "4b298df0-9147-4990-a08d-0f53cbc90ed6", "be482035-fe21-4be0-9704-c422618b4525", "0c0444c4-9642-447d-b912-ae7de4163342", "a68b1cff-47c7-4f4d-9e1c-70c05ba48512", "608cca3c-9780-4842-b5f4-79bfcea8eb02", "36e07892-4167-4cb1-b0a8-986cfd1edbd6", "0b10fed9-51dd-48dd-89e1-dd990e94e1fc", "254bd824-7e53-400b-a74c-189043e02db8", "36b2f7ec-8750-482c-842c-bf02462fbf5b", "280c499e-7026-4427-b41b-1f594978cbf4", "2be7ac3e-786c-42f5-932b-180ac8ec5fee", "a5df1cbc-33eb-4120-ad93-b9d930a26dc7", "c1f28f13-0a97-42fe-b98e-52b14e26194c", "8647cc37-8434-4d9a-bb66-0d898715c264", "d44b5783-e949-40dd-b7fb-d1ed13cafc5f", "ac2a2de7-6aad-45f5-ab9f-0e7afb345855", "63daa10f-0ffa-4566-913c-f35eef9e077d", "07f8dbf8-06f2-472e-b11b-5efa21451e13"]
laritakr commented 1 year ago

The job was run, but collections appear basically the same... unsure if ANY members were removed. Removal via the UI reports successful but no changes happen.

The list of collections is as follows:

2487c594-1026-4a91-9ede-6105d5626a41 https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/2487c594-1026-4a91-9ede-6105d5626a41?locale=en Genre:sdapi 436552 members

67911ae1-8a26-4309-ba89-aca81c2fe3be https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/67911ae1-8a26-4309-ba89-aca81c2fe3be?locale=en Genre:sdaoi 198135 members

4b298df0-9147-4990-a08d-0f53cbc90ed6 https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/4b298df0-9147-4990-a08d-0f53cbc90ed6?locale=en Adventist Review 14835 members

be482035-fe21-4be0-9704-c422618b4525 https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/be482035-fe21-4be0-9704-c422618b4525?locale=en Record (South Pacific Division) 22974 members

0c0444c4-9642-447d-b912-ae7de4163342 https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/0c0444c4-9642-447d-b912-ae7de4163342 Southwestern Union Record 23701 members

a68b1cff-47c7-4f4d-9e1c-70c05ba48512 https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/a68b1cff-47c7-4f4d-9e1c-70c05ba48512?locale=en Adventist Review - 14989 members

608cca3c-9780-4842-b5f4-79bfcea8eb02 https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/608cca3c-9780-4842-b5f4-79bfcea8eb02 
Guide 16399 members

36e07892-4167-4cb1-b0a8-986cfd1edbd6 https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/36e07892-4167-4cb1-b0a8-986cfd1edbd6 Messenger (British Union Conference) 14285 members

0b10fed9-51dd-48dd-89e1-dd990e94e1fc https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/0b10fed9-51dd-48dd-89e1-dd990e94e1fc Atlantic Union Gleaner 16160 records

254bd824-7e53-400b-a74c-189043e02db8 https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/254bd824-7e53-400b-a74c-189043e02db8 Canadian Adventist Messenger 11994 members

36b2f7ec-8750-482c-842c-bf02462fbf5b https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/36b2f7ec-8750-482c-842c-bf02462fbf5b Southern Tidings 24975 members

280c499e-7026-4427-b41b-1f594978cbf4 https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/280c499e-7026-4427-b41b-1f594978cbf4 Pacific Union Recorder 54843 members

2be7ac3e-786c-42f5-932b-180ac8ec5fee https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/2be7ac3e-786c-42f5-932b-180ac8ec5fee Outlook (Mid America Union) 13809 members

a5df1cbc-33eb-4120-ad93-b9d930a26dc7 https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/a5df1cbc-33eb-4120-ad93-b9d930a26dc7 North Pacific Union Gleaner 40612 members

c1f28f13-0a97-42fe-b98e-52b14e26194c https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/c1f28f13-0a97-42fe-b98e-52b14e26194c Columbia Union Visitor 13330 members

8647cc37-8434-4d9a-bb66-0d898715c264 https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/8647cc37-8434-4d9a-bb66-0d898715c264 Columbia Union Visitor 13021 members

d44b5783-e949-40dd-b7fb-d1ed13cafc5f https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/d44b5783-e949-40dd-b7fb-d1ed13cafc5f Australasian Record 22263 members

ac2a2de7-6aad-45f5-ab9f-0e7afb345855 https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/ac2a2de7-6aad-45f5-ab9f-0e7afb345855 Advent Review and Sabbath Herald 111865 members

63daa10f-0ffa-4566-913c-f35eef9e077d https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/63daa10f-0ffa-4566-913c-f35eef9e077d Insight 11864 members

07f8dbf8-06f2-472e-b11b-5efa21451e13 https://sdapi.b2.adventistdigitallibrary.org/dashboard/collections/07f8dbf8-06f2-472e-b11b-5efa21451e13 Lake Union Herald 22677 members

laritakr commented 1 year ago

In Rancher, I removed all collections from a work. Command ended with "true, and members appear to be gone.

irb(main):019:0> wk.member_of_collections
=> []
irb(main):020:0> wk
=> #<JournalArticle id: "9955bdb6-e442-4137-ada5-6fa618088ec7", head: [], tail: [], depositor: "eric@infogetics.com", title: ["\"I'm not baptized\""], date_uploaded: "2022-01-06 0behalf_of: nil, arkivo_checksum: nil, owner: nil, bibliographic_citation: ["Case, Stephen W, \"I'm not baptized\",\" Insight, 48 (Mar 18 2017): 7."], date_issued: ["2017-03-18"], lat: [], long: [], alt: [], place_of_publication: [], remote_url: [], aark_id: "13907754", slug: "13907754__i_m_not_baptized", slug_for_upgrade: "13907754__i_m_not_baptized", abstract: [], date_available: [], date_published: [], date_submitted: [], date_accepted: [], issue_number: [], managing_organisation: [], official_url: [], orcid: [], pagination: [], part_of: ["Insight"], publication_status: [], refereed: [], volume_number: [], preflabel: nil, altlabel: [], rdfs_label: nil, rights_holder: [], rights_statement: [], rights_description: [], license: [], creator: ["Case, Stephen W"], contributor: [], date: ["2017-Mar-18"], date_created: ["2017-Mar-18"], department: [], description: ["First appeared : Insight : 2002, v33, Mar 23. Insight."], funder: [], identifier: ["3907754", "13907754"], keyword: [], language_code: [], language: [], output_of: [], publisher: [], resource_type: ["Article"], source: ["Seventh-day Adventist Periodical Index"], subject: ["Baptism", "Salvation", "Youth", "Q and A"], doi: [], location: [], related_url: [], note: [], former_identifier: [], based_near: [], label: nil, relative_path: nil, import_url: nil, is_child: nil, packaged_by_ids: [], access_control_id: "77ef8bcd-7d61-4368-8b61-13d6b2cc9687", representative_id: nil, thumbnail_id: nil, rendering_ids: [], admin_set_id: "admin_set/default", embargo_id: nil, lease_id: nil, output_of_resource_ids: []>

Then I reload the work, and this collection remains.

irb(main):022:0> wk.reload
D, [2023-06-26T18:56:40.605252 #5786] DEBUG -- :   Load LDP (79.3ms) http://fcrepo.default.svc.cluster.local:8080/rest/83cdedb7-fb8e-453f-aad1-eb0a1b3d8107/99/55/bd/b6/9955bdb6-e442-4137-ada5-6fa618088ec7 Service: 542960
=> #<JournalArticle id: "9955bdb6-e442-4137-ada5-6fa618088ec7", head: [], tail: [], depositor: "eric@infogetics.com", title: ["\"I'm not baptized\""], date_uploaded: "2022-01-06 07:19:11", date_modified: "2022-01-06 07:19:12", state: #<ActiveTriples::Resource:0x84d78 ID:<http://fedora.info/definitions/1/0/access/ObjState#active>>, proxy_depositor: nil, on_behalf_of: nil, arkivo_checksum: nil, owner: nil, bibliographic_citation: ["Case, Stephen W, \"I'm not baptized\",\" Insight, 48 (Mar 18 2017): 7."], date_issued: ["2017-03-18"], lat: [], long: [], alt: [], place_of_publication: [], remote_url: [], aark_id: "13907754", slug: "13907754__i_m_not_baptized", slug_for_upgrade: "13907754__i_m_not_baptized", abstract: [], date_available: [], date_published: [], date_submitted: [], date_accepted: [], issue_number: [], managing_organisation: [], official_url: [], orcid: [], pagination: [], part_of: ["Insight"], publication_status: [], refereed: [], volume_number: [], preflabel: nil, altlabel: [], rdfs_label: nil, rights_holder: [], rights_statement: [], rights_description: [], license: [], creator: ["Case, Stephen W"], contributor: [], date: ["2017-Mar-18"], date_created: ["2017-Mar-18"], department: [], description: ["First appeared : Insight : 2002, v33, Mar 23. Insight."], funder: [], identifier: ["3907754", "13907754"], keyword: [], language_code: [], language: [], output_of: [], publisher: [], resource_type: ["Article"], source: ["Seventh-day Adventist Periodical Index"], subject: ["Baptism", "Salvation", "Youth", "Q and A"], doi: [], location: [], related_url: [], note: [], former_identifier: [], based_near: [], label: nil, relative_path: nil, import_url: nil, is_child: nil, packaged_by_ids: [], access_control_id: "77ef8bcd-7d61-4368-8b61-13d6b2cc9687", representative_id: nil, thumbnail_id: nil, rendering_ids: [], admin_set_id: "admin_set/default", embargo_id: nil, lease_id: nil, output_of_resource_ids: []>
irb(main):023:0> wk.member_of_collections
D, [2023-06-26T18:56:45.290217 #5786] DEBUG -- :   Load LDP (21.3ms) http://fcrepo.default.svc.cluster.local:8080/rest/83cdedb7-fb8e-453f-aad1-eb0a1b3d8107/24/87/c5/94/2487c594-1026-4a91-9ede-6105d5626a41 Service: 542960
=> [#<Collection id: "2487c594-1026-4a91-9ede-6105d5626a41", depositor: "support@notch8.com", title: ["genre:sdapi"], date_uploaded: nil, date_modified: nil, head: [], tail: [], collection_type_gid: "gid://hyku/hyrax-collectiontype/1", aark_id: nil, slug: nil, slug_for_upgrade: nil, label: nil, relative_path: nil, import_url: nil, remote_url: [], resource_type: [], creator: [], contributor: [], description: [], keyword: [], license: [], rights_statement: [], publisher: [], date_created: [], subject: [], language: [], identifier: ["oai.adventistdigitallibrary.org_genre:sdapi"], based_near: [], related_url: [], bibliographic_citation: [], source: [], abstract: [], date_available: [], date_published: [], date_submitted: [], date_accepted: [], issue_number: [], managing_organisation: [], official_url: [], orcid: [], pagination: [], part_of: [], publication_status: [], refereed: [], volume_number: [], preflabel: nil, altlabel: [], rdfs_label: nil, rights_holder: [], rights_description: [], date: [], department: [], funder: [], language_code: [], output_of: [], doi: [], lat: [], long: [], alt: [], location: [], note: [], former_identifier: [], date_issued: [], place_of_publication: [], access_control_id: "3580b629-1233-4b9a-a947-1203ba56443f", representative_id: nil, thumbnail_id: nil, output_of_resource_ids: []>]
jillpe commented 1 year ago

Prepended each title with deleted, to make them standup. They are also all private, so they only show to admin users.

ShanaLMoore commented 1 year ago

TODO: Pair with Rob to pull db from aws, in order to complete this task.