articles in Error state

ErnestaP commented 4 months ago

More than 62 articles are in error state with an error message: IOError: [Errno 2] No such file or directory: u'/data/files/93/04/d395-85d9-498b-9dbc-86d3b77e5f72/data' I checked a few articles, and it seems that they were harvested around 2021-06, and we are receiving updates from time to ti time. Update with PDFA files we received in 2021-07-23 (vtex00490082_a-2b). After that, we did not receive these articles' updates until now.

2024-01-26 we received the updates, however without PDFAs.

[x] Clean workflows: Restart these workflows in ERROR state
[x] Check do we have the data in EOS,
[x] I̶F̶ ̶Y̶E̶S̶,̶ ̶c̶o̶p̶y̶ ̶t̶h̶e̶ ̶m̶i̶s̶s̶i̶n̶g̶ ̶f̶i̶l̶e̶s̶ ̶t̶o̶ ̶t̶h̶e̶ ̶c̶u̶r̶r̶e̶n̶t̶ ̶f̶i̶l̶e̶s̶ ̶s̶y̶s̶t̶e̶m̶
[x] IF NO, locally reharvest zip folder which has pdfas ((vtex00490082_a-2b), verify do the files are in the location. After, locally re-harvest the update (CERNJ000000009969) for the records, the path after update, changes. For examples: ERROR: https://repo.scoap3.org/admin/workflow/details/?url=%2Fadmin%2Fworkflow%2F%3Fflt0_21%3D3&id=8aeea74c-bc4f-11ee-a328-42eccb3f995a path: /data/files/6c/42/35ad-4f39-48b1-8f7e-63aa95f5ce95/data

UPDATED JUST WITH PDFAs from ZIP: https://repo.scoap3.org/admin/workflow/details/?url=%2Fadmin%2Fworkflow%2F&id=aa449c30-beb3-11ee-ac69-4ee990e29a75 path: /data/files/2f/83/3b11-db6d-49a1-a0b1-571460014e34/data

full list of missing pdfa's (the ones that we know from ERROR messages)

{u'/data/files/03/0f/c88a-74b1-467f-b299-d05a52239b39/data',
 u'/data/files/04/a1/c361-f347-498e-906f-ed54f465e269/data',
 u'/data/files/06/c9/68d0-b37c-4835-b044-ab5ea5d36a3e/data',
 u'/data/files/0e/d6/b28b-f8e1-47a1-93a3-e8af43d322e9/data',
 u'/data/files/0f/09/32a4-ca6a-4f2b-ad5a-d52be5c85b84/data',
 u'/data/files/0f/0c/3cbd-cacd-46dc-b20a-2b20808805c3/data',
 u'/data/files/17/8f/9d81-89d4-438c-942c-a17ef2610051/data',
 u'/data/files/18/61/041f-1e96-4125-8f22-b726e60a19c7/data',
 u'/data/files/1a/90/dcc0-577a-41fc-86c6-4ad2349d18bb/data',
 u'/data/files/22/17/a33c-b1d5-471b-a524-26462b569d5b/data',
 u'/data/files/2d/09/4348-ee68-4cd3-9c02-0187a86d1138/data',
 u'/data/files/2e/83/e827-18d4-49f6-a947-9c80a5b79739/data',
 u'/data/files/2e/cf/0974-6e6c-415a-abf9-178ef0484b68/data',
 u'/data/files/31/84/e835-5f33-4673-965d-97dfdabe3203/data',
 u'/data/files/31/fe/cf66-3378-475e-9714-795f364c1ea0/data',
 u'/data/files/33/1f/a1ee-6bc1-45be-823f-17f1de16e7ad/data',
 u'/data/files/39/28/38ee-3c0e-47a4-bdf9-fae545bb9832/data',
 u'/data/files/3c/8d/2d41-c52e-4865-9a67-82d2a04b7072/data',
 u'/data/files/54/8a/4d76-3548-4ae2-947c-a026b9a2b631/data',
 u'/data/files/55/70/56ec-fe22-4bc2-9183-c739f5519bbf/data',
 u'/data/files/59/dd/1642-6a7f-4933-af27-b22343c563a5/data',
 u'/data/files/5d/73/87c5-79ef-484c-aed7-66cc4fd6a750/data',
 u'/data/files/68/03/a823-bcd0-45ee-a11f-5a04299638ef/data',
 u'/data/files/69/8d/7c9e-4636-4ecb-895d-21acbabfca61/data',
 u'/data/files/6b/cf/9612-c0d6-4833-832d-6b6aa745f0bf/data',
 u'/data/files/6c/42/35ad-4f39-48b1-8f7e-63aa95f5ce95/data',
 u'/data/files/6f/d4/5122-1587-4e07-8cd2-3b589dcbebc7/data',
 u'/data/files/71/7f/d0a7-9d7e-463f-9379-4f8e487c8a01/data',
 u'/data/files/74/a6/1e3a-9a8b-4ec2-8ca5-516913df81ae/data',
 u'/data/files/76/81/d36d-ecbb-476b-9033-2d70ae170c19/data',
 u'/data/files/77/2d/03b8-09c3-4c02-bb8d-d81d51099a69/data',
 u'/data/files/7a/d8/8c86-aafc-4b66-a092-ea8157a43b48/data',
 u'/data/files/80/20/7640-b46e-4f4c-8cb4-1b3d1513ffdf/data',
 u'/data/files/86/8b/2c60-9f68-48dd-aec0-c311eeb44722/data',
 u'/data/files/86/f7/d29c-26d8-4581-916e-c7587b737a29/data',
 u'/data/files/89/a5/1342-e3f7-4679-bf7d-4d6b1e1ce455/data',
 u'/data/files/8a/4f/76e9-e1ce-4e29-b9b1-c7678cec1da8/data',
 u'/data/files/90/e8/df2e-7c6c-45d9-a157-a647d67a3e09/data',
 u'/data/files/93/04/d395-85d9-498b-9dbc-86d3b77e5f72/data',
 u'/data/files/94/ab/0fea-12cf-4a6c-a0a5-64064d356858/data',
 u'/data/files/98/fb/466d-e07e-484b-86da-39ba53dc6b59/data',
 u'/data/files/b5/9a/1c4d-6674-4bd7-b417-9d0d43ae0d53/data',
 u'/data/files/b8/02/819d-cea2-4ba1-8599-7096045419b6/data',
 u'/data/files/b9/8e/ed09-76f4-48ab-8596-8adae5fa59d2/data',
 u'/data/files/be/ef/a442-23b6-46b6-a8ed-5615f85847b5/data',
 u'/data/files/c9/e0/7334-9dff-44be-ba34-f2c584c33094/data',
 u'/data/files/cc/99/a898-f56c-484a-9169-5532392699db/data',
 u'/data/files/cf/13/2f81-671f-4e84-bb88-9339563cf80b/data',
 u'/data/files/d4/40/65a0-7cfd-4e14-896b-8f0473ac4ed2/data',
 u'/data/files/d4/d2/eceb-298b-407b-8f04-78bcca0dcb31/data',
 u'/data/files/d6/5b/543f-f330-4350-b8bd-af7b5defecd2/data',
 u'/data/files/d9/e0/e241-ae8b-4d84-9a99-271f32c4c64e/data',
 u'/data/files/dd/05/7b65-3f83-4577-9240-9c29459741e7/data',
 u'/data/files/dd/26/3ebc-19a0-44e4-841c-a6e25af241eb/data',
 u'/data/files/de/2f/53bf-dbde-4479-b7f1-0e68b5edcab6/data',
 u'/data/files/df/b9/1ea3-6f57-4ce1-bb23-b80c04dbc063/data',
 u'/data/files/e0/ce/6a75-6ef4-4c00-94ed-00e2ab0b8ab4/data',
 u'/data/files/e1/c4/2fb6-9cd1-4fcf-aa35-548a7185edfd/data',
 u'/data/files/e4/af/8195-a1d0-4bb3-9f49-3c25ff9ae781/data',
 u'/data/files/e9/66/ddc7-de17-4b6e-a579-7311ba5cd53b/data',
 u'/data/files/f1/dd/172e-86d1-4c90-8b43-c4fc95816f06/data',
 u'/data/files/fc/c4/580b-a32f-4c3f-b5ed-76bf5ff24903/data'}

ErnestaP commented 4 months ago

Ben confirmed that none of them are in EOS

ErnestaP commented 4 months ago

the location of files changed, but the update worked

cern-sis / issues-scoap3

articles in Error state #290