search

scientist-softserv / louisville-hyku

Other
0 stars 0 forks source link

[3] LDP errors on bulkrax - staging #77

Closed orangewolf closed 1 year ago

orangewolf commented 1 year ago

As of 2/3 - all csv imports fail on staging due to LDP errors

dev note: consider increasing pool timeout in fedora config ( == staging ops fedora.yml)

orangewolf commented 1 year ago

Shana January 2022

dev note: increase pool timeout in fedora config

orangewolf commented 1 year ago

Summer February 2022

How do we test this?

orangewolf commented 1 year ago

Summer February 2022

I just tried to create & import the Cardinal Text file as I was QAing #32

All the works failed with Ldp::NotFound errors. Is this the same as what this ticket is about? If so, I will push it back to ready for dev.I just tried to create & import the Cardinal Text file as I was QAing #32 (closed) All the works failed with Ldp::NotFound errors. Is this the same as what this ticket is about? If so, I will push it back to ready for dev.

Image

orangewolf commented 1 year ago

Shana February 2022

Notes from pairing with April:

This is not happening locally. This was not happening on staging yesterday.

Is this because the fedora path is hardcoding "single" in its path? Where and how does this happen?

Error from single.lv-hyku

Image

Error from lv-hyku

Image

orangewolf commented 1 year ago

Shana February 2022

This issue has been resolved.

Summer,

For now, please retest using zipped csv as the files on the server is still WIP.

orangewolf commented 1 year ago

Rachel February 2022

As I recall, I provided the PDF in the file field for the Cardinal newspaper (and as the file), not the image files at the page level. So it may be a legitimate LDP error because there is no 19261001_2 etc. file - just a 19261001.pdf that covers all of the pages.

orangewolf commented 1 year ago

Alisha March 2022

@rachel.howard can you retest this?@rachel.howard can you retest this?

orangewolf commented 1 year ago

Rachel March 2022

Is staging back up? I was waiting for the go-ahead from Shana.

orangewolf commented 1 year ago

Alisha May 2022

sorry that I never responded to this. yes, please test this again on staging.

orangewolf commented 1 year ago

Rachel May 2022

Retested several hours ago. No LDP errors but thumbnails/viewer images still aren't appearing.

orangewolf commented 1 year ago

Alisha May 2022

hmm, sounds like that may be a different problem. before creating a separate ticket to track that, I'd like to verify it's a new/different problem though.

is it a specific import and/or parent that isn't showing the child images? if the first child doesn't have an image attached I don't expect the parent to have a thumbnail either. can you try to replicate this on staging so that we have some code/logs/errors that we can look into?

orangewolf commented 1 year ago

Rachel May 2022

It's the Louisville Cardinal Newspapers collection on staging (https://lv-hyku-staging.notch8.cloud/collections/fbc441a3-ac7c-4efb-a92e-84ef69bf52da?locale=en). I realized today that the sample set had incomplete information in the parents field, which may have caused the issue yesterday. I reimported it today and it's still pending, possibly because it had to create JPEGs from the PDF and run the OCR etc.

orangewolf commented 1 year ago

Alisha May 2022

@rachel.howard can you send me that zip file that you used?@rachel.howard can you send me that zip file that you used?

also, is there a reason you used a zip file opposed to a folder that contained the csv and a "files" folder?

orangewolf commented 1 year ago

Rachel May 2022

Here it is! Since the links Randy set up to make accessible to your staging server have been deleted on your end, I have to test on staging with Zip files.

Rachel

Cardinal_Text.zip

orangewolf commented 1 year ago

Alisha May 2022

thanks! looks like this is a different issue altogether. it's unrelated ot the jdp errors that this ticket was created for.

after viewing the zip, I see there are 2 pdf's attached. sounds like the pdf isn't being converted into jpg derivatives anymore. (doesn't appear related to #109)

I created #116 to work and track this issue.thanks! looks like this is a different issue altogether. it's unrelated ot the jdp errors that this ticket was created for. after viewing the zip, I see there are 2 pdf's attached. sounds like the pdf isn't being converted into jpg derivatives anymore. (doesn't appear related to #109 (closed)) I created #116 (closed) to work and track this issue.

orangewolf commented 1 year ago

Rachel May 2022

Agree that it's a different issue so will close this one.