scientist-softserv / adventist_knapsack

Apache License 2.0
2 stars 0 forks source link

🐛 Bulkrax related_url CSV import doesn't work on staging #746

Open ShanaLMoore opened 1 month ago

ShanaLMoore commented 1 month ago

Summary

Unable to import works with related urls.

Steps to reproduce:

Create a CSV importer for the sample file

Acceptance Criteria

Screenshots or Video

Image

Testing Instructions

Notes

ShanaLMoore commented 1 month ago

basic-advnetist-related-urls-import.csv

ShanaLMoore commented 2 weeks ago

QA RESULTS: ❌

tested on STAGING

sample file: basic-advnetist-related-urls-import(1).csv

something seems wrong. I imported the csv but don't see any updates or evidence that any works got created.

status says pending

I didn't see any import work jobs run in good jobs. I restarted the workers and tried to re run it again. No errors are being displayed.

Image

Image

ShanaLMoore commented 2 weeks ago

Reporting back.

I checked on this again the following day and it seems like I wasn't patient enough the first time. The jobs must've still been enqueue and backlogged. Alas, the importer still failed even though I see works got created.

Image

Image

Image

laritakr commented 2 weeks ago

The problem here is 1) the workers were severely backlogged yesterday (nothing in default queue was going through until overnight) and 2) the CSV has a bad url.

I corrected the CSV and resubmitted your importer: https://demo.s2.adventistdigitallibrary.org/importers/39?locale=en I corrected the CSV, submitted a new import it worked for me. https://demo.s2.adventistdigitallibrary.org/importers/40?locale=en

Both succeeded.

ShanaLMoore commented 2 weeks ago

This looks good to me too. Thanks for clarifying! However, one of them has a pdf and it didn't split. Should it have? I'll make a separate ticket

QA RESULTS: ✅ PASS

Image