search

scientist-softserv / adventist_knapsack

Apache License 2.0
1 stars 0 forks source link

Importers not updating post-Knapsack #172

Closed KatharineV closed 1 month ago

KatharineV commented 2 months ago

Earlier this week, I started two imports on ADL prod to test Knapsack. I found metadata errors in the CSVs, so I edited and resubmitted the imports on 4/17. The "last run" dates haven't updated and the metadata hasn't updated, so it appears that the importers have no rerun as expected. I did see confirmation messages after I submitted updates, and I also see the new CSV files are attached in the Import file path field of the Edit Importer screen. However, the new CSV hasn't run, and the delay is fully 24 hours now. I expect the importer to edit and rerun much more quickly. Ideally, it should be within an hour or two (if not faster, in an idea environment), since the edit only updated metadata, not files.

The importers that have not updated with the newly attached CSVs: https://adl.b2.adventistdigitallibrary.org/importers/309?locale=en https://adl.b2.adventistdigitallibrary.org/importers/310?locale=en (this one, in fact, is stuck pending and has been since it first ran)

KatharineV commented 2 months ago

May be related to scientist-softserv/adventist_knapsack#170 ?

ShanaLMoore commented 2 months ago

refer to comment on 757

KatharineV commented 1 month ago

These importers have run and the metadata is updated, so I'll move this to the Done column. I assume that any importer to update metadata would work equally as well now, post-Knapsack. However, we're back to the major migration of adl:issue from OAI, so I know the workers are swamped. I won't be testing further in production.