search

scientist-softserv / utk-hyku

Other
6 stars 0 forks source link

Some Importers "Completing" while Items are still Pending #617

Open markpbaggett opened 5 months ago

markpbaggett commented 5 months ago

Story

Rarely, an importer will run and complete but the items within still have a status of pending. Here is an example.

https://dc.utk-hyku-production.notch8.cloud/importers/397

When this happens, we don't see jobs queued or scheduled in Good Jobs. While there are some quality of life things that would be nice to have, we really just want to know what to do when this happens. Should we rerun the importer against pending items, and if so, should we remove and rebuild?

Acceptance Criteria

Screenshots / Video

import_397_pending_first_30

Testing Instructions and Sample Files

-

Notes

orangewolf commented 4 months ago

these pending ones have not been run. they dont need to be removed / redone because nothing was created for them. We mark them pending explicitly now instead of implicitly like we did before Skip was introduced. That caused me some confusion when we discussed this. What I don't understand is there is no record of the actual job running and doing anything. These can just be run, but if I could get a ping right away the next time we see this I'll jump on it and check the logs (I have about 15 days of logs that are easily accessible)

markpbaggett commented 4 months ago

👍