pulibrary / dpul

Princeton's digital collections: Digital PUL
https://dpul.princeton.edu/
Apache License 2.0
15 stars 0 forks source link

Retry resource enqueues up to 5 times #1530

Closed hackartisan closed 2 months ago

hackartisan commented 2 months ago

advances pulibrary/figgy#6329 (close once reindex is done)

supercedes #1529 -- I thought I could push the valid? check down the stack, but the job won't run if the resource hasn't persisted, and failed validation can keep a resource from persisting. I didn't want to rewrite the reindex jobs to take a url instead of a resource, so this PR still proposes recording the job as a failure, after some retries. It also sends more details to honeybadger.

hackartisan commented 2 months ago

Ran this on staging and it got all the records in that were listed on that ticket.