datacite / lupo

DataCite REST API
https://api.datacite.org
MIT License
12 stars 8 forks source link

Move index jobs for dois to their own queue. #1262

Closed richardhallett closed 1 month ago

richardhallett commented 1 month ago

Adds new specific import job which uses new queue.

Purpose

DOI Indexing for newly registered dois get put on same queue as other indexing jobs for say events. When we are overloaded with event based indexing this causes regular doi indexing to be slowed down.

Approach

Adds a new import worker to use new queue. Note new queue has already been created via infrastructure code see: https://github.com/datacite/mastino/commit/8d194aa9032af69c2ba2fe8728dee607190975d1

I think long term this needs tidying up more but this is easy change to make.

Open Questions and Pre-Merge TODOs

Learning

Types of changes

Reviewer, please remember our guidelines:

sentry-io[bot] commented 1 month ago

Suspect Issues

This pull request was deployed and Sentry observed the following issues:

Did you find this useful? React with a 👍 or 👎