Direct additional import jobs to use separate queue

[bkiahstroud]

Story

Sister ticket:

• scientist-softserv/adventist_knapsack#200

A very large OAI ingest is currently running, however, Katharine has separate imports that she would like to get into the site, while this is happening. It was proposed that a separate 'queue' be enabled for her additional imports, so they do not have to wait for the large ingest to complete before running.

All jobs created by additional imports (i.e. imports other than the primary OAI ingests) should be run in the separate GoodJob queue that will be set up in scientist-softserv/adventist_knapsack#200. This applies to all Bulkrax and Hyrax jobs.

Acceptance Criteria

• [ ] TODO (@laritakr will fill this in depending on the client's requirements)

Implementation Suggestions

Depending on the specifics on the Acceptance Criteria, there are several potential options for implementation:

• Configure GoodJob to send all jobs created in certain tenants to the new queue
• Reassign created jobs to new queue conditionally
  • GoodJob may not support reassigning already-created jobs¹
• Add conditional logic to ApplicationJob

¹ "Reassigning" can still be accomplished by creating a new job with the same arguments in a different queue. An example of this can be found in pals.

[bkiahstroud]

Needs Rework

Importers fail to create / run. Need to re-deploy to troubleshoot why

[jillpe]

Helpful Threads:

• https://assaydepot.slack.com/archives/C0311DN2YCA/p1708978960859479?thread_ts=1708720467.296219&cid=C0311DN2YCA
• https://assaydepot.slack.com/archives/C0311DN2YCA/p1709144299148609
• https://assaydepot.slack.com/archives/C0313NK4SMS/p1709305532757489