[BUG] Ensure Correct Worker Picks Up Correct Queues

[K8Sewell]

Summary

A Save to S3 job, which is in the default queue, appears to have been picked up by the intensive worker instead of the regular one. The ACCESS_MASTER_MOUNT on prod was s3 for the abandoned Save to S3 job's first run that failed. When re-ran the job succeeded.

Acceptance Criteria

• [ ] Intensive worker does not pick up any jobs on any queues except pdf and intensive_solr_index
• [x] Ensure ACCESS_MASTER_MOUNT is '/data' on production for the regular worker and 's3' for the intensive worker

Engineering Notes

Abandoned Save to S3 job - https://collections.library.yale.edu/management/jobs/jobs/546d6829-cb03-4b8b-b1bf-3518b3e5cd9b?locale=en

Successful Save to S3 job - https://collections.library.yale.edu/management/jobs/jobs/43e0c2f0-2e15-4749-9737-c9fb30d1b0a1?locale=en

teams discussion

[sshetenhelm]

When testing the 'Recreate Child OID PTIFF' batch process, I received a "PTIFF not found" error for an image that is very clearly in Management. Here's the batch process:https://collections.library.yale.edu/management/batch_processes/17211

Error message: Child Object 32287832 failed to convert PTIFF due to Expected file originals/32/32/28/78/32/32287832.tif on S3 not found. However, when I navigate to the individual child object page, I can see the thumbnail and successfully download the PTIFF.

[sshetenhelm]

Retried the spreadsheet mentioned in the above comment, and the batch process was successful this time.

Was also able to complete a Preservica Resync, although I now realize it's with the object that has the same image saved for all the child images (whoops). But the good news is that it successfully completed this time (even if it completed... wrong). Not sure if that was helpful for this, but thought I'd add it.

Any other tests to confirm this works?

[K8Sewell]

I don't think there are any other tests we need to do.

[sshetenhelm]

Cool! Ready to close. THANK YOU!