DDS Workflow / Sync daemons

[tomcrane]

There are two processes that run as part of the current DDS, that need to run in ECS. They can scale as much as we like.

(Milestone 2)

WorkflowProcessor

• Constructs b-number-level jobs in response to Goobi workflow end-state
• Rework as daemon to run on ECS (log output via Firelens)

DlcsJobProcessor

• TASK - the core DLCS synchronisation runner. Picks up DLCS Ingest jobs that have been left for it in the DDS Jobs database.
• Rework as daemon to run on ECS (log output via Firelens)

[donaldgray]

See ticket #4629 for basic deployment.

[donaldgray]

PR for code changes: https://github.com/wellcomecollection/iiif-builder/pull/24 PR for infra changes: https://github.com/wellcomecollection/iiif-builder-infrastructure/pull/8