Automate Prefect to run tests, nightly, on HPC, as another set of workflows

niaid / image_portal_workflows

Workflows related to project previously referred to as "Hedwig"

BSD 3-Clause "New" or "Revised" License

5 stars 1 forks source link

Automate Prefect to run tests, nightly, on HPC, as another set of workflows #404

Closed philipmac closed 9 months ago

philipmac commented 10 months ago

We can create workflow(s) that can be scheduled to run nightly on HPC. These flows will simply run tests, including large input tests. This has the additional convenience of not having to move any data around, we can leave a dataset on HPC for these tests.

annshress commented 9 months ago

Tests and pushes result as an artifact into prefect server.

Test run: https://prefect2.hedwig-workflow-api.niaiddev.net/flow-runs/flow-run/158b3031-1c89-4bd7-b1b7-c23150a35d4e Artifact: https://prefect2.hedwig-workflow-api.niaiddev.net/artifacts