theiagen / public_health_bioinformatics

Bioinformatics workflows for genomic characterization, submission preparation, and genomic epidemiology of pathogens of public health concern.
GNU General Public License v3.0
33 stars 15 forks source link

Change version_capture container #483

Closed andrewjpage closed 3 weeks ago

andrewjpage commented 1 month ago

:bug:

:pencil: Describe the Issue

task_versioning.wdl is called every time a workflow is run. The docker container it calls is Ubuntu which is massive. All it does is write some a version number and date. Change this to a very small docker container like alpine. This will reduce the cost of every workflow run by a little bit.

https://hub.docker.com/_/alpine

Upload the container used to our Google Artifact Registry.

This task runs for an average of 1 second. Make it preemptible (spot) so that we can access lower pricing. Google give 30 seconds notice before killing it, so we shouldn't notice any difference.

In the runtime section of the task set:

maxRetries: 3 preemptible: 1