theiagen / public_health_bioinformatics

Bioinformatics workflows for genomic characterization, submission preparation, and genomic epidemiology of pathogens of public health concern.
GNU General Public License v3.0
33 stars 15 forks source link

[TheiaCoV and TheiaMeta] Implement HOSTILE and Check resource usage for hostile-pe #486

Open andrewjpage opened 1 month ago

andrewjpage commented 1 month ago

:bug:

:pencil: Describe the Issue

The hostile-pe task has a high cost per run ($17 for 1000 runs).

Run the task and figure out how much RAM is normally used (/usr/bin/time -v cmd). Does it really need 8GB RAM? Does it require a 100GB local disk? How much processing time is used and calculate the utilisation of the CPUs? If its not making use of all 4, adjust the task to use less.