Closed EddieLF closed 3 weeks ago
Also had to add in the HIGHMEM
worker option because when requesting 64gb memory with STANDARD
machine type, the driver will fail to create the batch:
https://batch.hail.populationgenomics.org.au/batches/455413/jobs/1
ValueError: Requesting more cores than available on standard machine: 18>16
Adding in the HIGHMEM worker option resolved this. https://batch.hail.populationgenomics.org.au/batches/455415
Adds a config option to set the requested memory for GATK
GenomicsDBImport
jobs.NOTE
Current code has this comment about the memory request:
Then, the memory is requested from a
STANDARD
machine type:HIGHMEM
machine type instead ofSTANDARD
?xmx_gb + 1
, so this config option is actually tweaking the java job memory. Is this fine? Would a value likexmx_gb = 63
make sense, meaning we request 64GB memory total for the job VM?