search

VGP / vgp-assembly

VGP repository for the genome assembly working group
Other
185 stars 51 forks source link

update version to use app with higher memory #32

Closed Arkarachai closed 5 years ago

Arkarachai commented 5 years ago

This is the workflow change for the Falcon-unzip align and phase app update.

See the rational below or in genome_assembly repo PR. I update default instance type based on 3 VGP genomes which got into out of memory. The mem1_ssd1_x32 is proof to be sufficient, so we don't need mem3_ssd1_x16. This should be working fine with not so much more cost because download and parallelization step go faster.

Arkarachai commented 5 years ago

@msimbirsky I add instance type for Align and Phase as you recommended. The reasons that I like to directly change app rather modify the workflow are that: 1) It reduce the mismatch between running the app alone and within the workflow using default setting; 2) The dxworkflow.json doesn't have regional option, so I can't use it in Azure if I add default instance type there.

msimbirsky commented 5 years ago

Makes sense. I don't think those apply to the VGP workflow. They don't run on Azure and any changes to instance types should be made at the workflow level and reviewed by Arang or Sergey.