related-sciences / ukb-gwas-pipeline-nealelab

Pipeline for reproduction of NealeLab 2018 UKB GWAS
4 stars 3 forks source link

Configure autoscaling for GKE clusters #13

Closed eric-czech closed 4 years ago

eric-czech commented 4 years ago

I'm not certain if autoscaling will ever make sense for Dask clusters, but it would certainly be useful for the more generic clusters associated with other Snakemake tasks (e.g. normalizing phenotype data or converting bgen to zarr).

eric-czech commented 4 years ago

I never found a way to get this to work (particularly with multiple node pools). Switching to Cloud Provider instead since autoscaling is simpler that way.