aryarm / as_analysis

A complete Snakemake pipeline for detecting allele specific expression in RNA-seq
MIT License
10 stars 9 forks source link

improve dependency installation on cloud #56

Open aryarm opened 4 years ago

aryarm commented 4 years ago

the google life sciences api creates a new snakemake container to run each of our jobs so our dependencies must be installed anew by snakemake every time it runs a job, since each job is run in a new, empty container this process may add substantially to the runtime of some of our instances and the cost of using them

we have two options: 1) separate our dependencies into different env files to install only the necessary dependencies for each job 2) create a custom snakemake container with our dependencies already installed in it and force snakemake to use our container instead of its own