search

dib-lab / sourmash-slainte

Project template for sourmash-based characterization of genomes and metagenomes
BSD 3-Clause "New" or "Revised" License
1 stars 0 forks source link

MRG: add resources to Snakefile #9

Closed ctb closed 8 months ago

ctb commented 8 months ago

even after fastgather, running multiple gathers seems to be a problem - requiring ~30-60 GB of RAM each time. This PR adds threading resources as well as a gather resource. Will probably replace later with a mem resource instead.

A successful complete run used the following parameters:

srun -p high2 --time=72:00:00 --nodes=1 --cpus-per-task 128 --mem 120GB --pty bin/bash

snakemake --cores 128 --resources gather=2 -k