open2c / quaich

snakemake pipeline for Hi-C post-processing
MIT License
22 stars 6 forks source link

memory usage guidelines #9

Open gfudenberg opened 1 year ago

gfudenberg commented 1 year ago

It would be great to have a guideline for how much memory to request (perhaps broken down by resolution). It seems like insulation requests the highest per-thread amount by default (mem_mb=32 * 1024,, and dots the highest overall threads * 16 * 1024?

Jobs are currently failing due to oom errors with slurm sbatch defaults: slurmstepd: error: Detected 1 oom-kill event(s) in StepId=9431588.batch. Some of your processes may have been killed by the cgroup out-of-memory handler.