sanger-tol / genomenote

This Nextflow DSL2 pipeline takes aligned HiC reads, creates contact maps and a table of statistics.
https://pipelines.tol.sanger.ac.uk/genomenote
MIT License
19 stars 2 forks source link

Leftover files in /tmp from the `sort` commands #91

Closed muffato closed 6 months ago

muffato commented 7 months ago

Description of the bug

We've been regularly hit issues in production: no more space in /var/tmp and then farm nodes closed.

The problems come from the sort commands leaving files in their /tmp.

First, the biocontainer isn't mounting /tmp properly and instead uses /var/tmp, which only has 40 GB. Our workaround is to explicitly mount /tmp.

The second issue comes from LSF killing the sort commands because of MEMLIMIT.

Command used and terminal output

No response

Relevant files

No response

System information

No response