SystemsGenetics / GEMmaker

A workflow for construction of Gene Expression count Matrices (GEMs). Useful for Differential Gene Expression (DGE) analysis and Gene Co-Expression Network (GCN) construction
https://gemmaker.readthedocs.io/en/latest/
MIT License
33 stars 16 forks source link

Report of Default Memory, time, etc. #261

Open JohnHadish opened 2 years ago

JohnHadish commented 2 years ago

Description of feature

GEMmaker will occasionally encounter memory errors when it encounters large files:

#TRACE sample_id=SRX9369046
#TRACE fastq_lines=0
Ran out of memory for SRX9369046_1.fastq
java.lang.OutOfMemoryError: Java heap space

Unfortuently, GEMmaker does not report what default parameters for each process is, and how much memory was used that triggered the error.

It would be nice to have a feature that says something like:

Ran out of memory for SRX9369046_1.fastq - Exceeded limit of 8GB

So that parameters can easily be adjjsted, rather than relying on a trial and error or a code deep dive.