ndierckx / NOVOPlasty

NOVOPlasty - The organelle assembler and heteroplasmy caller
Other
170 stars 62 forks source link

Novoplasty memory error #212

Open snashraf opened 11 months ago

snashraf commented 11 months ago

Hi Team,

I have been stuck with this issue for a long time. I was able to run NOVOPlasty on my local machine but when I am trying on azure machine amd it failed. I have tried with multiple configurations and its getting failed every time . My current configuration is 16 cores with 512GB. But now all jobs are killing due to memory issues. I am using slurm to run this.

[nsyed@az-rbid-hpc-scheduler assembly]$ tail -f slurm-novoplasty-20939.err perl: warning: Setting locale failed. perl: warning: Please check that your locale settings: LANGUAGE = (unset), LC_ALL = (unset), LC_CTYPE = "UTF-8", LANG = "en_US.UTF-8" are supported and installed on your system. perl: warning: Falling back to a fallback locale ("en_US.UTF-8"). /var/spool/slurmd/job20939/slurmscript: line 8: 8195 Killed NOVOPlasty4.3.1.pl -c ${config}/config${name} .txt slurmstepd: error: Detected 1 oom-kill event(s) in StepId=20939.batch. Some of your processes may have been killed by the cgroup out-of

Could you please help me with this?

This is the horse genome, and the read1 file is around 32G.

horse.config.txt

Could you please help me with this? I have been struggling with this for the last two weeks.

Regards, Najeeb

ndierckx commented 11 months ago

Hi,

Not sure what the problem is but if it runs out of memory, you can try the max memory option. Seems you have a very large dataset, which you wouldn't need all the data from to assemble the mitogenome. Not sure how much memory you are requesting with your slurm job, but maybe try max memory 50 Gb and request 70 Gb or so, let me know if this gives the same problem