jtamames / SqueezeMeta

A complete pipeline for metagenomic analysis
GNU General Public License v3.0
357 stars 78 forks source link

SqueezeMeta Step 1 Error: Failing in Megahit Assembly #661

Closed Ravi-WSU closed 1 year ago

Ravi-WSU commented 1 year ago

Hello, I've had multiple failures at this same point. I am running 3 metagenomics samples, GRID resources are: 1 node, 14 CPUs, and 250 GB memory. I've attached an image of the megahit log where the error is. Any advice would be helpful, thank you. The error is in the 2nd image.

image

image

fpusan commented 1 year ago

Error 172 may be due to a lack of memory according to https://github.com/voutcn/megahit/issues/282 I am however a bit surprised that this is happening to you with only three samples if you have 250 Gb available. Does it happen if you reserve a full node instead of only 14 CPUs?

Ravi-WSU commented 1 year ago

Apologies, I am running a batch script that requests 14 cores on a single node with 250 GB memory. Do you mean a lack of memory in general on my directory?

Ravi-WSU commented 1 year ago

I've also run these exact samples before with lower memory requirements and the entire SqueezeMeta analysis has finished so I'm not sure what is causing it to stop at Megahit this time.

fpusan commented 1 year ago

I mean lack of RAM memory. If you are requesting only 14 cores, you may not be getting all the memory available in the node, or other processes in the node may be competing with SqueezeMeta for memory. Try reserving a full node and see if it works now.

Ravi-WSU commented 1 year ago

Thank you, I will give it a try and let you know how it goes.

Ravi-WSU commented 1 year ago

Sorry, I misspoke. I am requesting 34 cores on a single node, 14 was on my earlier attempts. However, I will still try to request the full node.

Ravi-WSU commented 1 year ago

Slightly unrelated question, should the value for -t be equal to the number of threads I am requesting on the GRID? Ex. if I request 34 threads, should I include -t 34 in my bash script?

fpusan commented 1 year ago

Yes

Ravi-WSU commented 1 year ago

The issues with the analysis were the result of a lack of storage space in my working directory. Everything is working smoothly now, thank you for your help, Fernando.

fpusan commented 1 year ago

Glad to hear! Closing issue!