soedinglab / metaeuk

MetaEuk - sensitive, high-throughput gene discovery and annotation for large-scale eukaryotic metagenomics
GNU General Public License v3.0
178 stars 23 forks source link

Stalled at prefitering? #8

Closed cslamo closed 7 months ago

cslamo commented 4 years ago

I started 3 metaeuk jobs, all with different fasta input but same pfam_full database. They all seemed to stall at a prefiltering step (different step) but the jobs appearing as running (2 days since). Below is one of the caller scripts with the command line:

!/bin/bash

$ -S /bin/bash

. /etc/profile

$ -pe threaded 8

source activate metaeuk metaeuk easy-predict /path-to-input/contigs.fasta /path-to-db/pfam_msa_db.fasta predsResultProteinsOmSpadesClean.fas tempor

Below is the log attached:

runmetaeukom.sh.o71761.txt

Expected Behavior

Current Behavior

Steps to Reproduce (for bugs)

Please make sure to execute the reproduction steps with newly recreated and empty tmp folders.

MetaEuk Output (for bugs)

Please make sure to also post the complete output of MetaEuk. You can use gist.github.com for large output.

Context

Providing context helps us come up with a solution and improve our documentation for the future.

Your Environment

Include as many relevant details about the environment you experienced the bug in.

milot-mirdita commented 4 years ago

Sorry your issue fell a bit through the cracks. Did you have any progress with it?

What are the specs of the machine you were running MetaEuk? It looks like it didn't have enough RAM, so it had to split the database into many many smaller chunks which affects runtime quite badly. However, none of the smaller chunks were actually taking a long time. Was that the last piece of output of MetaEuk?

fplazaonate commented 3 years ago

Hi, I have the same problem. The "prefilter" step takes a lot of time. More precisely, the CPU usage is very low and RAM usage increases then decreases in cyclic manner.