ruanjue / wtdbg2

Redbean: A fuzzy Bruijn graph approach to long noisy reads assembly
GNU General Public License v3.0
513 stars 94 forks source link

Failed to create threads on SGE #79

Closed GeoMicroSoares closed 5 years ago

GeoMicroSoares commented 5 years ago

Hi there, Trying to run wtdbg2 on our local HPC running SGE and getting the following error:

$ cat metagenome_wtdbg2.e3192124 
sh: module: line 1: syntax error: unexpected end of file
sh: error importing function definition for `BASH_FUNC_module'
-sh: module: line 1: syntax error: unexpected end of file
-sh: error importing function definition for `BASH_FUNC_module'
--
-- total memory      529411952.0 kB
-- available         524869200.0 kB
-- 32 cores
-- Starting program: ./wtdbg2/wtdbg2 -t 20 -i metagenome_folder/metagenome_surface.fastq -fo /scratch/metagenome_folder -x ont -e 2
-- pid                      7475
-- date         Wed Mar 13 10:00:17 2019
--
[Wed Mar 13 10:00:17 2019] loading reads
67941 reads
[Wed Mar 13 10:00:27 2019] Done, 67941 reads (>=5000 bp), 446992293 bp, 1711884 bins
** PROC_STAT(0) **: real 10.522 sec, user 6.770 sec, sys 3.060 sec, maxrss 201068.0 kB, maxvsize 20339548.0 kB
KEY PARAMETERS: -k 0 -p 19 -K 1000.049988 -A -S 2.000000 -s 0.050000 -g 0 -X 50.000000 -e 2 -L 5000
[Wed Mar 13 10:00:27 2019] generating nodes, 20 threads
 -- Failed to create thread [pgz, 0009] in open_pgzf_writer -- pgzf.h:555 --

The full script I submitted is as follows:

$ cat metagenome_submission.sge 
#$ -S /bin/sh
#$ -cwd
#$ -q large.q
#$ -l h_vmem=100G
#$ -N metagenome_wtdbg2
#$ -pe multithread 20
#$ -V

module load gcc/4.9.4

./wtdbg2/wtdbg2 -t 20 -i metagenome_folder/metagenome_surface.fastq \
    -fo /scratch/metagenome_folder \
    -x ont -e 2 -L 500

Any ideas what may be causing this?

Thanks!

ruanjue commented 5 years ago

There seems a thread/process limitation of your SGE job. Please contact the administrator for details.