linsalrob / fastq-pair

Match up paired end fastq files quickly and efficiently.
https://edwards.flinders.edu.au/sorting-and-paring-fastq-files/
MIT License
142 stars 32 forks source link

Can't allocate memory for new ID pointer #24

Open MikeHala opened 2 days ago

MikeHala commented 2 days ago

Hi,

I am trying to run fastq-pair on 2 fastq files. One of them has 484,173,359 reads (157G), the other has 484,590,459 reads (157G).

The command I am using is: fastq_pair -t 150000000 file_1.fastq file_2.fastq

I got the following error: Can't allocate memory for new ID pointer

Please advise.

MikeHala commented 2 days ago

When I reduced -t to 50000000, I got the following error:

Cannot allocate memory to duplicate @ST-E00180:52:H5LNMCCXX:2:2213:2928:19434/
/var/spool/gridscheduler/execd/node2d01/job_scripts/47134890: line 42: 896581 Segmentation fault      (core dumped) fastq_pair -t 50000000 file_1.fastq file_2.fastq