rbloom5 / ea-utils

Automatically exported from code.google.com/p/ea-utils
0 stars 0 forks source link

Limit on the number of files it can handle #29

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?
1. Call fastq-multx with 6000 different barcodes

What is the expected output? What do you see instead?
fastq files

What version of the product are you using? On what operating system?
ea-utils.1.1.2-537
on "Ubuntu 12.04.3 LTS"

Please provide any additional information below.

I have about 6000 cells and I need to run fastq-multx on it in order to 
demultiplex them.
However when I do, I get this error:

End used: start
Error opening file '1211.barcoded.fastq': Too many open files

Is there a way to fix this?

Original issue reported on code.google.com by masanao....@gmail.com on 17 Mar 2014 at 7:01

GoogleCodeExporter commented 9 years ago
This is an issue with your operating environment.  On a linux machine, you need 
to change the "ulimit"

On Ubuntu:

1. Type  ulimit -a
2. See where it says "open files" ... that's your limit
3. Ask your system admin to change the ulimit to 10,000, or, if you are an 
admin, here's how I would do it:

sudo vi  /etc/security/limits.conf

Add these lines:

soft nofile 2000 *
hard nofile 100000 *

That will change the soft limit to 2000, and the hard limit to 100K.   Then 
your users can type:

ulimit -S -n 10000

And get a new ulimit... just for that session.

Original comment by earone...@gmail.com on 17 Mar 2014 at 7:10