search

MDU-PHL / bohra

A pipeline for bioinformatics analysis of bacterial genomes
GNU General Public License v3.0
18 stars 4 forks source link

Thread pool reached error #59

Closed kristyhoran closed 1 year ago

kristyhoran commented 2 years ago

This is an error reported by @abcdtree bohra Nextflow errored out with a warning the the thread pool had been reached... this has happened before (in QC2) when running the local executor. It is mentioned here https://github.com/nextflow-io/nextflow/issues/1871 Although honestly I am not 100% sure I understand exactly what is happening. BUT the effect is that when there are alot of samples in the analysis, the Nextflow tries to check the cache... and does this across all processes and samples.. which may be more than the 1000 set.... There is no clear advice from developers on this.. but it seems that adding in -Dnxf.pool.type=sync addresses the issue..

karl-az commented 2 years ago

I would also appreciate more information here.