Open mtojek opened 3 years ago
Consider the following case (bioinformatics):
bwa mem ... | samtools view .... > outfile, which should end up with approx. 50 GB out file. Unfortunately the pipeline hangs at ~14 GB, bwa mem waits on buffers and so does samtools view.
bwa mem ... | samtools view .... > outfile
bwa mem
samtools view
Were there any reports around large file processing?
Consider the following case (bioinformatics):
bwa mem ... | samtools view .... > outfile, which should end up with approx. 50 GB out file. Unfortunately the pipeline hangs at ~14 GB,bwa memwaits on buffers and so doessamtools view.Were there any reports around large file processing?