alexstaj / cutadapt

Automatically exported from code.google.com/p/cutadapt
0 stars 0 forks source link

Gzip compression in separate process #38

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
I'm using the paired end patch I created and gziping the output.  This takes 
the runtime on an illumina run from 10 mins to  > 60 mins.

Would you be receptive to a patch that allows the creation of subprocesses to 
gzip the output, thereby using multi cores to speed up the throughtput?

Original issue reported on code.google.com by cas...@gmail.com on 7 Mar 2012 at 3:44

GoogleCodeExporter commented 9 years ago
Yes, sounds really good. I have als just committed a change that speeds up 
reading of gzipped files.

Original comment by marcel.m...@tu-dortmund.de on 9 Mar 2012 at 10:34

GoogleCodeExporter commented 9 years ago
Feel free to re-open if you still think this is an issue. I don't think it is a 
problem in Python 2.7 anymore.

Original comment by marcel.m...@tu-dortmund.de on 6 Feb 2014 at 10:10