Open PedalheadPHX opened 9 months ago
https://github.com/tgen/tempe/blob/a58d1b95020dc7fa6b3d02f7c73962c928f75cf7/modules/dna_alignment/split_fastq.j2#L40
would a straight decompression be faster then zcat using gzip/gunzip or pigz? In most cases this is a short task but with large fastq it can take more time than I think we appreciate and ends up being a large part of the total start-stop run time
https://github.com/tgen/tempe/blob/a58d1b95020dc7fa6b3d02f7c73962c928f75cf7/modules/dna_alignment/split_fastq.j2#L40
would a straight decompression be faster then zcat using gzip/gunzip or pigz? In most cases this is a short task but with large fastq it can take more time than I think we appreciate and ends up being a large part of the total start-stop run time