The current implementation only support compression for different algorithms in HDFS, but in local or other java.nio.Path implementations it does only check for GZIP and BZIP2. In addition, this is highly inconsistent in several ways:
All block-compressed extensions use the gzip implementation from HTSJDK, but not the block-compressed. Maybe we should switch to the bgzip one.
For the bzip2 format, we use commons-compress, but we cannot use the factory because it only checks for one extension but not for others.
Maybe the best way will be to add a service loader in our own for the compression algorithms, and support the same in local and HDFS to avoid nightmares while testing in different file systems.
I downloaded recently a bzip2 compressed FASTA file, and it will be useful to be able to use it directly in ReadTools. At least that part should be done for version 2.0.0
The current implementation only support compression for different algorithms in HDFS, but in local or other
java.nio.Path
implementations it does only check forGZIP
andBZIP2
. In addition, this is highly inconsistent in several ways:Maybe the best way will be to add a service loader in our own for the compression algorithms, and support the same in local and HDFS to avoid nightmares while testing in different file systems.