We download in database related Nextflow processes the corresponding database, decompress it and then delete the compressed version. This means that a certain point in time the compressed and decompressed version consume disk space.
The solution would be to pipe the wget (and s5cmd?) output to the linux tar command.
We download in database related Nextflow processes the corresponding database, decompress it and then delete the compressed version. This means that a certain point in time the compressed and decompressed version consume disk space.
The solution would be to pipe the wget (and s5cmd?) output to the linux tar command.