voutcn / megahit

Ultra-fast and memory-efficient (meta-)genome assembler
http://www.ncbi.nlm.nih.gov/pubmed/25609793
GNU General Public License v3.0
588 stars 134 forks source link

MissingOutputException using Megahit as part of Sunbeam, on WSL #287

Open TakacsBertalan opened 3 years ago

TakacsBertalan commented 3 years ago

I am using the Sunbeam pipeline for analyzing metagenome data, on a Windows server, with WSL 1 (Ubuntu 18.04). I get the same error every time I try to run the assembly MissingOutputException in line 14 of /mnt/d/sunbeam-dev/rules/assembly/assembly.rules: Missing files after 90 seconds: /mnt/d/sunbeam-dev/cosmos_id/sunbeam_output/assembly/megahit/S158_L008_asm/final.contigs.fa This might be due to filesystem latency. If that is the case, consider to increase the wait time with --latency-wait. Shutting down, this might take some time. Exiting because a job execution failed. Look above for error message Complete log: /mnt/d/sunbeam-dev/.snakemake/log/2020-10-02T152045.651215.snakemake.log I tried to change the waiting time, but received the same message even after 3 hours of waiting. I tried to uninstall and reinstall Sunbeam multiple times, creating several different projects with different data, no change. On a native Linux machine, Sunbeam and Megahit seem to work without problem. Could this be a WSL problem? The machine has 160 GB of RAM, I don't think this is a memory issue

The complete log: `[Fri Oct 2 17:19:32 2020] rule megahit_paired: input: /mnt/d/sunbeam-dev/cosmos_id/sunbeam_output/qc/decontam/S158_L008_1.fastq.gz, /mnt/d/sunbeam-dev/cosmos_id/sunbeam_output/qc/decontam/S158_L008_2.fastq.gz output: /mnt/d/sunbeam-dev/cosmos_id/sunbeam_output/assembly/megahit/S158_L008_asm/final.contigs.fa jobid: 18 wildcards: sample=S158_L008

Waiting at most 90 seconds for missing files. MissingOutputException in line 14 of /mnt/d/sunbeam-dev/rules/assembly/assembly.rules: Missing files after 90 seconds: /mnt/d/sunbeam-dev/cosmos_id/sunbeam_output/assembly/megahit/S158_L008_asm/final.contigs.fa This might be due to filesystem latency. If that is the case, consider to increase the wait time with --latency-wait. Shutting down, this might take some time. Exiting because a job execution failed. Look above for error message Complete log: /mnt/d/sunbeam-dev/.snakemake/log/2020-10-02T152045.651215.snakemake.log `

I will cross-link this issue to the Sunbeam github page