epi2me-labs / wf-metagenomics

Metagenomic classification of long-read sequencing data
Other
62 stars 23 forks source link

html report - read summary #74

Closed HannahBenisty closed 1 year ago

HannahBenisty commented 1 year ago

Ask away!

Hi! Usually a read summary appears in the read report, but now I have a run with 24 barcodes and the report starts at the lineages. It would be great if we could also see the read summary. Is there a way to find this information in other documents generated with this workflow. Many thanks!

nggvs commented 1 year ago

Hi! Thanks for using the workflow. Which version of the wf-metagenomics are you using and which options?

HannahBenisty commented 1 year ago

Hi, I am using minimap2 as classifier and added the option minimap2_by_reference. The version is the last one which I dowloaded using git clone gh repo clone epi2me-labs/wf-metagenomics.

nggvs commented 1 year ago

Ok, thank you very much! I will try to reproduce it (v2.0.7). Could you run the workflow using demo or test_data to see if you also observe the same issue?

HannahBenisty commented 1 year ago

I have run a test data case 01 with the following options: --fastq test_data/case01/ --classifier minimap2 --minimap2_by_reference. Read summary not appearing.

nggvs commented 1 year ago

I'm trying to reproduce the error, but I see this using test_data or demo data with the latest version. image

So, I'm not sure of what could be happening. Are you getting any error when you run the workflow? Could you paste the log?

HannahBenisty commented 1 year ago

Hi,

here are the options I have used and the log: --fastq test_data/case01/ --classifier minimap2 --minimap2_by_reference

N E X T F L O W ~ version 23.04.3 Launching main.nf [trusting_panini] DSL2 - revision: f09278680a WARN: NEXTFLOW RECURSION IS A PREVIEW FEATURE - SYNTAX AND FUNCTIONALITY CAN CHANGE IN FUTURE RELEASES

WARN: Found unexpected parameters:

|||||||||| _ __ _ __ ____ |||||||||| | ____| _ | | \/ | __| | | | | ||||| | | | |) | | ) | |\/| | _| ___| |/ ` | ' \/ | ||||| | |_| /| | / /| | | | |_|| | (| | |) _ \ |||||||||| |____|_| |_|___|| ||| ||\,|._/|/ |||||||||| wf-metagenomics v2.6.1 -------------------------------------------------------------------------------- Core Nextflow options runName : trusting_panini containerEngine : singularity launchDir : /nfs/users/rg/hbenisty/wf-meta/test_nat/wf-metagenomics workDir : /nfs/users/rg/hbenisty/wf-meta/test_nat/wf-metagenomics/work projectDir : /nfs/users/rg/hbenisty/wf-meta/test_nat/wf-metagenomics userName : hbenisty profile : crg configFiles : /nfs/users/rg/hbenisty/wf-meta/test_nat/wf-metagenomics/nextflow.config

Input Options fastq : test_data/case01/ classifier : minimap2

Reference Options database_sets : [ncbi_16s_18s:[reference:https://ont-exd-int-s3-euwst1-epi2me-labs.s3.amazonaws.com/wf-metagenomics/ncbi_16s_18s/ncbi_targeted_loci_16s_18s.fna, refindex:https://ont-exd-int-s3-euwst1-epi2me-labs.s3.amazonaws.com/wf-metagenomics/ncbi_16s_18s/ncbi_targeted_loci_16s_18s.fna.fai, database:https://ont-exd-int-s3-euwst1-epi2me-labs.s3.amazonaws.com/wf-metagenomics/ncbi_16s_18s/ncbi_targeted_loci_kraken2.tar.gz, kmer_dist:https://ont-exd-int-s3-euwst1-epi2me-labs.s3.amazonaws.com/wf-metagenomics/ncbi_16s_18s/database1000mers.kmer_distrib, ref2taxid:https://ont-exd-int-s3-euwst1-epi2me-labs.s3.amazonaws.com/wf-metagenomics/ncbi_16s_18s/ref2taxid.targloci.tsv, taxonomy:https://ftp.ncbi.nlm.nih.gov/pub/taxonomy/taxdump_archive/taxdmp_2023-01-01.zip], ncbi_16s_18s_28s_ITS:[reference:https://ont-exd-int-s3-euwst1-epi2me-labs.s3.amazonaws.com/wf-metagenomics/ncbi_16s_18s_28s_ITS/ncbi_16s_18s_28s_ITS.fna, refindex:https://ont-exd-int-s3-euwst1-epi2me-labs.s3.amazonaws.com/wf-metagenomics/ncbi_16s_18s_28s_ITS/ncbi_16s_18s_28s_ITS.fna.fai, database:https://ont-exd-int-s3-euwst1-epi2me-labs.s3.amazonaws.com/wf-metagenomics/ncbi_16s_18s_28s_ITS/ncbi_16s_18s_28s_ITS_kraken2.tar.gz, kmer_dist:https://ont-exd-int-s3-euwst1-epi2me-labs.s3.amazonaws.com/wf-metagenomics/ncbi_16s_18s_28s_ITS/database1000mers.kmer_distrib, ref2taxid:https://ont-exd-int-s3-euwst1-epi2me-labs.s3.amazonaws.com/wf-metagenomics/ncbi_16s_18s_28s_ITS/ref2taxid.ncbi_16s_18s_28s_ITS.tsv, taxonomy:https://ftp.ncbi.nlm.nih.gov/pub/taxonomy/taxdump_archive/taxdmp_2023-01-01.zip], SILVA_138_1:[database:null], PlusPF-8:[database:https://genome-idx.s3.amazonaws.com/kraken/k2_pluspf_08gb_20230314.tar.gz, taxonomy:https://ftp.ncbi.nlm.nih.gov/pub/taxonomy/taxdump_archive/new_taxdump_2023-03-01.zip], PlusPFP-8:[database:https://genome-idx.s3.amazonaws.com/kraken/k2_pluspfp_08gb_20230314.tar.gz, taxonomy:https://ftp.ncbi.nlm.nih.gov/pub/taxonomy/taxdump_archive/new_taxdump_2023-03-01.zip]]

Minimap2 Options split_prefix : true minimap2_by_reference: true

!! Only displaying parameters that differ from the pipeline defaults !! -------------------------------------------------------------------------------- If you use epi2me-labs/wf-metagenomics for your analysis please cite:

-------------------------------------------------------------------------------- This is epi2me-labs/wf-metagenomics v2.6.1. -------------------------------------------------------------------------------- Checking inputs. WARN: Access to undefined parameter real_time -- Initialise it to a default value eg. params.real_time = some_value Minimap2 pipeline. Preparing databases. Using default taxonomy database. Using a default database. Searching input for [.fastq, .fastq.gz, .fq, .fq.gz] files. [skipping] Stored process > prepare_databases:download_reference_ref2taxid [skipping] Stored process > prepare_databases:download_unpack_taxonomy [6c/ecf4cd] Cached process > fastcat (3) [6b/6e745d] Cached process > fastcat (2) [91/a2d0d9] Cached process > fastcat (1) [d4/ce9fbc] Cached process > minimap_pipeline:run_common:getVersions [30/6c5f96] Cached process > minimap_pipeline:run_common:getParams [c9/fce416] Cached process > minimap_pipeline:output (1) [f5/bfa54f] Submitted process > minimap_pipeline:output (2) [ff/a6b2d1] Submitted process > minimap_pipeline:minimap (1) [b7/311ecf] Submitted process > minimap_pipeline:minimap (3) [4b/6f488f] Submitted process > minimap_pipeline:minimap (2) [f8/7b4c42] Submitted process > minimap_pipeline:getAlignmentStats (1) [26/228e71] Submitted process > minimap_pipeline:getAlignmentStats (2) [b0/ce42f0] Submitted process > minimap_pipeline:getAlignmentStats (3) [5a/e02886] Submitted process > minimap_pipeline:createAbundanceTables [41/d851ce] Submitted process > minimap_pipeline:output (3) [a1/a95d25] Submitted process > minimap_pipeline:makeReport (1) [34/1d4090] Submitted process > minimap_pipeline:output (4)

nggvs commented 1 year ago

Hi, Thank you for the log. From it I think you are using an old version of the workflow. Could you make sure you are using v2.7.0 and the master branch?

HannahBenisty commented 1 year ago

Ah ok, so I was using doing git clone from the link of the main page of the workflow.

git clone https://github.com/epi2me-labs/wf-metagenomics.git

Which link should I use? Thanks!

nggvs commented 1 year ago

That is correct, would you mind to go into the folder wf-metagenomics that has been downloaded and run this? git status

HannahBenisty commented 1 year ago

On branch master

Changes not staged for commit:

(use "git add ..." to update what will be committed)

(use "git checkout -- ..." to discard changes in working directory)

#

modified: nextflow.config

modified: subworkflows/minimap_pipeline.nf

#

Untracked files:

(use "git add ..." to include in what will be committed)

#

._log

._nextflow.config

log

output/

store_dir/

subworkflows/._minimap_pipeline.nf

work/

no changes added to commit (use "git add" and/or "git commit -a")

HannahBenisty commented 1 year ago

Hi Natalia,

I have tried again, and it works. Probably it was my fault because of messing with versions the nextflow config file.

nggvs commented 1 year ago

Hi @HannahBenisty ,

Glad to hear that! I would suggest to:

git checkout -- nextflow.config
git checkout -- subworkflows/minimap_pipeline.nf

and then remove temporal files (subworkflows/._minimap_pipeline.nf, ._log, ._nextflow.config) to avoid any other issue. Then you can run git pull to make sure everything is fine and you have the latest stable version.

Besides, if you don't mind to close the issue (if it has been already solved), I would appreciate it!