lpantano / seqcluster

small RNA analysis from NGS data
http://seqcluster.readthedocs.io
MIT License
35 stars 17 forks source link

MIRALIGNER/question #58

Closed Alarabi1980 closed 5 months ago

Alarabi1980 commented 6 months ago

Hi Lorena,

Hope this email finds you well,

I am working on miRNA seq data, and I am using your pipeline https://seqcluster.readthedocs.io/mirna_annotation.html to find Isomirs, but I am faced with some difficulties as the final output show me no results. so, I was wondering if I am making a mistake or something. one of the issues if in the pipeline page one of the file needed is miRNA.str? which I am supposed to download from mirbase. but there is not such file the only file available is mature.fa file is this the same? but when I use this file, it gives me an error that I am missing miRNA.str file? so, I changed the mature.fa file to mature.str and it worked with no error but no results?

can you please help me

Thanks

command (bcbio) ahmed@ahmed-Precision-5570:~$ java -jar /home/ahmed/tools/miraligner.jar -sub 1 -trim 3 -add 3 -s mmu -i /home/ahmed/data/PEHmiRNA/collapse/trimmed_001.R1_trimmed.fastq -db /home/ahmed/data/PEHmiRNA/DB -o /home/ahmed/data/PEHmiRNA/collapse/output_prefix Format is not tabular,guessing fasta species found Go to mapping... Mismatches: 1 Trimming: 3 Addition: 3 Species: mmu Feb 20, 2024 2:02:32 PM miraligner.map readseq INFO: Tue Feb 20 14:02:32 EST 2024

Feb 20, 2024 2:02:32 PM miraligner.map readseq INFO: Tue Feb 20 14:02:32 EST 2024

Reading reads Feb 20, 2024 2:02:33 PM miraligner.map readseq INFO: Number of reads excluded because size: 590697 Feb 20, 2024 2:02:33 PM miraligner.map readseq INFO: Number of reads excluded because size: 590697 Feb 20, 2024 2:02:33 PM miraligner.map readseq INFO: Number of reads to be mapped: 154078 Feb 20, 2024 2:02:33 PM miraligner.map readseq INFO: Number of reads to be mapped: 154078 Feb 20, 2024 2:02:33 PM miraligner.map readseq INFO: Searching in precursors Feb 20, 2024 2:02:33 PM miraligner.map readseq INFO: Searching in precursors Feb 20, 2024 2:02:36 PM miraligner.map readseq INFO: Tue Feb 20 14:02:36 EST 2024 Feb 20, 2024 2:02:36 PM miraligner.map readseq INFO: Tue Feb 20 14:02:36 EST 2024 Feb 20, 2024 2:02:36 PM miraligner.map readseq INFO: Num reads annotated: 38720 Feb 20, 2024 2:02:36 PM miraligner.map readseq INFO: Num reads annotated: 38720

lpantano commented 6 months ago

Hi, I see the problem, it seems they stopped supporting that file. I would recommend to use STAR or bowtie to map reads to precursors and then use mirtop to parse the output and get isomir annotation.

bowtie \\
        -x \$INDEX \\
        -q <(zcat $reads) \\
        -p ${task.cpus} \\
        -t \\
        -k 50 \\
        --best \\
        --strata \\
        -e 99999 \\
        --chunkmbs 2048 \\
        --un ${meta.id}_unmapped.fq -S > ${meta.id}.sam

on another note you can use: https://nf-co.re/smrnaseq/2.2.4 to analyze everything and it will generate a lof results for this type of data.

Alarabi1980 commented 6 months ago

Thank you so much Lorena!

Alarabi1980 commented 6 months ago

Hi Lorena, I used Nextflow and the test worked nicely but when I used my data I faced the following (env_nf) ahmed@ahmed-Precision-5570:~$ nextflow run nf-core/smrnaseq -profile docker --input /home/ahmed/data/PEHmiRNA/samplesheet.csv --genome 'GRCm38' --mirtrace_species 'mmu' --protocol 'qiaseq' --outdir /home/ahmed/nextflow N E X T F L O W ~ version 23.10.1 Launching https://github.com/nf-core/smrnaseq [extravagant_lavoisier] DSL2 - revision: 87f2b3e27d [master] WARN: Running with Protocol qiaseq WARN: Therefore using Adapter: AACTGTAGGCACCATCAAT WARN: Clipping 0 bases from R1 WARN: And clipping 0 bases from 3' end


                                    ,--./,-.
    ___     __   __   __   ___     /,-._.--~'

|\ | | / / \ |__) |__ } { | \| | \__, \__/ | \ |___ \-.,--, .,._,' nf-core/smrnaseq v2.2.4-g87f2b3e

Core Nextflow options revision : master runName : extravagant_lavoisier containerEngine : docker launchDir : /home/ahmed workDir : /home/ahmed/work projectDir : /home/ahmed/.nextflow/assets/nf-core/smrnaseq userName : ahmed profile : docker configFiles :

Input/output options input : /home/ahmed/data/PEHmiRNA/samplesheet.csv protocol : qiaseq outdir : /home/ahmed/nextflow

Reference genome options genome : GRCm38 mirtrace_species : mmu fasta : s3://ngi-igenomes/igenomes/Mus_musculus/Ensembl/GRCm38/Sequence/WholeGenomeFasta/genome.fa

Trimming options clip_r1 : 0 three_prime_clip_r1: 0 three_prime_adapter: AACTGTAGGCACCATCAAT

!! Only displaying parameters that differ from the pipeline defaults !!

If you use nf-core/smrnaseq for your analysis please cite:

[- ] process > NFCORE_SMRNASEQ:SMRNASEQ:IN... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:CA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:IN... [ 0%] 0 of 1 [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:CA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - executor > local (1) [2f/332b96] process > NFCORE_SMRNASEQ:SMRNASEQ:IN... [ 0%] 0 of 1 [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:CA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - executor > local (1) [2f/332b96] process > NFCORE_SMRNASEQ:SMRNASEQ:IN... [100%] 1 of 1 ✔ [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:CA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... [ 0%] 0 of 10 [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... [ 0%] 0 of 6 [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:CU... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MU... - ERROR ~ Error executing process > 'NFCORE_SMRNASEQ:SMRNASEQ:FASTQC_FASTP:FASTQC_RAW (C1)'

Caused by: Process requirement exceeds available memory -- req: 36 GB; avail: 31 GB

Command executed:

printf "%s %s\n" trimmed_001.R1.fastq.gz C1.gz | while read old_name new_name; do [ -f "${new_name}" ] || ln -s $old_name $new_name done

fastqc \ executor > local (1) [2f/332b96] process > NFCORE_SMRNASEQ:SMRNASEQ:IN... [100%] 1 of 1 ✔ [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:CA... - [fa/e11864] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... [ 10%] 1 of 10, failed: 1 [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... [ 0%] 0 of 10 [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:CU... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MU... - Execution cancelled -- Finishing pending tasks before exit -[nf-core/smrnaseq] Pipeline completed with errors- ERROR ~ Error executing process > 'NFCORE_SMRNASEQ:SMRNASEQ:FASTQC_FASTP:FASTQC_RAW (C1)'

Caused by: Process requirement exceeds available memory -- req: 36 GB; avail: 31 GB

Command executed:

printf "%s %s\n" trimmed_001.R1.fastq.gz C1.gz | while read old_name new_name; do [ -f "${new_name}" ] || ln -s $old_name $new_name done

fastqc \ executor > local (1) [2f/332b96] process > NFCORE_SMRNASEQ:SMRNASEQ:IN... [100%] 1 of 1 ✔ [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:CA... - [fa/e11864] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... [ 10%] 1 of 10, failed: 1 [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... [ 0%] 0 of 10 [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:FA... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:GE... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MI... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:CU... - [- ] process > NFCORE_SMRNASEQ:SMRNASEQ:MU... - Execution cancelled -- Finishing pending tasks before exit -[nf-core/smrnaseq] Pipeline completed with errors- ERROR ~ Error executing process > 'NFCORE_SMRNASEQ:SMRNASEQ:FASTQC_FASTP:FASTQC_RAW (C1)'

Caused by: Process requirement exceeds available memory -- req: 36 GB; avail: 31 GB

Command executed:

printf "%s %s\n" trimmed_001.R1.fastq.gz C1.gz | while read old_name new_name; do [ -f "${new_name}" ] || ln -s $old_name $new_name done

fastqc \ --quiet \ --threads 6 \ C1.gz

cat <<-END_VERSIONS > versions.yml "NFCORE_SMRNASEQ:SMRNASEQ:FASTQC_FASTP:FASTQC_RAW": fastqc: $( fastqc --version | sed -e "s/FastQC v//g" ) END_VERSIONS

Command exit status:

Command output: (empty)

Work dir: /home/ahmed/work/fa/e118641458f2904373c1ec0621907f

Tip: you can try to figure out what's wrong by changing to the process work dir and showing the script file named .command.sh

-- Check '.nextflow.log' file for details

lpantano commented 6 months ago

Hi,

can you share the input sample sheet you are using, please?

Alarabi1980 commented 6 months ago

Hi Lorena,

it worked, I just added this --max_memory 7.GB to the above command and it worked like magic!! Thanks a lot for your support! you are awesome!!

lpantano commented 5 months ago

oh, that is great! let me know if something else happens.