Visit our web site : http://frogs.toulouse.inrae.fr/
FROGS is a CLI workflow designed to produce and analysis an ASV count matrix from high depth sequencing amplicon data.
FROGS-wrappers allow to add FROGS on a Galaxy instance. (see https://github.com/geraldinepascal/FROGS-wrappers)
This workflow is focused on:
Legend for the next schemas:
.: Complete nucleic sequence
!: Region of interest
*: PCR primers
From: To:
rDNA .........!!!!!!................ ......!!!!!!!!!!!!!!!!!!!.....
Ampl ****!!!!!!**** ****!!!!!!!!!!!!!!!!!!!****
R1 -------------- --------------
R2 -------------- --------------
In any case, the maximum overlap between R1 and R2 can be the complete overlap.
The minimum authorized overlap between R1 and R2 is 10nt. With less, the overlap can be incorrect, it will be rejected or considered as non overlap reads.
rDNA .........!!!!!!................
Ampl ****!!!!!!****
Read --------------
rDNA .....!!!!!!!!!!!!!!............
Ampl ****!!!!!!****
Read --------------
The amplicons can have a high length variability such as ITS. The R1 and R2 can have different length.
This FROGS repository is for command line user. If you want to install FROGS on Galaxy, please refer to FROGS-wrappers.
FROGS is written in Python 3 (with external numpy and Scipy libraries) , uses also home-made scripts written in PERL5 and R 4.
FROGS relies on different specific tools for each of the analysis steps.
FROGS Tools | Dependancy | version tested |
---|---|---|
Denoising and Remove_chimera | vsearch | 2.17.0 |
Denoising | flash (optional) | 1.2.11 |
Denoising | cutadapt (need to be >=2.8) | 2.10 |
Denoising | swarm (need to be >=2.1) | 3.1.4 |
Denoising | DADA2 | 1.22.0 |
ITSx | ITSx | 1.1.2 |
Taxonomic_affiliation | NCBI BLAST+ | 2.10 |
Taxonomic_affiliation | RDP Classifier | 2.0.3 |
Taxonomic_affiliation | EMBOSS needleall | 6.6.0 |
Tree | MAFFT | 7.407 |
Tree | Fasttree | 2.1.9 |
Tree / FROGSSTAT | plotly, phangorn, rmarkdown, phyloseq, DESeq2, optparse, calibrate, formattable, DT | R 4.1.2 |
FROGSSTAT | pandoc | 2.11.3 |
FROGSFUNC | PICRUSt2 | 2.5.1 |
FROGSFUNC | ete3 | 3.1.1 |
PEAR is one of the most effective software for read pairs merging, but as its license is not free for private use, we can not distribute it in FROGS. If you work in an academic lab on a private Galaxy server, or if you have paid your license you can use PEAR in FROGS preprocess. For that you need to:
--merge-software pear
option in the preprocess.py command lineFROGS is now available on bioconda (https://anaconda.org/bioconda/frogs).
conda env create --name frogs@5.0.0 --file frogs-conda-requirements.yaml
# to use FROGS, first you need to activate your environment
conda activate frogs@5.0.0
WARNING : As PICRUSt2 currently relies on a different R version, in order to use the FROGSFUNC tools, it is necessary to create a dedicated conda environment as follows:
conda env create --name frogsfunc@5.0.0 --file frogsfunc-conda-requirements.yaml
# and then activate the environment
conda activate frogsfunc@5.0.0
After that, you just have to switch from one environment to another (with conda activate frogs@5.0.0
or conda activate frogsfunc@5.0.0
depending on whether you want to use FROGSFUNC or all the other tools.
To check your installation you can type:
cd <conda_env_dir>/frogs@5.0.0/share/FROGS-5.0.0/test
conda activate frogs@5.0.0
sh test_frogs.sh <NB_CPU> <JAVA_MEM> <OUT_FOLDER>
"Bioinformatic" tools are performed on a small simulated dataset of one sample replicated three times. "Statistical" tools are performed on an extract of the published results of Chaillou et al, ISME 2014
This test executes the FROGS tools in command line mode. Example:
[user@computer:/home/frogs/FROGS/test/]$ sh test_frogs.sh 1 2 res
Step demultiplex jeu. 02 mai 2024 17:54:17 CEST
Step denoising 16S vsearch jeu. 02 mai 2024 17:54:21 CEST:
Step denoising 16S pear jeu. 02 mai 2024 17:54:37 CEST:
Step denoising: dada2 keep-unmerged jeu. 02 mai 2024 17:55:48 CEST
Step denoising: preprocess only jeu. 02 mai 2024 17:57:10 CEST
Step remove_chimera jeu. 02 mai 2024 17:57:13 CEST
Step cluster_filters jeu. 02 mai 2024 17:57:15 CEST
Step itsx jeu. 02 mai 2024 17:57:19 CEST
Step taxonomic_affiliation jeu. 02 mai 2024 17:57:24 CEST
Step affiliation_filters: masking mode jeu. 02 mai 2024 17:57:32 CEST
Step affiliation_filters: deleted mode jeu. 02 mai 2024 17:57:34 CEST
Step affiliation_postprocess jeu. 02 mai 2024 17:57:35 CEST
Step normalisation jeu. 02 mai 2024 17:57:36 CEST
Step cluster_stats jeu. 02 mai 2024 17:57:41 CEST
Step affiliation_stats jeu. 02 mai 2024 17:57:42 CEST
Step biom_to_tsv jeu. 02 mai 2024 17:57:43 CEST
Step biom_to_stdBiom jeu. 02 mai 2024 17:57:44 CEST
Step tsv_to_biom jeu. 02 mai 2024 17:57:44 CEST
Step tree jeu. 02 mai 2024 17:57:45 CEST
Step phyloseq_import_data jeu. 02 mai 2024 17:58:00 CEST
Step phyloseq_composition jeu. 02 mai 2024 17:59:40 CEST
Step phyloseq_alpha_diversity jeu. 02 mai 2024 18:00:02 CEST
Step phyloseq_beta_diversity jeu. 02 mai 2024 18:00:25 CEST
Step phyloseq_structure jeu. 02 mai 2024 18:00:44 CEST
Step phyloseq_clustering jeu. 02 mai 2024 18:01:02 CEST
Step phyloseq_manova jeu. 02 mai 2024 18:01:17 CEST
Step deseq2_preprocess jeu. 02 mai 2024 18:01:32 CEST
DESeq2 asv abundances
DESeq2 function abundances
Step deseq2_visualisation jeu. 02 mai 2024 18:03:02 CEST
DESeq2 otu abundances
DESeq2 function abundances
Completed with success
Finally, to check the FROGSFUNC tools installation you can type:
cd <conda_env_dir>/frogsfunc@5.0.0/share/FROGS-5.0.0/test
conda activate frogsfunc@5.0.0
sh test_frogsfunc.sh <OUT_FOLDER>
This test executes the FROGSFUNC tools in command line mode. Example:
[user@computer:/home/frogs/FROGS/test/]$ sh test_frogsfunc.sh res
Step frogsfunc_placeseqs jeu. 02 mai 2024 18:32:19 CEST
Step frogsfunc_functions jeu. 02 mai 2024 18:33:49 CEST
Step frogsfunc_pathways jeu. 02 mai 2024 18:36:32 CEST
Completed with success
If you have more than one CPU, it is recommended to increase the number of CPUs used by tools. All the CPUs must be on the same computer/node.
Tool | RAM per CPU | Minimal RAM | Configuration example |
---|---|---|---|
Denoising | 8Gb | 10 Gb | 12 CPUs and 96 GB |
ITSx / Remove_Chimera | 3Gb | 5Gb | 12 CPUs and 36 GB |
Taxonomic_affiliation | - | 20 Gb | 30 CPUs and 300 GB |
Reference databanks are needed to filter contaminants, assign taxonomy to each ASV or filter ambiguities for hyper variable amplicon length.
We propose some databanks, that you simply need to download and extract.
Please take time to read individual README.txt and LICENCE.txt files.
Assignation databank
these databanks are formatted for NCBI Blast+ and RDP Classifier
available databases : http://genoweb.toulouse.inra.fr/frogs_databanks/assignation
Contaminant databank
these banks are formatted for NCBI Blast+
http://genoweb.toulouse.inrae.fr/frogs_databanks/contaminants
Hyper variable in length amplicon databank
This is simply fasta file.
In addition, several default databases are used in FROGSFUNC steps by PICRUSt2.
With some old versions of glibc the virtual memory used by CPU is multiplicative.
Nb CPUs | expected RAM consumtion | observed RAM consumption |
---|---|---|
1 | 1 Gb | 1Gb |
2 | 2 Gb | 2*2 Gb |
3 | 3 Gb | 3*3 Gb |
4 | 4 Gb | 4*4 Gb |
The parameters memory and CPU provided in examples take into account this problem.
GNU GPL v3
2024 INRAE
Depending on which type of amplicon you are working on (mergeable or unmergeable), please cite one of the two FROGS publications:
frogs-support@inrae.fr