genome-nexus / genome-nexus-annotation-pipeline

Library and tool for annotating MAF files using Genome Nexus Webserver API
MIT License
8 stars 25 forks source link

Genome Nexus Annotation Pipeline

Annotation of genomic variants from a MAF for import into the cBioPortal using Genome Nexus.

MAF Annotation

The annotationPipeline module is a command line tool to annotate a maf using genome nexus.

Build From Source

  1. Create application.properties file:

    cp annotationPipeline/src/main/resources/application.properties.EXAMPLE annotationPipeline/src/main/resources/application.properties

    [!TIP] If you have your own installation of Genome Nexus, you can point to it by modifying the genomenexus.base=<URL> in application.properties

  2. Create log4j.properties:

cp annotationPipeline/src/main/resources/log4j.properties.console.EXAMPLE annotationPipeline/src/main/resources/log4j.properties

Build

mvn clean install

Run Annotate

To use it, build the project using maven and run it like so:

java -jar annotationPipeline/target/annotationPipeline-*.jar \
    --filename <INPUT_MAF> \
    --output-filename <OUTPUT DESTINATION> \
    --isoform-override <mskcc or uniprot>

To output error reporting to a file, supply the -e option a location for the file to be saved. By running the jar without any arguments or by providing the optional parameter -h you can view the full usage statement.

Annotate with Docker

Genome Nexus Annotation Pipeline is available on DockerHub: https://hub.docker.com/r/genomenexus/gn-annotation-pipeline.

Usage instruction

docker pull genomenexus/gn-annotation-pipeline:master 
docker run -v ${PWD}:/wd genomenexus/gn-annotation-pipeline:master java -jar annotationPipeline.jar --filename /wd/input.txt  --output-filename /wd/output.txt

Logging

[!IMPORTANT] Logging via docker has been changed to stdout by default since v1.0.4

Optional parameters

Short Long Description
-h --help shows this help document and quits
-f --filename Mutation filename
-o --output-filename Output filename (including path)
-t --output-format extended, minimal or a file path which includes output format (FORMAT EXAMPLE: Chromosome,Hugo_Symbol,Entrez_Gene_Id,Center,NCBI_Build)
-i --isoform-override Isoform Overrides. Options: mskcc or uniprot
-e --error-report-location Error report filename (including path)
-r --replace-symbol-entrez Replace gene symbols and entrez id with what is provided by annotator, this is enabled by default
-p --post-interval-size Number of records to make POST requests to Genome Nexus with at a time
-s --strip-matching-bases Strip matching allele bases. Options: first, all, none. For example: AAC/AAT, strip-off first: AC/AT, strip-off all: C/T, strip-off none: AAC/AAT
-a --add-original-genomic-location Add original genomic location data columns into the output, name columns with prefix 'IGNORE_Genome_NexusOriginal'). This would be useful if saving a reference of original input is needed and won't be changed in any condition
-d --ignore-original-location Genome-nexus-annotation-pipeline reads original genomic location info as input by default, if not existing, reading from normal genomic location info columns. Adding -d ignores original genomic location info columns (columns with prefix 'IGNORE_Genome_NexusOriginal') and only use whatever in normal genomic location info columns. This would be helpful if you'd like to stick with current genomic location info columns.

Reference Genome

The Genome Nexus Annotation Pipeline supports two versions of the human genome reference assembly:

  1. GRCh37 (default)
  2. GRCh38

[!NOTE] By default, the pipeline uses GRCh37.

Using GRCh38

If you want to annotate with GRCh38, please set the GENOMENEXUS_BASE environment variable to https://grch38.genomenexus.org. Here's an example of how to do this:

docker run -e GENOMENEXUS_BASE=https://grch38.genomenexus.org -v ${PWD}:/wd genomenexus/gn-annotation-pipeline:master --filename /wd/input.txt --output-filename /wd/output.txt --isoform-override uniprot

Annotation fields

Field Source Note
Hugo_Symbol
Entrez_Gene_Id
Center
NCBI_Build
Chromosome GN response / Input
Start_Position GN response / Input
End_Position GN response / Input
Strand
Consequence
Variant_Classification
Variant_Type
Reference_Allele GN response / Input
Tumor_Seq_Allele1
Tumor_Seq_Allele2 GN response / Input
dbSNP_RS
dbSNP_Val_Status
Tumor_Sample_Barcode
Matched_Norm_Sample_Barcode
Match_Norm_Seq_Allele1
Match_Norm_Seq_Allele2
Tumor_Validation_Allele1
Tumor_Validation_Allele2
Match_Norm_Validation_Allele1
Match_Norm_Validation_Allele2
Verification_Status
Validation_Status
Mutation_Status
Sequencing_Phase
Sequence_Source
Validation_Method
Score
BAM_File
Sequencer
t_ref_count
t_alt_count
n_ref_count
n_alt_count
HGVSc
HGVSp
HGVSp_Short
Transcript_ID
RefSeq VEP
Protein_position VEP
Codons VEP
Exon_Number VEP
gnomAD_AF myvariant.info Need to add "my_variant_info" in "genomenexus.enrichment_fields"
gnomAD_AFR_AF myvariant.info Need to add "my_variant_info" in "genomenexus.enrichment_fields"
gnomAD_AMR_AF myvariant.info Need to add "my_variant_info" in "genomenexus.enrichment_fields"
gnomAD_ASJ_AF myvariant.info Need to add "my_variant_info" in "genomenexus.enrichment_fields"
gnomAD_EAS_AF myvariant.info Need to add "my_variant_info" in "genomenexus.enrichment_fields"
gnomAD_FIN_AF myvariant.info Need to add "my_variant_info" in "genomenexus.enrichment_fields"
gnomAD_NFE_AF myvariant.info Need to add "my_variant_info" in "genomenexus.enrichment_fields"
gnomAD_OTH_AF myvariant.info Need to add "my_variant_info" in "genomenexus.enrichment_fields"
gnomAD_SAS_AF myvariant.info Need to add "my_variant_info" in "genomenexus.enrichment_fields"
MA:FIS Mutation Assessor Need to add "mutation_assessor" in "genomenexus.enrichment_fields"
MA:FImpact Mutation Assessor Need to add "mutation_assessor" in genomenexus.enrichment_fields"
MA:link.MSA Mutation Assessor Need to add "mutation_assessor" in "genomenexus.enrichment_fields"
MA:link.PDB Mutation Assessor Need to add "mutation_assessor" in "genomenexus.enrichment_fields"
Polyphen_Prediction Polyphen Need to add "polyphen" in "genomenexus.enrichment_fields"
Polyphen_Score Polyphen Need to add "polyphen" in "genomenexus.enrichment_fields"
SIFT_Prediction SIFT Need to add "sift" in "genomenexus.enrichment_fields"
SIFT_Score SIFT Need to add "sift" in "genomenexus.enrichment_fields"
Ref_Tri Need to add "nucleotide_context" in "genomenexus.enrichment_field"
Var_Tri Need to add "nucleotide_context" in "genomenexus.enrichment_field"
oncokb_geneExist OncoKb Need to add "oncokb" in "genomenexus.enrichment_fields" and provide your OncoKB token in "oncokb.token"
oncokb_highestDXLevel OncoKb Need to add "oncokb" in "genomenexus.enrichment_fields" and provide your OncoKB token in "oncokb.token"
oncokb_highestPXLevel OncoKb Need to add "oncokb" in "genomenexus.enrichment_fields" and provide your OncoKB token in "oncokb.token"
oncokb_highestResistanceLevel OncoKb Need to add "oncokb" in "genomenexus.enrichment_fields" and provide your OncoKB token in "oncokb.token"
oncokb_highestSensitiveLevel OncoKb Need to add "oncokb" in "genomenexus.enrichment_fields" and provide your OncoKB token in "oncokb.token"
oncokb_mutationEffect OncoKb Need to add "oncokb" in "genomenexus.enrichment_fields" and provide your OncoKB token in "oncokb.token"
oncokb_mutationEffectCitations OncoKb Need to add "oncokb" in "genomenexus.enrichment_fields" and provide your OncoKB token in "oncokb.token"
oncokb_oncogenic OncoKb Need to add "oncokb" in "genomenexus.enrichment_fields" and provide your OncoKB token in "oncokb.token"
oncokb_variantExist OncoKb Need to add "oncokb" in "genomenexus.enrichment_fields" and provide your OncoKB token in "oncokb.token"
Annotation_Status FAILED / SUCCESS

Add additional annotation columns

Genome Nexus supports additional annotation columns with the setting of "enrichment_fields". The configuration for these enrichment fields is managed through the application.properties file, please refer to Pre-build steps section.

To configure the enrichment fields, you need to include the desired field names from the provided list in the -Dgenomenexus.enrichment_fields= parameter of the command line, or directly add field names in genomenexus.enrichment_fields= in application.properties file. Multiple field names can be specified by separating them with commas. annotation_summary is highly recommended to add as default since it's crucial for lots of annotation fields.

Example:

java -Dgenomenexus.enrichment_fields=annotation_summary,my_variant_info \
    -jar annotationPipeline/target/annotationPipeline-*.jar \ 
    -r \ 
    --filename test/data/minimal_example.in.txt \ 
    --output-filename test/data/minimal_example.out.uniprot.txt \ 
    --isoform-override uniprot
Available enrichment fields:

Minimal MAF Example

For an example minimal input file see test/data/minimal_example.in.txt and corresponding output test/data/minimal_example.out.uniprot.txt. The output file was generated with:

$JAVA_HOME/bin/java -jar annotationPipeline/target/annotationPipeline-*.jar \
    -r \
    --filename test/data/minimal_example.in.txt  \
    --output-filename test/data/minimal_example.out.uniprot.txt \
    --isoform-override uniprot

Direct Database Annotation

There used to be a utility/module called databaseAnnotator which could be used to annotate database records which were already loaded into a cBioPortal database. This module was not being maintained and has been removed (code is still reachable through git history).

Annotator

The annotator module is the client code that makes calls to the Genome Nexus server and interprets the response. The annotationPipeline module uses this as a dependency.

Updating the Genome Nexus Annotation Pipeline

The annotation pipeline uses models brought in by the auto-generated genome-nexus-java-api-client here and here .

In the event of an update to the Genome Nexus server (e.g adding to an existing model), the genome-nexus-java-api-client must be regenerated and propagated to this codebase. To generate the newest genome-nexus-java-api-client, refer to instructions here.

Once updated, update the pom with the newest commit hash from the genome-nexus-java-api-client codebase.