ranking-agent / ranking-agent.github.io

1 stars 0 forks source link

V1. Develop a computational pipeline to validate question enhancement and answer scoring based on curated edges (“shortcuts”) in RDF data sources. #7

Closed jzollars closed 3 years ago

jzollars commented 4 years ago

For example, scoring of clinical outcome pathways should roughly mirror the strength of the associated “treats” edges, if present. As the variety of evidence available to ARAGORN increases, the edge-weighting and scoring algorithm pipeline will by necessity become more complex, and it will be critical to be able to rapidly evaluate proposed algorithmic modifications and optimize algorithm parameters. The existence of a large validation set and efficient evaluation routine will allow rapid iteration on edge-weighting and scoring algorithms, and thereby enable timely incorporation of new and varied evidence sources (KPs) into ARAGORN and Translator. These data and testing infrastructure software will be shared with other Translator teams to aid in their algorithm development and to obtain feedback for the improvement of the shared tools.


Y1 History For example, scoring of clinical outcome pathways should roughly mirror the strength of the associated “treats” edges, if present.