linqs / psl

The PSL software from the University of Maryland and the University of California Santa Cruz
http://psl.linqs.org
Apache License 2.0
298 stars 100 forks source link

Develop #262

Closed dickensc closed 4 years ago

dickensc commented 4 years ago

RankingEvaluator.java: New MAP, DCG, and NDCG evaluation metrics

RankingEvaluatorTest.java: New MAP, DCG, and NDCG test methods. TODO, should probably expand on these tests

TrainingMap.java: Added optional argument, createOnGet to the training map constructor.

This is to add the option to build an evaluator that only considers the results of the predicates in the truth partition, otherwise, the default truth value is used to evaluate unmatched targets, which throws off MAP, and NDCG evaluation.

When createOnGet is set to false then the inferred predicates without truth values are considered latent.