QACandidates contain score and confidence fields but only score was used to rank QACandidates so far.
This PR makes ranking QACandidates by score the default but also allows to set use_confidence_scores_for_ranking in QAPredictionHead, which activates ranking
QACandidates by confidence.
I think, it's better to keep both fields, score and confidence in QACandidates instead of dropping one of them entirely. Thereby, we are more flexible and allow backwards compatibility.
A new test case checks that results are ranked as expected with and without setting use_confidence_scores_for_ranking.
QACandidatescontainscoreandconfidencefields but onlyscorewas used to rankQACandidatesso far. This PR makes rankingQACandidatesby score the default but also allows to setuse_confidence_scores_for_rankinginQAPredictionHead, which activates rankingQACandidatesbyconfidence.I think, it's better to keep both fields,
scoreandconfidenceinQACandidatesinstead of dropping one of them entirely. Thereby, we are more flexible and allow backwards compatibility.A new test case checks that results are ranked as expected with and without setting
use_confidence_scores_for_ranking.closes #808