Use start and end index for confidence score

deepset-ai / FARM

:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

https://farm.deepset.ai

Apache License 2.0

1.73k stars 247 forks source link

Closed julian-risch closed 3 years ago

julian-risch commented 3 years ago

Up to now, FARM has been using only the logit of the start index of the answer to calculate the confidence score.

With this PR, FARM now uses the mean of the confidence scores of start and end index.

closes #816