njallskarp / finetune-qa-powerset

Finetuning BERT models on a powerset of different linguistic domains
https://lvl.ru.is/
5 stars 0 forks source link

Functions that compute metrics #16

Closed njallskarp closed 1 year ago

njallskarp commented 1 year ago

Metrics Functions

We need a function that can evaluate a model and, given a test dataset, calculates the following aggregate metrics: