search

dewittpe / qwraps2

An updated version of qwraps with a focus on flexibility and general purpose. These functions are helpful for extracting and formatting results from R into .Rnw or .Rmd files. Additional functions for routine work such as extracting results from regression models or finding sensitivity and specificity.
http://www.peteredewitt.com/qwraps2/
GNU General Public License v3.0
37 stars 7 forks source link

Sensitivity, PPV, F1 when there are no true positives. #88

Closed dewittpe closed 4 years ago

dewittpe commented 4 years ago

F1, defined has the harmonic mean of precision (PPV) and recall (sensitivity) is ill defined if TP are zero.

Implement the following from DICE Group

In some rare cases, the calculation of Precision or Recall can cause a division by 0. Regarding the precision, this can happen if there are no results inside the answer of an annotator and, thus, the true as well as the false positives are 0. For these special cases, we have defined that if the true positives, false positives and false negatives are all 0, the precision, recall and F1-measure are 1. This might occur in cases in which the gold standard contains a document without any annotations and the annotator (correctly) returns no annotations. If true positives are 0 and one of the two other counters is larger than 0, the precision, recall and F1-measure are 0.

dewittpe commented 4 years ago

Done, added to the documentation and implementation for the confusion_matrix