search

Striveworks / valor

Valor is a centralized evaluation store which makes it easy to measure, explore, and rank model performance.
https://striveworks.github.io/valor/
Other
38 stars 4 forks source link

BUG: Incorrect F1 reported. #808

Closed czaloom closed 1 month ago

czaloom commented 1 month ago

valor version checks

Reproducible Example

F1 score computation is missing a scaling factor.

Issue Description

Current F1 Formula
(Precision * Recall) / (Precision + Recall)
Actual F1 Formula
(2 * Precision * Recall) / (Precision + Recall)

Expected Behavior

F1 should be correct.