Fix DetailedPRCurve examples for classification tasks

Striveworks / valor

Valor is a centralized evaluation store which makes it easy to measure, explore, and rank model performance.

https://striveworks.github.io/valor/

Other

38 stars 4 forks source link

Closed ntlind closed 2 months ago

ntlind commented 2 months ago

Ensure that we're correctly accounting for all types of true negatives when pulling examples for DetailedPrecisionRecallCurve, fixing #739
Add a check to make sure we don't pass any examples when the count of a PR category is zero, fixing #737
Add tests to check for these issues
Confirm that benchmarks are unaffected by change