search

Striveworks / valor

Valor is a centralized evaluation store which makes it easy to measure, explore, and rank model performance.
https://striveworks.github.io/valor/
Other
38 stars 4 forks source link

Fix type issue with valor-core text gen metrics #753

Closed bnativi closed 2 months ago

bnativi commented 2 months ago

Allow text gen metric values to be integers. Most of these metrics are still restricted to be (non-strictly) between 0 and 1.

This fixes a bug where some metrics can throw errors when the score is 0 or 1.