search

Striveworks / valor

Valor is a centralized evaluation store which makes it easy to measure, explore, and rank model performance.
https://striveworks.github.io/valor/
Other
38 stars 4 forks source link

Add smoothing function as a metric parameter for the BLEU text generation metric #741

Open bnativi opened 2 months ago

bnativi commented 2 months ago

The smoothing function parameter was the most important parameter for Nanbo and I when we were researching data drift techniques. I think it will be common for users to not want smoothing and common for users to want smoothing, so I think this should be exposed to the user as an option.

bnativi commented 2 months ago

PR #742 adds the the bleu smoothing function as an evaluation parameter.