Closed leoribeiro closed 2 years ago
The code looks good to me, thanks @leoribeiro ! Could you please also add a test for TER? See https://github.com/GEM-benchmark/GEM-metrics/tree/main/tests for instructions.
Test added.
Kicked off the test. If it passes, we can merge, @tuetschek . Thank you @leoribeiro!
All looks good. Thanks @leoribeiro @sebastianGehrmann !
This PR adds the metric Translation error rate (TER), using the sacrebleu implementation. TER is an error metric for machine translation that measures the number of edits required to change a system output into one of the references.