Closed vyraun closed 2 years ago
Hy @vyraun , thanks for the PR! The code looks good to me. Could you please add tests for both metrics before we merge it?
You can have a look at the instructions at https://github.com/GEM-benchmark/GEM-metrics/tree/main/tests & the files in this directory to see how the tests work – it shouldn't be hard to add them.
Thanks @tuetschek ! Sorry for the late reply, I have updated the PR with the tests for both metrics. Please let me know if any other changes would be useful. Thanks.
This PR adds two new metrics to GEM: TTR and Yule's I-Measure, as described in "Machine Translationese: Effects of Algorithmic Bias on Linguistic Complexity in Machine Translation", Vanmassenhove et al., EACL 2021.
Please let me know if any changes would be helpful prior to the integration. Thanks.