search

AIPHES / ACL20-Reference-Free-MT-Evaluation

Reference-free MT Evaluation Metrics
Apache License 2.0
20 stars 5 forks source link

Add remapping matrices for the languages covered by Eval4NLP. #3

Closed potamides closed 2 years ago

potamides commented 3 years ago

Hi there, this pull request provides the missing language pairs for the very recent dataset of the Eval4NLP shared task. The new language pairs are:

Both language pairs were trained on the wikimedia dataset, which is again reflected in the filenames. The Pearson correlations are depicted in the following table: Pearson de-zh ru-de Average
XMoverScore 7.3 44.79 26.05
XMoverScore (UMD) 10.85 48.35 29.6
XMoverScore (CLP) 21.61 52.25 36.93
andyweizhao commented 2 years ago

thanks, @potamides!