mozilla / translations

The code, training pipeline, and models that power Firefox Translations
https://mozilla.github.io/translations/
Mozilla Public License 2.0
155 stars 34 forks source link

Switch bestbleu to chrF #908

Closed eu9ene closed 2 weeks ago

eu9ene commented 3 weeks ago

chrF is now considered more reliable than BLEU, and should work better for CJK Based on advice from #748

+unify sacrebleu and mtdata versions everywhere +update config generator and skip some datasets there (it's not final though)

closes #748 closes #911