search

mozilla / translations

The code, training pipeline, and models that power Firefox Translations
https://mozilla.github.io/translations/
Mozilla Public License 2.0
155 stars 34 forks source link

Dig deeper in sentences we translate badly to try and identify common failure themes #228

Open marco-c opened 1 year ago

marco-c commented 1 year ago

For example, by using tools such as compare-mt, or by comparing translations with a “good” known one and sorting by BLEU/COMET.

marco-c commented 1 year ago

Another interesting tool in this space: https://github.com/ondrejklejch/MT-ComparEval.

marco-c commented 10 months ago

We can also use the new eXplainable COMET models for this.

marco-c commented 4 months ago

We could also use the same tools to compare teacher vs student and see if there are common cases where the student fails and the teacher succeeds.