mozilla / translations

The code, training pipeline, and models that power Firefox Translations
https://mozilla.github.io/translations/
Mozilla Public License 2.0
155 stars 34 forks source link

[meta] Kick off a 2024-H2 training run #912

Open gregtatum opened 3 weeks ago

gregtatum commented 3 weeks ago

We'd like to kick off another training run to fix quality issues in spring-2024 where the models weren't shippable and pick up a few languages we skipped. This meta issue will collect issues I'd like to get done before kicking it off. Also I'd like to incorporate more cost saving work.

This does not cover CJK.

### Tasks
- [ ] #165
- [ ] BLOCKING [MozIntGemm is not working for larger translation models](https://bugzilla.mozilla.org/show_bug.cgi?id=1926100)
- [ ] #894
- [ ] #778
- [ ] #785
- [ ] #783
- [ ] #905
Name To "en" Release From "en" Release
Russian -2.67 Released -5.23 Nightly
Hungarian -2.55 Released -4.50 Nightly
Slovak -2.77 Released -5.71 Nightly
Arabic
Hebrew
Serbian -3.56 Released
Vietnamese -2.91 Released
Latvian -3.38 Released -5.10 Nightly
Persian -6.05 Nightly -9.17 Nightly
Lithuanian -3.22 Released -5.82 Nightly
Ukrainian -3.18 Released -4.68 Nightly
Bosnian -7.81 Nightly