mozilla / translations

The code, training pipeline, and models that power Firefox Translations
https://mozilla.github.io/translations/
Mozilla Public License 2.0
154 stars 33 forks source link

Parse evaluation data from .metrics artifacts in taskcluster #565

Closed vrigal closed 5 months ago

vrigal commented 5 months ago

Closes #518

Example with Taskcluster group KYZvXC6jTPG7A4j80SrYlQ: https://wandb.ai/teklia/565-lt-en

eu9ene commented 5 months ago

Closes #518

Example with Taskcluster group KYZvXC6jTPG7A4j80SrYlQ: https://wandb.ai/teklia/565-lt-en

I don't know if it's related to this fix, but I noticed that the teacher is called teacher and not teacher-1 which will make it hard to compare with other runs.

vrigal commented 5 months ago

The teacher-1 run is only mentioned as teacher on Taskcluster. @eu9ene could you fill an issue with the required renaming(s) please ?

eu9ene commented 5 months ago

The teacher-1 run is only mentioned as teacher on Taskcluster. @eu9ene could you fill an issue with the required renaming(s) please ?

ok, I filed https://github.com/mozilla/firefox-translations-training/issues/573