mozilla / translations

The code, training pipeline, and models that power Firefox Translations
https://mozilla.github.io/translations/
Mozilla Public License 2.0
154 stars 33 forks source link

Publish evals from Taskcluster #519

Closed eu9ene closed 5 months ago

La0 commented 6 months ago

@eu9ene Could you link here all the Taskcluster kind files you want to track ?

eu9ene commented 6 months ago

Everything that starts from "evaluate": https://github.com/mozilla/firefox-translations-training/blob/main/taskcluster/kinds/evaluate-quantized/kind.yml https://github.com/mozilla/firefox-translations-training/blob/main/taskcluster/kinds/evaluate-teacher-ensemble/kind.yml https://github.com/mozilla/firefox-translations-training/blob/main/taskcluster/kinds/evaluate/kind.yml

The goal is to integrate everything we had in the offline publisher.

Also, we should reuse the code from the offline publisher that maps the task label to the training steps to keep the naming consistent.