mozilla / firefox-translations-training

Training pipelines for Firefox Translations neural machine translation models
https://mozilla.github.io/firefox-translations-training/
Mozilla Public License 2.0
145 stars 31 forks source link

Support uploading GCP Taskcluster artifacts to W&B #809

Closed eu9ene closed 3 weeks ago

eu9ene commented 1 month ago

Apparently the format of the uploaded Taskcluster artifacts is slightly different from the old Snakemake experiments. We should make sure we support it so that we can easily reupload the archived task groups in the future.

The artifacts are located in this GCP bucket: gs://moz-fx-translations-data--303e-prod-translations-data

Depends on #808

eu9ene commented 3 weeks ago

If lack of importer was the only issue which we now fixed, I'm closing this one. FYI @vrigal