Support uploading GCP Taskcluster artifacts to W&B

mozilla / translations

The code, training pipeline, and models that power Firefox Translations

https://mozilla.github.io/translations/

Mozilla Public License 2.0

154 stars 33 forks source link

Support uploading GCP Taskcluster artifacts to W&B #809

Closed eu9ene closed 1 month ago

eu9ene commented 2 months ago

Apparently the format of the uploaded Taskcluster artifacts is slightly different from the old Snakemake experiments. We should make sure we support it so that we can easily reupload the archived task groups in the future.

The artifacts are located in this GCP bucket: gs://moz-fx-translations-data--303e-prod-translations-data

Depends on #808

eu9ene commented 1 month ago

If lack of importer was the only issue which we now fixed, I'm closing this one. FYI @vrigal