Publish experiment config from taskcluster training task (group_logs)

mozilla / translations

The code, training pipeline, and models that power Firefox Translations

https://mozilla.github.io/translations/

Mozilla Public License 2.0

154 stars 33 forks source link

Publish experiment config from taskcluster training task (group_logs) #602

Closed vrigal closed 5 months ago

vrigal commented 5 months ago

Based on #598

Closes #521

eu9ene commented 5 months ago

@vrigal it's this issue again #527. Could you remove this line so that we can test it on CI?

https://github.com/mozilla/firefox-translations-training/blob/c3ad3a4837184a2d82d0e4f0bcf0b7a977ed59c0/taskcluster/translations_taskgraph/parameters.py#L83

eu9ene commented 5 months ago

Depends on #611 to start CI

vrigal commented 5 months ago

Config publication fails because no experiment configuration is found in the CI task group (the script is looking at extra.action.context.input in task group). Otherwise it should be fine I think.

Config could not be read at /tmp/tmpepz6spwv/experiments/ru-en/ci_YhDt4D_wTM2xGIDSLKPS-Q/config.yml: 'NoneType' object is not iterable

eu9ene commented 5 months ago

Also, the linter fails, you should do task lint-fix

eu9ene commented 5 months ago

Ok, I tested it from the Train action and the config is being published from the first training task. @vrigal I also moved the publishing before the training starts so that we can see the config right away.