mozilla / translations

The code, training pipeline, and models that power Firefox Translations
https://mozilla.github.io/translations/
Mozilla Public License 2.0
154 stars 33 forks source link

Publish OpusTrainer and Marian logs to W&B logs tab #696

Closed vrigal closed 4 months ago

vrigal commented 4 months ago

Closes #522

Tested from task group N1O85rIASLmCwKfUpCvTlw: https://wandb.ai/teklia/696-da-en

WandB client handles logging from stdout. The inconvenient of this method is that the parser will output all parsed lines at the end of the script, but it is probably the less "hacky" way to do it.

vrigal commented 4 months ago

@eu9ene I simplified parser logs' storage, so we should have all the lines now. I updated results at https://wandb.ai/teklia/696-da-en.

eu9ene commented 4 months ago

@vrigal please resolve conflicts so I can merge. It's likely poetry lock