Improve GPU utilization for "translate" tasks

mozilla / firefox-translations-training

Training pipelines for Firefox Translations neural machine translation models

Mozilla Public License 2.0

142 stars 31 forks source link

Open eu9ene opened 1 month ago

eu9ene commented 1 month ago

Currently, it's ~70%. We could try using a bigger batch but it also depends on language.

eu9ene commented 1 month ago

It appears to be even lower for translate-corpus: GCP console

@gregtatum FYI

gregtatum commented 1 month ago

Is it possible to dynamically determine this value? Like run N translations, measure and adjust?