evaluate-* is the slowest step in CI, as it's having to download nvidia cudnn and torch

mozilla / translations

The code, training pipeline, and models that power Firefox Translations

https://mozilla.github.io/translations/

Mozilla Public License 2.0

154 stars 33 forks source link

Open gregtatum opened 1 month ago

gregtatum commented 1 month ago

task	runtime
evaluate-backward-flores-devtest-ru-en	16m
evaluate-teacher-ensemble-flores-devtest-ru-en	18m

nvidia cudnn - 3 min install torch - 3 min install

Can we do some of these installs in a docker image to speed up the task time? It's nice to have faster CI runs.