achimr / mteval

Library to automate machine translation evaluation
https://achimr.github.io/mteval/
Apache License 2.0
4 stars 0 forks source link

COMET unit testing doesn't run in Github Actions #2

Open achimr opened 1 year ago

achimr commented 1 year ago

COMET unit testing has to be run with GPU. Github Actions doesn't provide GPU instances for testing. It is possible to run actions on self-hosted runners, but setting this up is very involved.

The easier workaround is to run unit tests with nbdev_test on a local Jupyter notebook instance (with GPU support) or on Google Colab (with GPU runtime).