If a metric is not installed (e.g., a metric like MoverScore might not have the necessary pip packages installed, and therefore will not work), the metric-specific command gives a really unhelpful error about missing arguments. It should instead crash with a message saying the metric is not installed.
If a metric is not installed (e.g., a metric like
MoverScore
might not have the necessary pip packages installed, and therefore will not work), the metric-specific command gives a really unhelpful error about missing arguments. It should instead crash with a message saying the metric is not installed.