Open varisd opened 4 months ago
Current version of the EvaluationStep only supports automatic Sacrebleu metrics. We want to add additional support for COMET (which was used during the D5.1 evaluation).
It should likely be based on the code from the deliverable repo.
Current version of the EvaluationStep only supports automatic Sacrebleu metrics. We want to add additional support for COMET (which was used during the D5.1 evaluation).
It should likely be based on the code from the deliverable repo.