amazon-science / contrastive-controlled-mt

Code and data for the IWSLT 2022 shared task on Formality Control for SLT
Other
21 stars 6 forks source link

Add formality classifier evaluation script. #8

Closed erip closed 1 year ago

erip commented 1 year ago

This adds the script to compute the predicted accuracy of a system output relative to a target formality using the formality classifier. Instructions are included for using the included script intended for self-service eval.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.