ondrejklejch / MT-ComparEval

Tool for comparison and evaluation of machine translation.
Apache License 2.0
56 stars 14 forks source link

Configurable case-sensitivity and bootstrap per metric #51

Closed martinpopel closed 9 years ago

martinpopel commented 9 years ago

In config.neon, you can now setup which metrics should be case sensitive and for which metrics a bootstrap resampling significance should be computed:

BLEU-cis: [
   class: @bleuMetric,
   case_sensitive: False,
   compute_bootstrap: True,
],
BLEU: [
   class: @bleuMetric,
   case_sensitive: True,
   compute_bootstrap: False,
],