When training a model with --valid-metrics chrf ce-mean-words bleu-detok it seems like the development set is translated fully twice, in order to calculate the chrf and bleu-detok separately.
How to reproduce
Train a model with --valid-metrics chrf ce-mean-words bleu-detok
Bug description
When training a model with
--valid-metrics chrf ce-mean-words bleu-detok
it seems like the development set is translated fully twice, in order to calculate thechrf
andbleu-detok
separately.How to reproduce
Train a model with
--valid-metrics chrf ce-mean-words bleu-detok
Context
Log
*The reason there's
chrf
twice is a bug in browsermt, now fixed.