Question about bleu evaluation

tensorflow / tensor2tensor

Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

Apache License 2.0

15.6k stars 3.51k forks source link

Question about bleu evaluation #1917

Open shizhediao opened 2 years ago

shizhediao commented 2 years ago

Hi, I am a little bit confused why should we set REFERENCE_TEST_TRANSLATE_DIR=t2t_local_exp_runs_dir_master/t2t_datagen/dev/newstest2014-deen-ref.en.sgm . because in my mind, the reference should be de.sgm. Do you have any idea? Thanks!

martinpopel commented 2 years ago

duplicate of https://github.com/tensorflow/tensor2tensor/issues/1542#issuecomment-1285179919