Question about bleu evaluation

tensorflow / tensor2tensor

Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

Apache License 2.0

15.1k stars 3.44k forks source link

Question about bleu evaluation #1917

Open shizhediao opened 1 year ago

shizhediao commented 1 year ago

Hi, I am a little bit confused why should we set REFERENCE_TEST_TRANSLATE_DIR=t2t_local_exp_runs_dir_master/t2t_datagen/dev/newstest2014-deen-ref.en.sgm . because in my mind, the reference should be de.sgm. Do you have any idea? Thanks!

martinpopel commented 1 year ago

duplicate of https://github.com/tensorflow/tensor2tensor/issues/1542#issuecomment-1285179919