tensorflow / nmt

TensorFlow Neural Machine Translation Tutorial
Apache License 2.0
6.38k stars 1.96k forks source link

dev bleu much smaller than test bleu #437

Open shangqing-liu opened 5 years ago

shangqing-liu commented 5 years ago

May I ask a question when I train my own nmt model, the dev bleu is much smaller than test bleu. Why is it caused?

External evaluation, global step 100000

decoding to output ./nmt/lexer_model/output_dev done, num sentences 18462, num translations per input 1, time 124s, Tue Apr 2 10:44:33 2019. bleu dev: 2.6 saving hparams to ./nmt/lexer_model/hparams

External evaluation, global step 100000

decoding to output ./nmt/lexer_model/output_test done, num sentences 18462, num translations per input 1, time 123s, Tue Apr 2 10:46:38 2019. bleu test: 9.3 saving hparams to ./nmt/lexer_model/hparams