LiyuanLucasLiu / Transformer-Clinic

Understanding the Difficulty of Training Transformers
https://arxiv.org/abs/2004.08249
Apache License 2.0
326 stars 20 forks source link

IWSLT'14 Results #12

Closed villmow closed 3 years ago

villmow commented 3 years ago

Hi, very nice paper, I like it! I have a question regarding your results on IWSLT'14. Are these values tokenized BLEU on dev or test set?

Dataset IWSLT’14 De-En Enc #–Dec # 6L–6L (small) Post-LN 35.64 ± 0.23 Pre-LN 35.50 ± 0.04 Admin 35.67 ± 0.15

LiyuanLucasLiu commented 3 years ago

Thanks for your attention, glad you enjoy the paper : -) The results on IWSLT'14 are on the test set.