microsoft / MASS

MASS: Masked Sequence to Sequence Pre-training for Language Generation
https://arxiv.org/pdf/1905.02450.pdf
Other
1.12k stars 206 forks source link

Hyperparameter for low-resource experiment #136

Open yukiyakiZ opened 4 years ago

yukiyakiZ commented 4 years ago

Could you share the full command (and default hyperparameters) you used for low-resource experiment in your paper? In the MASS paer, you achieved a BLEU4 higher than 10 in ro-en MT with 10k sentences. However, I could not test hyperparameters that will reproduce similar results. Thanks!