ChengyueGongR / advsoft

Language Model Baselines for PyTorch
42 stars 4 forks source link

Got huge drop in bleu scores in translation #2

Open SefaZeng opened 4 years ago

SefaZeng commented 4 years ago

I use the same methods in the code, but change to tensorflow. And I dont add noise in the input embedding, I got huge drop in the bleu scores. Actually, it seems the model doesnt tent to converge. Is there any difference about the adv training between lm and translation? Any help is appreciate! Thx!