loss sometimes jumpes to 200

[yzho0907]

my params are { "cell_type": "lstm", "depth": 2, "attention_type": "Luong", "bidirectional": true, "use_residual": true, "use_dropout": false, "time_major": true, "hidden_units": 1024, "optimizer": "adam", "learning_rate": 0.001 } and i am using fasttext pre-trained word2vec as well batch size is 128 which i haven't changed it. But the loss is always fluctuating and sometimes jumps to a huge number (200), it usually started as 10-20. It's cuz this version of seq2seq add a part of reinforcement learning? plz tell u how to fix it?

[yzho0907]

我把词向量去掉，把参数调到默认，loss有时候也会跳到一个很大的数字，请问下怎么解决啊？训练出来的对话也完全不对。

[yzho0907]

训练轮数增加后loss就会变的很巨大，请问有什么办法可以解决嘛？