Hi,
I am trying to using pretrained word embeddings as input for my model.
I made sure that the embeddings are loaded correctly.
However the model cannot learn anything when using these embeddings! Which is totally strange.
For the very first evaluation before the training starts, the model chooses random words, which is ok. Afterwords, all the model chooses is basically and sometimes some words like "the", "is", "to". Therefore the bleu score is always zero.
Any suggestions what the reason could be?
Thanks
Hi, I am trying to using pretrained word embeddings as input for my model. I made sure that the embeddings are loaded correctly. However the model cannot learn anything when using these embeddings! Which is totally strange. For the very first evaluation before the training starts, the model chooses random words, which is ok. Afterwords, all the model chooses is basically and sometimes some words like "the", "is", "to". Therefore the bleu score is always zero.
Any suggestions what the reason could be?
Thanks