Open nabihach opened 8 years ago
Hi, the problem is with the embeddings.. I am working on an example chatbot for seq2seq, will take some time.
I see. I look forward to your example. Meanwhile, I will try other embeddings to see if it improves the results. Thanks!
@farizrahman4u Hi, I ran into the same problem here. Any suggestion or any update on this matter?
Thanks.
I came up with the following sanity check to ensure that the implementation and word embeddings etc are good.
I created a dataset of 100,000 lines, that has the following 6 lines repeated over and over again:
I then ran your code with the following parameters and model:
After 10 data passes, my result look like this:
So basically, the sanity check fails. The model can't even learn the answer to these 6 lines, even though they were repeated so many times. Does anyone know why this is happening? What could be the problem?