output_dev and output_test with all <unk>

daniel-kukiela / nmt-chatbot

NMT Chatbot

GNU General Public License v3.0

385 stars 213 forks source link

output_dev and output_test with all <unk> #97

Open jacklooi96 opened 5 years ago

jacklooi96 commented 5 years ago

Hi, I stopped training the bot at global step 480, 000....but when I checked the output_dev and output_test files....I found that there are only "unk" token in both the files. Is there any problem with that?

daniel-kukiela commented 5 years ago

It means that something went wrong. What training data are you using?

jacklooi96 commented 5 years ago

I used reddit 2018-06 data.

daniel-kukiela commented 5 years ago

It looks like you have used a dictionary file from other dataset, hmmm. Is it possible? Or you were trying to train with that data only?