Always responding with "i dont know"

fawazsammani / chatbot-transformer

Building a Chatbot in PyTorch using Transformers

125 stars 53 forks source link

Always responding with "i dont know" #1

Closed jafioti closed 3 years ago

jafioti commented 3 years ago

Hi, I have tried to train a model with your code and the cornell movie dialogue dataset, and after training for 9 epochs, the only thing it outputs is "i dont know" regardless of input. Not sure if you are seeing the same thing.

fawazsammani commented 3 years ago

this problem used to happen in the old version because the masks were wrong. But i have corrected it in some previous commit if i recall correctly. The problem isnt happening anymore and the output is quite good.

huwprosser commented 3 years ago

Hi there, after 8 epochs the bot is still saying "I don't know" despite being on latest commit.