preplexity value increase raise when the training epochs over 3

huggingface / transfer-learning-conv-ai

🦄 State-of-the-Art Conversational AI with Transfer Learning

MIT License

1.73k stars 431 forks source link

preplexity value increase raise when the training epochs over 3 #50

Closed kangzhonghua closed 4 years ago

kangzhonghua commented 4 years ago

I have tested many times and PPL value up grow when epochs over 3. I have question, number of training epochs 3 is the best? Please give us your advice.

training

kangzhonghua commented 4 years ago

personachat_self_original dataset

sshleifer commented 4 years ago

Seems like 3 epochs is good!

kangzhonghua commented 4 years ago

Think you for your reply!