Training for IMDB - Running out of patience

allenai / vampire

Variational Methods for Pretraining in Resource-limited Environments

Apache License 2.0

174 stars 33 forks source link

Training for IMDB - Running out of patience #64

Closed monkeysforever closed 4 years ago

monkeysforever commented 4 years ago

I am trying to train for the IMDB dataset, but only after a few epochs the training ends with the message Ran out of patience, which i guess is from early stopping. Can you recommend any hyperparamters I need to adjust to improve training?

kernelmachine commented 4 years ago

I assume you are talking about training VAMPIRE. I would try adjusting the learning rate, vocab size, hidden size of the model. Learning rate will probably have the biggest impact on how long you train for.

monkeysforever commented 4 years ago

thanks