How to continue the finetuning?

kamalkraj / ALBERT-TF2.0

ALBERT model Pretraining and Fine Tuning using TF2.0

Apache License 2.0

199 stars 45 forks source link

How to continue the finetuning? #12

Closed loginaway closed 4 years ago

loginaway commented 4 years ago

Hi,

I have finetuned the base_2 model on squad2.0 for 3 epochs. Now I would like to continue the training process for another several epochs, and when I run the training instruction, the training process immediately ended. What option should I add to continue the finetuning?

Thanks!

kamalkraj commented 4 years ago

increase the num epochs in the parameters. Increase it to 6, so that it will run for 3 more epochs. the weights from the first 3 epochs will be restored automatically.

loginaway commented 4 years ago

Thank you kamalkraj! It works.