minimaxir / aitextgen

A robust Python tool for text-based AI training and generation using GPT-2.
https://docs.aitextgen.io
MIT License
1.84k stars 220 forks source link

How do you continue training from the same place in the training set? #225

Open xzuyn opened 1 year ago

xzuyn commented 1 year ago

So I wanna be able to stop training at say 500 steps, then later on continue that from 500 steps into the training data on my saved model. How can I do that?

I think just loading the model and training it normally just defaults to the beginning of the training data, unless I'm mistaken. I don't wanna run through the exact same training data just to get to fresh data, I may as well just start from the beginning again.