How to continue training on the basis of pre-trained?

[graphl]

Hi, thank you for making this! I loaded the parameters of the pre-trained model and trained it, But now the results more like the fonts I added (main.py)Append code:

result

VAL/Loss

Is this an overfitting? or This is because there are no parameters to load the Adam optimizer ？ If I want to continue training my method on the basis of pre-trained, right?

[yizhiwang96]

Use .load_state_dict before the training (e.g, in this place). Do not use .eval because if is for training. If your dataset is small, it is more like finetune and you need only train for a few steps.

[graphl]

Thank you for the reply，I've tried it。The method you said is very useful. But I ran into other problems。 I trained with epoch = 11 and added some of my own fonts. But test with the parameters of their own training, but the effect is not very good.

Here are some of my test results。

I found that the weight of the font seemed to affect the result.

1. case 1
2. case 2
3. case 3

I found that the thickness of the font seems to affect the result, the thicker the font, the better the effect, and the thinner the font, the worse the effect。What do I have to do to make the thin font better。