Closed jalew188 closed 2 years ago
Comparing with the results those I shared last week in bioinfor meeting, warmup-based fine-tuning has less overfitting issues.
Results before:
I guess it is not really overfitting, but falling into the local maxima while training with only a few samples.
After testing on ProteomeTools 21 PTMs, we found out that
warmup epoch
is also important for ms2 fine-tuning, even for few-shot fine-tuning.