I got pretrain and finetune process mixed up, and previously I pretrained the models using finetune model structure, which might lead to worse results. The fix code is in process and may be finished in a few days.
this is great! we would like to bring this into Finetuner! in case @elenacliu do not have time, we could take over ! great work @elenacliu ! @jemmyshin please proceed
I got
pretrain
andfinetune
process mixed up, and previously I pretrained the models using finetune model structure, which might lead to worse results. The fix code is in process and may be finished in a few days.