number of steps for finetuning

google-research / multilingual-t5

Apache License 2.0

1.25k stars 129 forks source link

number of steps for finetuning #64

Closed dorost1234 closed 3 years ago

dorost1234 commented 3 years ago

Hi could you clarify for how many steps you finetuned the model for the zero-shot results ? I do not see this number being reported in the paper, thanks @craffel @nconstant-google

nconstant-google commented 3 years ago

We fine-tuned 20k steps for the NER and the QA tasks, and 10k steps for the other tasks. Note, we selected the best checkpoints based on validation performance, rather than just using the final checkpoint.