search

UBC-NLP / araT5

AraT5: Text-to-Text Transformers for Arabic Language Understanding
84 stars 18 forks source link

Which optimizer to use while fine-tuning ara-t5 base mode ? #7

Open mtala3t opened 2 years ago

mtala3t commented 2 years ago

Hello,

Please help , which optimizer should i use while fine-tuning your model ? and with which learning rate ?

Thanks.