Details of finetuning - Githubissues

AI4Bharat / IndicBERT

Pretraining, fine-tuning and evaluation scripts for IndicBERT-v2 and IndicXTREME

https://ai4bharat.iitm.ac.in/language-understanding

MIT License

73 stars 13 forks source link

Details of finetuning #8

Open sandeep-krutrim opened 7 months ago

sandeep-krutrim commented 7 months ago

Can you share details on fine-tuning for IndicGlue tasks like hyperparameters , full fine tuning or freezing the bert layers etc. Will be helpful in comparing fairly.