Unable to reproduce Retrieval Accuracy as given in the paper for Flores

AI4Bharat / IndicBERT

Pretraining, fine-tuning and evaluation scripts for IndicBERT-v2 and IndicXTREME

https://ai4bharat.iitm.ac.in/language-understanding

MIT License

73 stars 13 forks source link

Unable to reproduce Retrieval Accuracy as given in the paper for Flores #12

Open sandeep-krutrim opened 2 months ago

sandeep-krutrim commented 2 months ago

I am trying to reproduce the retrieval task results for Flores dataset of IndicXtreme. I am using. - fine-tuning/retrieval/retrieval.py code. However, the accuracy returned by the script is nowhere closer to what is reported in the papers. Please help me understand.