eli5 implicit knowledge model reproduce scores

facebookresearch / KILT

Library for Knowledge Intensive Language Tasks

MIT License

910 stars 91 forks source link

eli5 implicit knowledge model reproduce scores #33

Closed dptam closed 3 years ago

dptam commented 3 years ago

Hi, I saw the scores for t5-base and bart models using implicit knowledge get around 19-20 rougeL, and was having issues matching that score. Currently, I am getting around 11 rougeL. I was wondering what hyperparameters and scheduler were used? Thanks

fabiopetroni commented 3 years ago

Hey @dptam, I've just pushed some script to reproduce t5 results. :)