ielab / GPT_Ranker

Use GPT-2/T5 to beat traditional LM
2 stars 0 forks source link

Retrain models with lowercased documents #13

Closed ArvinZhuang closed 3 years ago

ArvinZhuang commented 4 years ago

The original training didn't use lowercased documents as input. But lowercased documents performed slightly better in terms of MRR10. Maybe use lowercased documents as training examples could further improve the score.