search

microsoft / MSMARCO-Passage-Ranking-Submissions

Submission archive for the MS MARCO passage ranking leaderboard
https://microsoft.github.io/MSMARCO-Passage-Ranking-Submissions/leaderboard
MIT License
12 stars 30 forks source link

Submission 20211021-h2oloo #13

Closed crystina-z closed 3 years ago

crystina-z commented 3 years ago

monoELECTRA + LCE loss (nneg=31) + trained and reranked on TCT-ColBERT w/ HN

ghost commented 3 years ago

CLA assistant check
All CLA requirements met.

msmarco-bot commented 3 years ago

Hi there, thanks for your submission!

I've gone ahead and run the evaluation... here are your results:

# Processing submission 20211021-h2oloo

Private key found!
Unpacking submission 20211021-h2oloo
Decrypting key...
Decrypting metadata...
Decrypting submission tarball...
Unpacking tarball...
Done!

Submission directory ./submissions/20211021-h2oloo
Verified: submission directory exists!
Verified: expected files appear in the submission directory!

Sanity checking run ./submissions/20211021-h2oloo/dev.txt.bz2
Run has 6980000 lines, 6980 unique queries.

Sanity checking run ./submissions/20211021-h2oloo/eval.txt.bz2
Run has 6837000 lines, 6837 unique queries.

Proceeding to evaluate:

Dev run MRR@10: 0.41354413971892495
Eval run MRR@10: 0.40427221398041985