msmarco-bot
commented
1 year ago Hi there, thanks for your submission!
I've gone ahead and run the evaluation... here are your results:
# Processing submission 20220929-doc2query--
Private key found!
Unpacking submission 20220929-doc2query--
Decrypting key...
Decrypting metadata...
Decrypting submission tarball...
Unpacking tarball...
Done!
Submission directory ./submissions/20220929-doc2query--
Verified: submission directory exists!
Verified: expected files appear in the submission directory!
Sanity checking run ./submissions/20220929-doc2query--/dev.txt.bz2
Run has 6975972 lines, 6980 unique queries.
Warning, 6980000 lines expected (1000 hits per query), instead 6975972 lines found!
Sanity checking run ./submissions/20220929-doc2query--/eval.txt.bz2
Run has 6833806 lines, 6837 unique queries.
Warning, 6837000 lines expected (1000 hits per query), instead 6833806 lines found!
Proceeding to evaluate:
Dev run MRR@10: 0.3076110883703996
Eval run MRR@10: 0.30633458005112124
@microsoft-github-policy-service agree