Closed HongleiZhuang closed 2 years ago
Hi there, thanks for your submission!
I've gone ahead and run the evaluation... here are your results:
# Processing submission 20211214-google-gbm48 Private key found! Unpacking submission 20211214-google-gbm48 Decrypting key... Decrypting metadata... Decrypting submission tarball... Unpacking tarball... Done! Submission directory ./submissions/20211214-google-gbm48 Verified: submission directory exists! Verified: expected files appear in the submission directory! Sanity checking run ./submissions/20211214-google-gbm48/dev.txt.bz2 Run has 6980000 lines, 6980 unique queries. Sanity checking run ./submissions/20211214-google-gbm48/eval.txt.bz2 Run has 6837000 lines, 6837 unique queries. Proceeding to evaluate: Dev run MRR@10: 0.45343117523991566 Eval run MRR@10: 0.431220587791454
Hi there, thanks for your submission!
I've gone ahead and run the evaluation... here are your results: