Closed kkwarchiefs closed 2 years ago
Hi there, thanks for your submission!
I've gone ahead and run the evaluation... here are your results:
# Processing submission 20210927-lichee-tkd
Private key found!
Unpacking submission 20210927-lichee-tkd
Decrypting key...
Decrypting metadata...
Decrypting submission tarball...
Unpacking tarball...
Done!
Submission directory ./submissions/20210927-lichee-tkd
Verified: submission directory exists!
Verified: expected files appear in the submission directory!
Sanity checking run ./submissions/20210927-lichee-tkd/dev.txt.bz2
Run has 6980000 lines, 6980 unique queries.
Sanity checking run ./submissions/20210927-lichee-tkd/eval.txt.bz2
Run has 6837000 lines, 6837 unique queries.
Proceeding to evaluate:
Dev run MRR@10: 0.4179693114112892
Eval run MRR@10: 0.39747272659734256
fix team name