search

microsoft / MSMARCO-Passage-Ranking-Submissions

Submission archive for the MS MARCO passage ranking leaderboard
https://microsoft.github.io/MSMARCO-Passage-Ranking-Submissions/leaderboard
MIT License
12 stars 30 forks source link

How long will the board update? #14

Closed zyznull closed 2 years ago

zyznull commented 2 years ago

Hi, I have submitted a new result a week ago and successfully merged, but I notice that the result is not updated on the leadee board. So I want to know that how long will the board update? Thanks!

bmitra-msft commented 2 years ago

Hello,

Sincere apologies for the delay. The delay is due to pending automation of the leaderboard update. That was compounded by the fact that one of our team members who is working on the leaderboard migration had multiple deadlines last week and all of us have also been busy with the TREC Deep Learning Track. We will try to manually update the leaderboard soon. But in the meantime please feel free to use the evaluation results in your papers and presentations even if they are not on the official leaderboard yet.

We sincerely apologize for the inconvenience.

Best regards, Bhaskar

msmarco-bot commented 2 years ago

Leaderboard has been updated!