search

microsoft / MSMARCO-Passage-Ranking-Submissions

Submission archive for the MS MARCO passage ranking leaderboard
https://microsoft.github.io/MSMARCO-Passage-Ranking-Submissions/leaderboard
MIT License
12 stars 30 forks source link

Could you please update the leaderboard? #15

Closed cdh4696 closed 3 years ago

cdh4696 commented 3 years ago

Hi,

I am so sorry to bother you, but could you please update the leaderboard?

Since the evaluation results are not officially announced, I cannot use the evaluation result on any materials, including papers and presentations.

If it takes some time to implement the automated update script, could you please manually update the leaderboard excel file? I really want to use the evaluation result in my Friday presentation.

Many thanks for considering my request.

bmitra-msft commented 3 years ago

Hello,

Sincere apologies for the delay. You are correct in the assumption that the delay was due to pending automation of the leaderboard update. That was compounded by the fact that one of our team members who is working on the leaderboard migration had multiple deadlines last week and all of us have also been busy with the TREC Deep Learning Track. We will try to manually update the leaderboard soon. But in the meantime please feel free to use the evaluation results in your papers and presentations even if they are not on the official leaderboard yet.

We sincerely apologize for the inconvenience.

Best regards, Bhaskar

msmarco-bot commented 3 years ago

Leaderboard has been updated!