search

aliannejadi / qulac

Qulac: A dataset on asking Questions for Lack of Clarity in open-domain information-seeking conversations.
MIT License
73 stars 9 forks source link

Release of Qrels with SIGIR 2019 paper #7

Open Sebastianacross opened 3 years ago

Sebastianacross commented 3 years ago

Hi everyone, thank you for the great resource. I am trying to find in the repository where are the qrels to replicate your sigir 2019 experiments. For example, the qrels to replicate the document retrieval experiments for table 3, with the -T and -F splits. Can you please direct me to where I can find them within this repository? @aliannejadi

Many thanks, Sebastian

aliannejadi commented 3 years ago

Hi,

Thank you for your query. I’m not sure if I can add the Qrels here due to copyright issues of TREC. I will ask the organizers of the TREC track and see if I’m allowed to redistribute the Qrels. In the meantime, if you have access to TREC Web track 09-12, you can use those Qrels to reproduce the results. I’m happy to give more details on how to do it if you have the files.

Thanks, Mohammad

On 8 Jul 2021, at 03:00, Sebastianacross @.***> wrote:

Hi everyone, thank you for the great resource. I am trying to find in the repository where are the qrels to replicate your sigir 2019 experiments. For example, the qrels to replicate the document retrieval experiments for table 3, with the -T and -F splits. Can you please direct me to where I can find them within this repository? @aliannejadi https://github.com/aliannejadi Many thanks, Sebastian

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/aliannejadi/qulac/issues/7, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA4DS3IKO4CRHU52N4C23UTTWT2DHANCNFSM477WOYNA.