search

microsoft / KEAR

Official code for achieving human parity on CommonsenseQA with External Attention
106 stars 25 forks source link

Retrieval field in the dataset #17

Closed chaizmp closed 11 months ago

chaizmp commented 11 months ago

Hello! Thank you for sharing this amazing work!

I wonder if we can also get the "retrieval" field in the csqa ret dataset (I want to make my own preprocessed dataset.) Do you have any code for retrieving that? Is it about retrieving relevant training examples (q/a pairs) from the question and choice? I tried looking into the code but could not find it.

xycforgithub commented 11 months ago

Hi chaizmp, Thank you for your interest. Please use REINA for the retrieval part of the knowledge: https://github.com/microsoft/REINA

chaizmp commented 11 months ago

I see. Thank you for the fast response!