search

canghongjian / beam_retriever

[NAACL 2024] End-to-End Beam Retrieval for Multi-Hop Question Answering
https://arxiv.org/abs/2308.08973
Apache License 2.0
66 stars 8 forks source link

query with Beam Retrieval of other datasets #3

Closed codefreshman1024 closed 8 months ago

codefreshman1024 commented 9 months ago

Hi,bro! I want to use Beam Retrieval in my model,which test in other KGQA datasets,such as WebQSP or CWQ. So I ask about compatibility this way in other datasets.Thanks!

canghongjian commented 9 months ago

Hi,bro! I want to use Beam Retrieval in my model,which test in other KGQA datasets,such as WebQSP or CWQ. So I ask about compatibility this way in other datasets.Thanks!

Hello @codefreshman1024 ! Sorry for the late reply. Beam Retrieval mainly focuses on the unstructured multi-hop QA datasets, and I'm not sure whether it could be applied to structured datasets such as KGQA. Maybe you can try to transform the structured data into unstructured form. In general, I don't recommend doing this because there are more suitable papers and methods in the KGQA field.

codefreshman1024 commented 9 months ago

Thank you for your suggestion!I understand that the beam retrieval method used in your paper is used to supervise the intermediate process, so that it can better find the target entity. I think it is the same for text or structured data sets, and I am also actively looking for other supervision methods

canghongjian commented 9 months ago

Your understanding is correct, and applying the idea of beam retrieval to KGQA is promising. I hope you can make a progress. Feel free to contact me if you have other questions.

codefreshman1024 commented 9 months ago

Ok, I first want to know if this beam retrieval method is used as a module to participate in the QA, so that we can only change the input and output format, otherwise it is a lot of work.

canghongjian commented 9 months ago

Yes. Beam Retrieval is used for selecting relevant passages given a question and a set of candidate passages. If you can generate this type of format, then you can use Beam Retrieval.