Can't get the answer using BM25Retriever

cdqa-suite / cdQA

⛔ [NOT MAINTAINED] An End-To-End Closed Domain Question Answering System.

https://cdqa-suite.github.io/cdQA-website/

Apache License 2.0

614 stars 191 forks source link

Can't get the answer using BM25Retriever #342

Open giangpol opened 4 years ago

giangpol commented 4 years ago

Hello , We have used your cdQA to test sample dataset. But then it gets the wrong answer. Screenshot from 2020-02-13 16-45-29

Do you have any idea on what the problem could be ?? Thank you Best Regards,

ridhimagarg commented 4 years ago

Hi @giangpol , I was also testing it out and feels like there is some issue in this retriever code.

I have gone through that and try changing it a little bit then comes up with another issue.

Pls if anyone could help us on the same will be good.

RohitRanga12 commented 4 years ago

I created the dataframe with my custom dataset. The shape of my df is (40144, 2). When I call fit_retriever(), I get a memory error. But when I reduce the number of rows in the df to 2000, it works fine. Can you please look into this issue?