search

shijx12 / TransferNet

Pytorch implementation of EMNLP 2021 paper "TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graph "
61 stars 18 forks source link

Neither CWQ nor WebQSP can meet the results reported in your pape #13

Open nenuzhangkuan opened 2 years ago

nenuzhangkuan commented 2 years ago

Hello, first of all, I would like to express my gratitude for your open source work.

After I downloaded your source code and ran it on my own machine, neither CWQ nor WebQSP could reach the results you reported. CWQ (dev 45.55, test 42.23) and WebQSP (test: 64), I see that in your previous answer, you explained that it might be because of the bert initialization on WebQSP. I don't know what the reason is on CWQ, and I don't know whether you can also share the CWQ checkpoint file

Huiopfsdfsdf commented 1 year ago

Hello, first of all, I would like to express my gratitude for your open source work.

After I downloaded your source code and ran it on my own machine, neither CWQ nor WebQSP could reach the results you reported. CWQ (dev 45.55, test 42.23) and WebQSP (test: 64), I see that in your previous answer, you explained that it might be because of the bert initialization on WebQSP. I don't know what the reason is on CWQ, and I don't know whether you can also share the CWQ checkpoint file

Hello brother, has the cwq reappeared? Mine is also 45-42, I don't know how to solve it, if it is solved, thank you very much