search

RichardHGL / WSDM2021_NSM

Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signals. WSDM 2021.
130 stars 22 forks source link

A question about CWQ test dataset #10

Closed LLLiaomeng closed 2 years ago

LLLiaomeng commented 2 years ago

Does the ComplexWebQuestions_test_wans.json file that appears in the code contain the answer to the question? How do I find this file?

RichardHGL commented 2 years ago

You can find it from https://github.com/lanyunshi/KBQA-GST. But I'd suggest evaluate through leaderboard. There may be some difference between local evaluation and leaderboard.

LLLiaomeng commented 2 years ago

thanks.

LLLiaomeng commented 2 years ago

One more question, how much RAM and GPU memory do you need to train cwq dataset at least?

RichardHGL commented 2 years ago

I guess it also fit into 12GB GPU, 64 GB RAM. You can try to reduce batch size to fit your machine.

LLLiaomeng commented 2 years ago

Thank you for the reply.