search

zhiguowang / BiMPM

BiMPM: Bilateral Multi-Perspective Matching for Natural Language Sentences
Apache License 2.0
438 stars 150 forks source link

Evaluation on WikiQA #38

Open ktymoshenko opened 6 years ago

ktymoshenko commented 6 years ago

Could you please answer a quick question regarding evaluation on WikiQA?

When evaluating, did you eliminate only the questions which have no correct answers from DEV and TEST (thus having 126 DEV and 243 TEST questions)? Or did you eliminate the questions which have only correct answers as well (thus having 122 DEV and 237 TEST questions)?

Thank you!

jc-wang commented 6 years ago

I can answer your problem, all the paper use wikiQA train/dev/test 873/126/243, It has some question that answers are All True.

jc-wang commented 6 years ago

@ktymoshenko