create retrieval_word_overlap.py

allenai / deep_qa

A deep NLP library, based on Keras / tf, focused on question answering (but useful for other NLP too)

Apache License 2.0

404 stars 132 forks source link

create retrieval_word_overlap.py #367

Closed haniesedghi closed 7 years ago

haniesedghi commented 7 years ago

This code implements a word_overlap retrieval baseline. given a question and a file consisting all the knowledge, e.g. list of all table row sentences. In order to score the retrieval model, picks a random list of question, answer pairs (e.g. from AristoQuiz dataset) and it checks if the answer exists in the topk retrieved sentences. btw, the code has been checked by Joel

matt-gardner commented 7 years ago

@DeNeutoy, are you looking at this? I was holding off, because Hanie requested your review.

DeNeutoy commented 7 years ago

Sorry I missed this, LGTM.

matt-gardner commented 7 years ago

Once the pylint errors are fixed and the tests pass, feel free to merge.