search

deepset-ai / COVID-QA

API & Webapp to answer questions about COVID-19. Using NLP (Question Answering) and trusted data sources.
Apache License 2.0
344 stars 121 forks source link

Question : Exact Match computation #175

Closed Geethi2020 closed 3 years ago

Geethi2020 commented 3 years ago

Hello, Would you please help understand how the "Exact Match" is calculated? May be please point to which .py file to be referred for the code. Thank you

Timoeller commented 3 years ago

Exact match is the exact match between two strings, only if their are equal it is 1, otherwise 0. Some scripts exclude punctuation, multiple whitespace and stopwords from the exact match calculation. See here this is the official SQuAD eval script (in our framework FARM)

Geethi2020 commented 3 years ago

Thank you for the response and thank so very much for the dataset.