search

deepset-ai / COVID-QA

API & Webapp to answer questions about COVID-19. Using NLP (Question Answering) and trusted data sources.
Apache License 2.0
344 stars 121 forks source link

Getting empty answer #75

Closed theapache64 closed 4 years ago

theapache64 commented 4 years ago

image

tholor commented 4 years ago

Found 10 FAQs with empty answers indexed in elasticsearch. Deleted them now. @bogdankostic Can you please filter out scraper results that have an empty answer string to avoid something like this in the future?

bogdankostic commented 4 years ago

@tholor The meta-scraper is already filtering out empty answers (see here). I checked the resulting dataframe for empty strings, but none of the answer cells is empty. Also, I checked whether there are answer cells which only contain whitespace (thus not being technically empty), but this is not the case either.