deepset-ai / COVID-QA

API & Webapp to answer questions about COVID-19. Using NLP (Question Answering) and trusted data sources.
Apache License 2.0
344 stars 121 forks source link

Update Arbeitsagentur scraper to match new site #107

Closed mfleming99 closed 4 years ago

mfleming99 commented 4 years ago

Hey, Arbeitsagentur changed their website's format. This change gets all the QA data. Previous runs of the scraper would pick up non QA data.

Timoeller commented 4 years ago

Hey @mfleming99 thanks for updating functionality in our repository. We will gladly review and merge it if correct. I have seen you have an own repository for scraping COVID related content with quite some datasources and your publicly facing app which I think is pretty neat with giving additional info if available or "questions I currently cannot answer".

As stated in our README we took down the FAQ matching UI and API because of declining interest and actually quite good alternatives. We are currently focusing our efforts on the research side of COVID-19 by releasing a Question Answering dataset and accompanying paper.