search

semantic-systems / NLIWOD

Collection of tools, utilities, datasets and approaches towards realising natural language interfaces for the Web of Data.
GNU Affero General Public License v3.0
94 stars 32 forks source link

QALD 3 Test without answers #2

Closed RicardoUsbeck closed 8 years ago

RicardoUsbeck commented 8 years ago

As you can see here (http://gerbil-qa.aksw.org/gerbil/experiment?id=201606010001) SINA gets a score of 1 at QALD 3. That is, the questions have no answers. Please add the correct dataset to qa.datasets.

JonathanHuthmann commented 8 years ago

Since: https://github.com/AKSW/NLIWOD/commit/eba284485f8a4d86261ea0f561a50d14e4f12fde Changed loaders to fix missing answers on QALD3, but still dirty datasets: unbenannt

(Run main on LoaderController for this post)

RicardoUsbeck commented 8 years ago

Pleas fix or at least have a look at QALD2 test and qald 2musicbrainz before closing this ticket.

JonathanHuthmann commented 8 years ago

QUALD2__test_dbpedia and QUALD2_test_musicbrainz have no answers in File (only sparql) See here: https://github.com/ag-sc/QALD/blob/master/2/data/dbpedia-test.xml https://github.com/ag-sc/QALD/blob/master/2/data/musicbrainz-test.xml

RicardoUsbeck commented 8 years ago

Ah I see