search

dice-group / gerbil

GERBIL - General Entity annotatoR Benchmark
GNU Affero General Public License v3.0
222 stars 58 forks source link

QAnswer not displayed in the systems list #423

Open javiersorucol opened 1 year ago

javiersorucol commented 1 year ago

Hi! I'm attempting to use Gerbril to test a Spanish dataset based on QALD-9 using the web portal at http://gerbil-qa.aksw.org/gerbil/config. QAnswer is not listed in the systems list in this portal. Is QAnswer still available for Gerbril-QA? Is any other system available to run QA in ES? All the other systems listed end in errors except for ganswer2. @RicardoUsbeck  @MichaelRoeder

RicardoUsbeck commented 1 year ago

@MichaelRoeder could you please check, I see that https://qanswer-frontend.univ-st-etienne.fr/ and http://wdaqua-core1.univ-st-etienne.fr/gerbil is also running

MichaelRoeder commented 1 year ago

At the moment, evaluating QAnswer is not possible since it starts to block GERBIL after some requests because of a request quota. We have found a workaround and we are going to implement it within the next days.

MichaelRoeder commented 1 year ago

QAnswer should be available now. Please give it a try.

With respect to other QA systems: since most of them are research prototypes, they may disappear from time to time. Sometimes, they may not come back. Unfortunately, there is not much we can do about it :confused:

javiersorucol commented 1 year ago

Thanks a lot, I'll try it :).

RicardoUsbeck commented 1 year ago

Thanks Michael!