Add Hoffart measures - Githubissues

wikilinks / conll03_nel_eval

Python evaluation scripts for AIDA-formatted CoNLL data

Apache License 2.0

20 stars 4 forks source link

Open benhachey opened 10 years ago

benhachey commented 10 years ago

One of these should replicate the Hoffart MAP@1 evaluation (see #9).

wejradford commented 10 years ago

We need to allow a confidence score in the system response to calculate this.

benhachey commented 10 years ago

As discussed (#9), MAP needs to include disambiguation only setting which can be implemented as a data filter.