Evaluation- token level or entity level?

UKPLab / elmo-bilstm-cnn-crf

BiLSTM-CNN-CRF architecture for sequence tagging using ELMo representations.

Apache License 2.0

389 stars 81 forks source link

Open Mahmedturk opened 5 years ago

Mahmedturk commented 5 years ago

Hi,

What evaluation metric you use here? entity level or token level? Do you consider exact matching scheme or partial matching?

nreimers commented 5 years ago

Entity Level with exact matches. Like for CoNLL 2003 NER task

Mahmedturk commented 5 years ago

Is there any difference between conll 2000 and conll 2003 evaluation?