Error in NER for WNUT2017

sebastianruder / NLP-progress

Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.

https://nlpprogress.com/

MIT License

22.58k stars 3.62k forks source link

Error in NER for WNUT2017 #266

Closed napsternxg closed 5 years ago

napsternxg commented 5 years ago

The SOTA model's eval score and the linked paper is incorrect. F1 score is 49.49 as reported in the paper. More details at: https://github.com/zalandoresearch/flair

The paper will be published in NAACL 2019, the citation string is:

Pooled Contextualized Embeddings for Named Entity Recognition (to appear). Alan Akbik, Tanja Bergmann and Roland Vollgraf. 2019 Annual Conference of the North American Chapter of the Association for Computational Linguistics, NAACL 2019.

sebastianruder commented 5 years ago

Thanks for the pointer. Would you mind submitting a PR to fix the mistake?