search

ShannonAI / mrc-for-flat-nested-ner

Code for ACL 2020 paper `A Unified MRC Framework for Named Entity Recognition`
643 stars 117 forks source link

Reproduce of the GENIA dataset #70

Open YuSawan opened 3 years ago

YuSawan commented 3 years ago

Hi, I cannot reproduce the genia dataset results for f1=83.75 in your paper; the results only reached f1=78. If available, would you like to give your preprocessed dataset?

Nicozwy commented 3 years ago

@YuSawan Neither do I. Have you reproduced the genia dataset results for f1=83.75 in your paper now?

YuSawan commented 3 years ago

Not yet. I use the genia dataset provided in Obaja's project but it can not reproduce the results. I think this model uses different preprocessing like eliminates entities with coordinate structure (ex. Human A and B lymphocytes).

yujiahappy commented 3 years ago

Hello! I ran your program on the genia dataset, and the result was 74. Can you give me the data set you have processed?

xiaoya-li commented 2 years ago

Please use our released data files link for GENIA. Hyperparameters for reproducing the result can be found here. Many thanks.

EternalEep commented 2 years ago

Any update of this issue? I have run the experiment with Genia dataset, but only f1 0.79 I can get. I already used your dataset and your genia.sh scripts.