CODAIT / Identifying-Incorrect-Labels-In-CoNLL-2003

Research into identifying and correcting incorrect labels in the CoNLL-2003 corpus.
Apache License 2.0
12 stars 2 forks source link

Reproduce results #41

Closed GSidiropoulos closed 2 years ago

GSidiropoulos commented 2 years ago

Dear authors, I am trying to reproduce the results you reported in Table 3, for the case of "Akbik et al., 2019" trained and tested on the original corpus. Unfortunately, my results are different from the ones you reported. Furthermore, the results I am getting when using the author provided tagger (model) are still different from the ones reported. Do you have any insights on this? Thank you in advance!

xuhdev commented 2 years ago

The training process involves some randomness, and it's totally natural to see some minor discrepancies between our results and the results you produced.

I would suggest: