search

uf-hobi-informatics-lab / ClinicalTransformerNER

a library for named entity recognition developed by UF HOBI NLP lab featuring SOTA algorithms
MIT License
142 stars 28 forks source link

add DeBERTa support #7

Closed bugface closed 3 years ago

bugface commented 3 years ago

add DeBERTa for BERT:

  1. implementation
  2. test on CONLL-2003
  3. test on 2010-i2b2
bugface commented 3 years ago

DeBERTa implementation updated

bugface commented 3 years ago

conll-2003

         precision    recall        f1

strict
    loc     0.9092    0.9245    0.9168
    per     0.9534    0.9617    0.9575
   misc     0.7671    0.8305    0.7975
    org     0.8710    0.8820    0.8765

relax
    loc     0.9180    0.9335    0.9257
    per     0.9601    0.9685    0.9643
   misc     0.8158    0.8832    0.8482
    org     0.8977    0.9091    0.9034

overall
acc: 0.9797
strict
            0.8918    0.9109    0.9013

relax
            0.9106    0.9301    0.9202

i2b2:

           precision    recall        f1

strict
  problem     0.8785    0.8314    0.8543
     test     0.8645    0.8656    0.8650
treatment     0.8535    0.8394    0.8464

relax
  problem     0.9540    0.9028    0.9277
     test     0.9197    0.9208    0.9203
treatment     0.9239    0.9086    0.9162

overall
acc: 0.9561
strict
              0.8670    0.8433    0.8550

relax
              0.9351    0.9095    0.9221