Closed andreaskuster closed 4 years ago
Train Data | Test Data | Accuracy Word2vec CRF | Accuracy GloVe CRF | Accuracy ELMo | Accuracy ELMo CRF (paper experiment) |
---|---|---|---|---|---|
PTB Dataset | |||||
Cased | Cased | 0.8880455545265108 | 0.9590110557999537 | 0.9719191363741607 | 0.9726933317897661357 |
Cased | Uncased | 0.7863437717064136 | 0.8611223662884927 | 0.8857229682796943 | 0.8828577216948367834 |
Uncased | Uncased | 0.809714343598055 | 0.9496845334568187 | 0.9651829127112758 | 0.9651033225283631 |
C+U | Cased | 0.8562384232461218 | 0.9688295901829127 | 0.9743791965732809 | 0.9750810372771475 |
C+U | Uncased | 0.8666936790923825 | 0.9584105116925214 | 0.9659571081268812 | 0.9659209307710118 |
Half Mixed | Cased | 0.8745079879601759 | 0.9579040287103496 | 0.9729755151655476 | 0.972331558231072 |
Half Mixed | Uncased | 0.8286133943042371 | 0.9489826927529521 | 0.9636345218800648 | 0.9618763023848113 |
Cased | Truecase | 0.8573960986339431 | 0.9382235471173883 | 0.9477671335957397 | 0.9503574322759898 |
Truecase | Truecase | 0.8663970247742533 | 0.9519709423477657 | 0.9655519217411438 | 0.9660584047233156 |
Train Data | Test Data | Accuracy ELMo CRF | ||||
---|---|---|---|---|---|---|
PTB Reduced Dataset | ||||||
Cased | Cased | 0.9635225748770675 | ||||
Cased | Uncased | 0.8837878110564744 | ||||
Uncased | Uncased | 0.9547608404112651 | ||||
C+U | Cased | 0.9670093875726419 | ||||
C+U | Uncased | 0.95726419311578 | ||||
Half Mixed | Cased | 0.963373565787513 | ||||
Half Mixed | Uncased | 0.950782297720161 | ||||
Cased | Truecase | 0.9462375204887498 | ||||
Truecase | Truecase | 0.953524064967963 | ||||
Brown | ||||||
Cased | Cased | 0.956935486868762 | ||||
Cased | Uncased | 0.8330018772187424 | ||||
Uncased | Uncased | 0.9290745869189451 | ||||
C+U | Cased | 0.9710846032870111 | ||||
C+U | Uncased | 0.9583375486291857 | ||||
Half Mixed | Cased | 0.9528464955485754 | ||||
Half Mixed | Uncased | 0.9256175306209691 | ||||
Cased | Truecase | 0.9211382264929465 | ||||
Truecase | Truecase | 0.9261565340222664 | ||||
CoNLL 2000 | ||||||
Cased | Cased | 0.9779668161091313 | ||||
Cased | Uncased | 0.8791048779553206 | ||||
Uncased | Uncased | 0.9683105337778288 | ||||
C+U | Cased | 0.9899877244130735 | ||||
C+U | Uncased | 0.9946294307196563 | ||||
Half Mixed | Cased | 0.9765107100433 | ||||
Half Mixed | Uncased | 0.9666245162279189 | ||||
Cased | Truecase | 0.954017703184274 | ||||
Truecase | Truecase | 0.9678507108096716 | ||||