Statistics at type level

bst-mug / acres

Acronym expansion module based on word embeddings and filtering rules

Apache License 2.0

1 stars 2 forks source link

Statistics at type level #66

Closed michelole closed 5 years ago

michelole commented 5 years ago

We so far do not operate at the token level (#67) because we're not dealing with WSD (#10).

So calculate stats accordingly.

michelole commented 5 years ago

(with gold_standard.tsv)

Token level:

2019-05-08 23:41:02 INFO     [evaluation.py:220] 146 out of 1143 (12.77%) acronyms were ignored.
Time: (s) 5.238261938095093
Precision:  0.764179104477612
Recall:  0.2567703109327984
F1:  0.3843843843843844

Type level:

2019-05-08 23:40:21 INFO     [evaluation.py:220] 860 out of 1143 (75.24%) acronyms were ignored.
Time: (s) 2.304633140563965
Precision:  0.7079646017699115
Recall:  0.2826855123674912
F1:  0.40404040404040403