search

vered1986 / OKR

OKR: A Consolidated Open Knowledge Representation for Multiple Texts
Other
39 stars 13 forks source link

Computing F1 score for predicate mentions #1

Open hitzkrieg opened 7 years ago

hitzkrieg commented 7 years ago

https://github.com/vered1986/OKR/blob/master/src/baseline_system/eval_predicate_mention.py#L35

We shouldn't be using average of precision and recall for computing F1 but the harmonic mean. Can we change/modify the method compute_predicate_mention_agreement in predicate_mention.py: https://github.com/vered1986/OKR/blob/master/src/agreement/predicate_mention.py#L31

rachelvov commented 7 years ago

Hello hitesh! Are you in the lab today? Can we talk about it here today?