search

jgroschwitz / GrAPES

GNU General Public License v3.0
1 stars 0 forks source link

unseen_predicate_senses_excl_01 #7

Open Lisa-aa opened 5 months ago

Lisa-aa commented 5 months ago

Hello, All categories I tested worked except for: "unseen_predicate_senses_excl_01". This category gives an division by zero error when I try to evaluate on a single category.

jgroschwitz commented 5 months ago

Hi, the category "unseen_predicate_senses_excl_01" uses original GrAPES data (unlike for the frequent predicate senses, which are from the AMRBank testset). In the terminology used here, that would be category A. I suspect you are giving it as input the gold data and parser predictions on the AMRBank testset?