search

snowblink14 / smatch

Smatch tool: evaluation of AMR semantic structures
MIT License
63 stars 25 forks source link

AMR graph which scores > 100% #42

Open jheinecke opened 1 year ago

jheinecke commented 1 year ago

Hi, I'm using smatch 1.0.4 (installed via pip install) and I found a case where the precision (and F-mesure) are > 100%

gold:

# ::snt 22/02/2010 16:42
(d / date-entity
      :time "16:42"
      :day 22
      :month 2
      :year 2010)

predicted:

# ::snt 22/02/2010 16:42
(d / date-entity
      :time "16:42"
      :year 2010
      :month 2
      :day 22
      :day 22)

evaluation: 

$ smatch.py --pr -f gold predicted
Precision: 1.17
Recall: 1.00
F-score: 1.08

Thanks !

jheinecke commented 1 year ago

Just saw that #15 mentioned this problem already...