search

hipe-eval / HIPE-scorer

A python module for evaluating NERC and NEL system performances as defined in the HIPE shared tasks (formerly CLEF-HIPE-2020-scorer).
https://hipe-eval.github.io
MIT License
13 stars 4 forks source link

Fuzzy results are named `'ent_type'` in json output #15

Open sven-nm opened 2 years ago

sven-nm commented 2 years ago

In the JSON outputs of the scorer, the results corresponding to fuzzy in the csv-output are named ent-type. For instance: 

# To get the strict results, you fetch the values of the 'strict'-key : 
results["NE-COARSE-LIT"]["TIME-ALL"]["LED-ALL"][desired_entity_type]["strict"]

#However, to get the fuzzy results, you have to retrieve the values of the 'ent_type' key : 
results["NE-COARSE-LIT"]["TIME-ALL"]["LED-ALL"][desired_entity_type]["ent_type"]

This is a bit confusing. Unless I am missing something, I think the name of the key should be replaced with 'fuzzy'.