search

catalpa-cl / inceptalytics

An easy-to-use API for analyzing INCEpTION annotation projects.
16 stars 7 forks source link

inter-agreement among relations #30

Open SarehAghaei opened 6 months ago

SarehAghaei commented 6 months ago

I am wondering if you have addressed how to measure agreements between annotators for the relations established between the two annotations. As you know, Inception has the capability to establish relations between two entities.

zesch commented 6 months ago

In principle wrt to measuring agreement they could be treated like any other annotation (with the possible catch, that the underlying annotation forming the relation need to be identical). Having said that, currently we only support span annotations in general. Adding support for relations is on the todo list, but unlikely to be tackled in the near future.