IAA breaks down for span-only annotations.

catalpa-cl / inceptalytics

An easy-to-use API for analyzing INCEpTION annotation projects.

16 stars 7 forks source link

IAA breaks down for span-only annotations. #11

Open simulacrum6 opened 2 years ago

simulacrum6 commented 2 years ago

Some annotations do not require a label but consist only of a span marking the object of analysis. For these annotations, the IAA calculation throws errors. The expected behaviour would be to allow only unitising agreement measures.