search

inception-project / inception

INCEpTION provides a semantic annotation platform offering intelligent annotation assistance and knowledge management.
https://inception-project.github.io
Apache License 2.0
599 stars 152 forks source link

Automatic Names Entity based on agreement threshold #2828

Open n0k0m3 opened 2 years ago

n0k0m3 commented 2 years ago

Is your feature request related to a problem? Please describe. I'm working with a team of 10 (2 curators) on 100+ documents and want to make the curation process more tolerable

Describe the solution you'd like Based on a certain agreement threshold (customizable), curator has a "suggested tag" to select on their raw text. (thanks @reckart for pointing me at the remerge button and pre-merge strategies) Also, would be great if there's also a "suggested tag" from the annotator with the highest average inter-annotator agreement score

Describe alternatives you've considered No alternative considered

reckart commented 2 years ago

Thank you for the suggestions.

Have you seen the option for a threshold-based pre-merge? When you open a document for curation for the first time, click on the "remerge" button and switch to the threshold-based strategy.

n0k0m3 commented 2 years ago

That was really cool, I thought the remerge button was the same as the refresh/undo button in annotator's UI. Thanks for the tips. I found the 3 merge strategies really useful.

I still want to request (feature) strategy of prefer tags from annotator with highest agreement score.