nlplab / brat

brat rapid annotation tool (brat) - for all your textual annotation needs
http://brat.nlplab.org
Other
1.82k stars 509 forks source link

Remove/include all mentions with a particular text #394

Open mlneves opened 13 years ago

mlneves commented 13 years ago

Ability to remove and include all mentions with a certain automatically for whole document. It could be a checkbox in the annotation window. And also for all the documents in the same directory. Maybe a second checkbox for that. In our project, we pre-annotate the documents with the named entities, so that the curators only need to annotated the relationships. They are complaining that sometimes they have to remove the same mention over and over again. And a similar functionality to include all the mentions with the same text. Alternatively, we can do it programatically, changing the output files. But, (1) they have to tell me which terms are to be removed or inserted (ok, we can compare the old and the new files, but maybe it is just some of them), (2) they have to wait until we do it in order to proceed with the annotation of the relationships, (3) news examples are always coming and we will have to do it many times. Other curation tools have this functionality, for example, GATE, I think.

spyysalo commented 13 years ago

Good suggestion, thanks!

We've discussed this previously and there was some concern that "bulk deletes" or similar would promote careless annotation practices: I understand that a tool in use in GENIA annotation had this functionality, and led at least to some errors from annotators triggering "delete all" (or similar) before checking all the instances that were about to be deleted.

A possible guard against such errors would be an implementation similar to the "replace all" functionality in many text editors, where each entry is shown for separate confirmation prior to revision.

I'll take this for now for the next milestone past the current. Comments very welcome.

mlneves commented 13 years ago

Yes, I think you could use something like a "replace all" function, in our case, replacing the type of the entity to another one for a certain mention. But sometimes the origin or the destination type can be no type at all ("none"), which means annotating or removing these annotations for a certain entity type.

mlneves commented 13 years ago

Sorry, I didn't mean to close the issue....

ghost commented 9 years ago

Related to #289, this would be nice to have.

snegirigens commented 5 years ago

I think this is still very relevant to have. We face the same problem and I am struggling to find satisfying workaround.