Make tokenization editable

[jcklie]

Is your feature request related to a problem? Please describe. When using the builtin tokenizer of INCEpTION, it sometimes does errors. It would be nice if the tokenization can be edited.

Describe the solution you'd like Make the tokenization somehow editable, e.g. in the brat view.

• 2474

  • [x] Decoupling of rendering in brat from existence of tokens
  • [x] Option to enable token layer as editable layer
  • [x] Option to enable sentence layer as editable layer

• 2989

  • [x] Display sentences/tokens in the annotator views on the curation page if they are editable
  • [x] If tokens/sentences are editable, run them through the merge process instead of obtaining them from the template
  • [x] Use a line-oriented editor instead of a sentence-oriented editor while the sentence layer is not read-only
  • [x] Add documentation for editable sentences
  • [x] Disable changing anchoring mode and overlap mode for sentences / tokens
  • [x] Disable coloring rules for sentences
• Todo / Open questions
  • [ ] Deleting a token also removes attached annotations (eg. POS and transitively dependency relations)
  • [ ] What to do with "cross sentence" behavior if a document contains no sentences?
  • [ ] Should it be allowed to delete the sentence / token layer?
  • [ ] What about tokens / sentences in the curation view?

[mmatthiesencsc]

A similar feedback was given when using Webanno for the ANEE project (https://www2.helsinki.fi/en/researchgroups/ancient-near-eastern-empires)