Closed adrianeboyd closed 4 years ago
Rewrite the alignment algorithm to create the words and spaces using a copy of spacy.util.get_words_and_spaces and align the stanza annotation to the words, adjusting the positions and offsets around the additional whitespace tokens.
spacy.util.get_words_and_spaces
Fixes #30, fixes #33.
Rewrite the alignment algorithm to create the words and spaces using a copy of
spacy.util.get_words_and_spacesand align the stanza annotation to the words, adjusting the positions and offsets around the additional whitespace tokens.Fixes #30, fixes #33.