search

explosion / spacy-stanza

💥 Use the latest Stanza (StanfordNLP) research models directly in spaCy
MIT License
723 stars 59 forks source link

Fix alignment for spacy tokenizer #44

Closed adrianeboyd closed 4 years ago

adrianeboyd commented 4 years ago

Fix the alignment when spacy is used as the tokenizer and may return whitespace tokens.