statsmaths / cleanNLP

R package providing annotators and a normalized data model for natural language processing
GNU Lesser General Public License v2.1
209 stars 36 forks source link

tokenizers backend error on empty input #13

Closed statsmaths closed 7 years ago

statsmaths commented 7 years ago

When given an empty string as a document, run_annotators fails on the tokenizers backend with as_strings = TRUE.