search

PolMine / duplicates

0 stars 0 forks source link

Consider tokenizers::tokenize_characters() #3

Open ablaette opened 1 year ago

ablaette commented 1 year ago

Is this a faster alternative to strsplit(x, "")?

ablaette commented 1 year ago

Or more robust when it comes to UTF-8 characters.