Closed agx closed 1 year ago
Add nonbreaking space to separators and »« to separators.
»«
The approach taken in utils/ is nicer but having text2ngram do the right thing helps for sqlite based DBs.
text2ngram
Thanks!
Add nonbreaking space to separators and
»«
to separators.The approach taken in utils/ is nicer but having
text2ngram
do the right thing helps for sqlite based DBs.