search

rivo / uniseg

Unicode Text Segmentation, Word Wrapping, and String Width Calculation in Go
MIT License
581 stars 60 forks source link

libstemmer #1

Closed ghost closed 5 years ago

ghost commented 5 years ago

hey Rivo !

DO you think i can use uniseg to replace lib stemmer ? Its for indexing in bleve !

rivo commented 5 years ago

From what I can see, libstemmer implements stemming algorithms, which is not what uniseg does. You typically use uniseg when you need to split a Unicode string into its individual characters or when you need to count the number of characters in a string. Word stems are something different.

Or maybe I misunderstood what you were looking for, in which case let me know what exactly you need.