nextapps-de / flexsearch

Next-Generation full text search library for Browser and Node.js
Apache License 2.0
12.53k stars 491 forks source link

No results when searching index for emoji #166

Closed smnmmnn closed 3 years ago

smnmmnn commented 4 years ago

index.search on an input like '😀' yields no results, even if the string has an exact match in the doc. Does this relate to encoding or tokenizing issues?

ts-thomas commented 3 years ago

Yes, it is related to the used "encoder", please try to use another encoder function (takes a string, returns an array of words/terms).

kolaente commented 2 months ago

Tried setting a different encoder, but couldn't get that to work: https://github.com/nextapps-de/flexsearch/issues/428