Add Chinese support - Githubissues

mattico / elasticlunr-rs

A partial port of elasticlunr to Rust. Intended to be used for generating compatible search indices.

Apache License 2.0

52 stars 23 forks source link

Closed fetchadd closed 4 years ago

fetchadd commented 4 years ago

The tokenizing is special for Chinese, as 'word' is not sperated by whitespace. So there is a new "tokenize_chinese" function for tokenizing Chinese.