This PR enables elasticlunr-rs to generate search indices for Japanese language.
Like #24, I added a special tokenizer for Japanese since Japanese is not a space-separated language as well.
I would be very glad if this PR is merged so that I and many other Japanese people will make use of this powerful crate.
Thank you.
This PR enables
elasticlunr-rs
to generate search indices for Japanese language. Like #24, I added a special tokenizer for Japanese since Japanese is not a space-separated language as well.I would be very glad if this PR is merged so that I and many other Japanese people will make use of this powerful crate. Thank you.