olivernn / lunr.rs

Lunr backend implemented in Rust
MIT License
5 stars 2 forks source link

Implement pipeline #1

Open olivernn opened 7 years ago

olivernn commented 7 years ago

I assume this is still something that would be useful in this implementation, having stop word filtering and stemming would be useful and this abstraction works well in the JavaScript implementation.

budziq commented 7 years ago

Hi @olivernn I have zero knowledge about NLP so I might not be much help. But there is this stemming crate https://crates.io/crates/rust-stemmers used both by tantivy and elasticlunr.js that you might not be aware of.

olivernn commented 7 years ago

That looks perfect. The JavaScript stemmers are also based of snowball so hopefully things will stem the same on the front end and back end.