QUERY tokenisation pipeline

fergiemcdowall / search-index

A persistent, network resilient, full text search library for the browser and Node.js

MIT License

1.39k stars 149 forks source link

QUERY tokenisation pipeline #539

Closed fergiemcdowall closed 2 years ago

fergiemcdowall commented 3 years ago

Some sort of custom tokenisation option in query pipeline. An example is to use this when stemming queries. Could also be used to internally tidy up handing of case sensitivity and stopwords

fergiemcdowall commented 2 years ago

done.