Why doesn't stemming work in Node?

[peterbe]

This could be a user-error. If so, I'm sorry, but it's not easy to understand how to use it. I know the language, in my use case is, English (en) so I want it to find "repositories" and I search for "repository" and vice versa. I tried this:

const { Index, Document, Worker } = require("flexsearch");

const index = new Index({language: 'en', tokenize: "forward", stemmer: true})
const docs = ["Procurement is a word", "But also procurements is a word", "Repository is a word"]
docs.forEach((doc, i) => {
  index.add(i, doc)
})

const results = index.search('repositories', {limit: 10})
for (const key of results) {
  console.log(key, docs[key])
}

It's not finding anything. And if I search for procurement I want it to match Procurement and procurements.

Demo here: https://glitch.com/edit/#!/insidious-roan-note

[peterbe]

I had some luck with

const index = new Index({language: 'en', tokenize: "forward",stemmer: {

        // object {key: replacement}
        "ational": "ate",
        "s": "",
        "y": "ies",
        "tional": "tion",
        "enci": "ence",
        "ing": ""
    },})

but I'm not sure it's "smart enough". The loading of language: 'en' should hopefully have a stemmer built in specifically for the English language.

[ts-thomas]

I will update the docs shortly to show how to use extern stemmer library.