Lemmatization need for LEMMA patterns

davidberenstein1957 / concise-concepts

This repository contains an easy and intuitive approach to few-shot NER using most similar expansion over spaCy embeddings. Now with entity scoring.

MIT License

242 stars 14 forks source link

Lemmatization need for LEMMA patterns #35

Open swelcker opened 1 year ago

swelcker commented 1 year ago

I believe you are missing to call the lematization function before you build the conceptual patterns. I saw you already have the function for it but not calling it:

I added in run(): (my local version) .... self.infer_original_data()

self.lemmatize_concepts() ....

Was obvious with german text and de_ spacy models

davidberenstein1957 commented 1 year ago

@swelcker thanks for catching this! Could you open a PR, then I will include it in the next release.

swelcker commented 1 year ago

done