gramener / gramex-nlg

Natural Language Generation for Gramex applications.
Other
24 stars 24 forks source link

Named entities vs noun chunks #43

Open jaidevd opened 4 years ago

jaidevd commented 4 years ago

nlg.utils.ner wrongly clubs named entities and nouns together. This is a problem because NEs undergo a literal search, whereas nouns should undergo a lemmatized search.

E.g. "Inception is a good movie." Here the word "movie", if it appears in an inflected form in the dataframe, will not be correctly templatized because NER clubs it with NEs like "Inception".