Addition of Syntax Feature for IBM NLU - to enable Lemmatisation

[gaillimhabu]

Is your enhancement related to a problem? Please describe.

Hi Guys ,

great product , thank you for your hard work on this. My main reason for install/testing was to see if NLU could achieve "Lemmatizaion" , I was thinking Hike/Hiking ..

I tested the Syntax feature , which enables you to get your Lemmatization tags back and I would imagine , it could be ( famous last words ) a straight forward feature addition ( like entities , categories etc )

https://developer.ibm.com/articles/a-deeper-look-at-the-syntax-api-feature-within-watson-nlu/

My Example using the demo in the article above , pointed at a link which mentioned hiking but not the word "hike".

Return snippet

{ "text": "considered", "part_of_speech": "VERB", "location": [ 8, 18 ], "lemma": "consider" }, { "text": "hiking", "part_of_speech": "VERB", "location": [ 19, 25 ], "lemma": "hike" },

Thanks in advance !

Designs

No response

Describe alternatives you've considered

No response

Code of Conduct

• [X] I agree to follow this project's Code of Conduct

[jeffpaul]

@gaillimhabu what's the use case you would see this help with on your site?

[gaillimhabu]

Hi Jeffrey ,

Thanks for your message. I'm testing the plugin for content classification but missing link is synonyms for words or conversion of hike/hiking , walking/walk etc.

I think with the other features that are in situ , the syntax feature gives lemmatization and the extra edge to the plugin.

I'm using Relevanssi search to index and Classifai really enhances that search.

Cheers

Stephen

---

From: Jeffrey Paul @.> Sent: Tuesday, February 22, 2022 3:29:54 AM To: 10up/classifai @.> Cc: Stephen Griffin @.>; Mention @.> Subject: Re: [10up/classifai] Addition of Syntax Feature for IBM NLU - to enable Lemmatisation (Issue #326)

@gaillimhabuhttps://github.com/gaillimhabu what's the use case you would see this help with on your site?

— Reply to this email directly, view it on GitHubhttps://github.com/10up/classifai/issues/326#issuecomment-1047391542, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AXY66OQ4MFXL2P5FHHAUQ6TU4L7LFANCNFSM5OOV7Z7A. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub. You are receiving this because you were mentioned.Message ID: @.***>

[jeffpaul]

@gaillimhabu are you looking for ClassifAI to add those synonyms that are returned as part of the taxonomies from the plugin settings?

[gaillimhabu]

Hi Jeffrey ,

Yes , similar to how the behaviour is currently. The syntax call for lemmatisation includes the word class type and so perhaps it could be VERB only.

The call I used can return the other features and so I assumed that's how Classifai achieved also.

I'm not an expert in the field, but lemma is what I'm after , alternatively I will need to come up with synonym map lists walk=walking for example.

Thanks again

Stephen

---

From: Jeffrey Paul @.> Sent: Wednesday, February 23, 2022 4:42:09 AM To: 10up/classifai @.> Cc: Stephen Griffin @.>; Mention @.> Subject: Re: [10up/classifai] Addition of Syntax Feature for IBM NLU - to enable Lemmatisation (Issue #326)

@gaillimhabuhttps://github.com/gaillimhabu are you looking for ClassifAI to add those synonyms that are returned as part of the taxonomies from the plugin settings?

— Reply to this email directly, view it on GitHubhttps://github.com/10up/classifai/issues/326#issuecomment-1048444819, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AXY66OSZHFVXY5M7S5C3JELU4RQSDANCNFSM5OOV7Z7A. Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub. You are receiving this because you were mentioned.Message ID: @.***>