microsoft / CognitiveServicesLanguageUtilities

Utilities for the Cognitive Service Custom Text document processing tool.
MIT License
17 stars 1 forks source link

fix issue with entity index resolution #139

Closed mshaban-msft closed 2 years ago

mshaban-msft commented 2 years ago

scenario:

problem is, this should only be cairo

proposed solution: use another similarity measure in post processing to get more accurate result problem: single database record existing in multiple parts of the utternace utterance: "i'm from Algeria, Algeria and my name is ..." { "Algeria": [ {"token": "from Algeria"}, {"token": "Algeria Algeria"}, {"token": "Algeria to"} ] }

we need to resolve two entities not just one!