search

microsoft / Cognitive-LUIS-Windows

Windows (.Net) SDK for the Microsoft Language Understanding Intelligent Service API, part of Congitive Services
www.microsoft.com/cognitive-services/en-us/language-understanding-intelligent-service-luis
Other
134 stars 78 forks source link

Cross-intent entity matching #69

Closed pvanaarde closed 6 years ago

pvanaarde commented 6 years ago

Hi,

We have an issue where our LUIS model doesn't identify entities as expected. The problem is that even though the correct intent is recognized the entity identified is from an unrelated intent. The detailed scenario below...

We have an intent called ContactProfile with entities related to contact information, for example, name, email, surname, etc. An utterance that we're testing with is 'can you get fred's contacts for me'. In this utterance, we expect 'fred' to be identified as a ContactName. Instead, 'fred' is identified as a DocumentName entity, which is only used on a completely different intent relating to Search functionality.

Additionally, I exported this LUIS app and imported it as a new app in the portal. Without making any changes I ran into the same problem, although this time another entity is identified in ReferenceId, which is used in another intent again.

Please advise. Pieter

LTsLlama commented 6 years ago

Any feedback on this?

ghost commented 6 years ago

We're still having this issue some months on now. Here are some example utterances using the same model months apart:

Input

  1. "find fred smith's contact details"
  2. "get fred's address book"
  3. "can you get fred's contacts for me"

Expected LUIS Output

  1. "find [$ContactName]'s contact details" (ContactProfile intent)
  2. "get [$ContactName]'s address book" (ContactProfile intent)
  3. "can you get [$ContactName]'s contacts for me" (ContactProfile intent)

Actual LUIS Output

  1. a) 2017-11-24 "find [$DocumentName]'s contact details" (ContactProfile intent) b) 2018-02-09 "find [$ContactName]'s contact details" (WebSearch intent)
  2. a) 2017-11-24 "get [$ReferenceID]'s address book" (ContactProfile intent) b) 2018-02-09 "get [(no entity recognised)]'s address book" (BookMeeting intent)
  3. a) 2017-11-24 "can you get [$DocumentName]'s contacts for me" (ContactProfile intent) b) 2018-02-09 "can you get [(no entity recognised)]'s contacts for me" (ContactProfile intent)