microsoft / BotFramework-Composer

Dialog creation and management for Microsoft Bot Framework Applications
https://docs.microsoft.com/en-us/composer/
MIT License
868 stars 372 forks source link

Node WA Parent bots don't have equivalent LUIS routing performance #7861

Closed Virtual-Josh closed 3 years ago

Virtual-Josh commented 3 years ago

Describe the bug

Node WA parent bots don't trigger intents via LUIS at the same threshold as function bots and dotnet bots despite the same LUIS confidence levels across the same intents.

Version

Version: 2.0.0-nightly.246170.8fa93 Electron: 8.2.4 Chrome: 80.0.3987.165 NodeJS: 12.13.0 V8: 8.0.426.27-electron.0

Browser

OS

To Reproduce

Steps to reproduce the behavior:

  1. Create and upload 4 skill bots, dotnet wa, dotnet function, node wa, node function
    • note: make the trigger phrase the type of the bot (dotnet wa, dotnet function, node wa, node function)
  2. Create and upload a node wa parent that has all skills
  3. send the parent each of the messages to connect to each of the skills

Expected behavior

This should just work

Screenshots

image

Additional context

Because I was curious I ran the node wa and node function bots locally to look at their LUIS scores to see if there was some difference there, but the scores are the same. Function bots don't have any issues, and dotnet bots work across both scenarios. The trigger phrases are the same in all scenarios.

Node WA parent scores dotnet wa - 80.29 - does not work locally -- does not work in azure dotnet function - 78.67 - does not work locally -- does not work in azure node wa - 84.20 -- works locally -- works in azure node function - 83.14 - does not work locally -- does not work in azure

Node function parent: dotnet wa - 80.29 - works locally -- does not work in azure dotnet function - 78.67 - works locally - works in azure node wa - 84.20 -- works locally -- works in azure node function - 83.14 - works locally -- works in azure

Virtual-Josh commented 3 years ago

non-issue, seems like it was somethign weird with luis