search

microsoft / MixedRealityToolkit-Unity

This repository is for the legacy Mixed Reality Toolkit (MRTK) v2. For the latest version of the MRTK please visit https://github.com/MixedRealityToolkit/MixedRealityToolkit-Unity
https://aka.ms/mrtkdocs
MIT License
6k stars 2.12k forks source link

"Start Dictating" voice command doesn't work in immersive application while working fine with 2D app like Edge #10511

Closed tletie closed 9 months ago

tletie commented 2 years ago

Overview

When interacting with input field => keyboard popup. Instead of keying, user can trigger dictation via "Start Dictating" voice command. This is true when using 2D app like Edge but not in immersive application say the app shifted with OS like: remote assist or dynamic 360 guide. When using these immersive applications at the user name field, we can't trigger dictation at all using voice command. This happen with any other immersive applications that use keyboard

Expected behavior

When 3D keyboard popup, we should be able to trigger dictating using voice command regardless of application types (2D and/or immersive)

Actual behavior

"Start Dictating" voice command only work on 2D not immersive apps

Steps to reproduce

  1. Launching remote assist
  2. At the sign in place focus on user input field. If you don't see the user input field => choose other login option instead of selecting save login user.
  3. When keyboard popup => use voice command "Start Dictating" to trigger dictation
  4. It should not work.

Unity editor version

Unity 2018.4.31f1,

Mixed Reality Toolkit release version

MRTK 2.7.2 - Windows Holographic OS Build: 20348.1450

elbuhofantasma commented 2 years ago

Hello @tletie thank you for the Voice Dictation bug submission! I would like some additional information, as I do not completely understand your reproduction steps.

The reproduction steps sound like you are opening up the Dynamics 365 Remote Assist application and attempting to log into Dynamics 365 by typing in the credentials with Voice Dictation. Are you attempting to do this Dynamics 365 login inside of your MRTK app or are you just trying to log into the Dynamics 365 app with Voice Dictation?

tletie commented 2 years ago

@elbuhofantasma Thank for your response.

  1. I first build an immersive app using MRTK with Text Input Field that trigger keyboard => I then attempt to trigger voice dictation by "Start Dictating" voice command doesn't work.
  2. I then try using the text input field of Remote Assist or Dymanic 365 using voice dictation => They both don't work either with "Start Dictating" voice command. Hope this clear to you. Thanks
elbuhofantasma commented 2 years ago

@tletie You are welcome, I am here to help!

Thank you for clarifying your reproduction steps. I will work on reproducing this issue right now and update this issue with my results shortly.

tletie commented 2 years ago

@elbuhofantasma thank you so much.

IssueSyncBot commented 9 months ago

We appreciate your feedback and thank you for reporting this issue.

Microsoft Mixed Reality Toolkit version 2 (MRTK2) is currently in limited support. This means that Microsoft is only fixing high priority security issues. Unfortunately, this issue does not meet the necessary priority and will be closed. If you strongly feel that this issue deserves more attention, please open a new issue and explain why it is important.

Microsoft recommends that all new HoloLens 2 Unity applications use MRTK3 instead of MRTK2.

Please note that MRTK3 was released in August 2023. It features an all-new architecture for developing rich mixed reality experiences and has a minimum requirement of Unity 2021.3 LTS. For more information about MRTK3, please visit https://www.mixedrealitytoolkit.org.

Thank you for your continued support of the Mixed Reality Toolkit!