search

microsoft / MixedRealityToolkit-Unity

This repository is for the legacy Mixed Reality Toolkit (MRTK) v2. For the latest version of the MRTK please visit https://github.com/MixedRealityToolkit/MixedRealityToolkit-Unity
https://aka.ms/mrtkdocs
MIT License
6k stars 2.12k forks source link

Speech recognition and predifined VC don't work in editor #11717

Closed yeahbunny closed 11 months ago

yeahbunny commented 1 year ago

Describe the bug

Speech recognition and VC don't work for new project (configured for Mixed Reality) as well as for example MRTK project in Editor. I have installed the latest MRTK package and enabled all necessary capabilities in Player -> Publishing -> Capabilities. I checked in many different applications the microphone works fine. My project is configured for UWP platform and I have configured the profile for the MixedRealityToolkit script in the scene. Unfortunately, VC like "select" or predefined VC for specific buttons won't work in Unity Editor. I tested it on a clean MRTK project and for my own app.

To reproduce

Steps to reproduce the behavior:

  1. Instal Unity 2021.3.8f1
  2. Instal latest MRTK
  3. Run Speech example scene from MRTK
  4. VC ("rotate") doesn't work

Expected behavior

VC works as it should.

Your setup (please complete the following information)

Target platform (please complete the following information)

AMollis commented 1 year ago

@yeahbunny please ensure you have enabled speech recognition on your HoloLens.

HoloLens Settings App > Privacy > Speech > Turn on > Speech recognition (and maybe Online speech recognition ).

If running in Editor, make sure voice services are also enabled in Windows.

Windows Settings App > Privacy & Security > Speech > Turn on > Online speech recognition

image

Once you've verified these settings, please reply to this issue.

yeahbunny commented 1 year ago

Hi, Thank you for your answer. Yes, I have it enabled.

yeahbunny commented 1 year ago

@AMollis Hi, any update here?

AMollis commented 11 months ago

@yeahbunny , I unfortunately can't reproduce this issue (tries with Unity 2021.3.30)

A couple of tips....

  1. Most of the voice controls require the object to be focused with a pointer. For example, your eye gaze or hand ray. Try pointing your hand ray at the target and speak the voice command
  2. If you want eye gaze to work, make sure you've added the "Eye Gaze Interaction Profile" to the XR Plugin settings (Project Settings > XR Plug-in Management > OpenXR > UWP (and Standalone) > Enabled Interaction Profiles > + > Eye Gaze Interaction Profile). Also make sure your UWP app has requested eye input permissions (Project Settings > UWP > Publishing Settings > Capabilities > GazeInput)
  3. If running in Editor, I found that I had to speak rather loudly, and near the microphone, for the voice input to work (but this could just be my setup).

Going to close this issue as "Not Reproduceable" Please reach out to us if you have further questions.

‼️ Important. For all new applications, we highly recommend using MRTK3 instead of MRTK2. MRTK3 is better supported. You can find MRTK3 documentation at https://mixedrealitytoolkit.org