Hands-Free Button - Githubissues

microsoft / MixedRealityToolkit-Unity

This repository is for the legacy Mixed Reality Toolkit (MRTK) v2. For the latest version of the MRTK please visit https://github.com/MixedRealityToolkit/MixedRealityToolkit-Unity

https://aka.ms/mrtkdocs

MIT License

6.01k stars 2.12k forks source link

Hands-Free Button #6153

Closed gilbdev closed 5 years ago

gilbdev commented 5 years ago

Describe the problem

Seems i didn't find this kind of button yet:

Having a prefab button that can be clicked automatically after focusing it for a given time.

This is useful when both of your hands are used with real (or virtual..) tools for example (mostly an hololens request, but can be applied elsewhere too i guess).

Describe the solution you'd like

user focus the button (with head or eye tracking)
the button 'fills' visually
the user can unfocus it to cancel
once fully filled, the onclick is automatically triggered
if the user stays focus on the button after it has been triggered, the fill process does not start (user has to unfocus and focus again)

Additional Context

see Guides 365 videos for examples

cre8ivepark commented 5 years ago

@sostel has been investigating Gaze & Dwell button.

ritijain commented 5 years ago

This was an attempt to bring the Guides 365 implementation to MRTK - https://github.com/microsoft/MixedRealityToolkit-Unity/blob/mrtk_development/Assets/MixedRealityToolkit.SDK/Experimental/Features/Dwell/DwellHandler.cs

Unfortunately there is no prefab for this yet. But there is an example scene which demonstrates this -

https://github.com/microsoft/MixedRealityToolkit-Unity/blob/mrtk_development/Assets/MixedRealityToolkit.Examples/Experimental/Dwell/DwellScene.unity

sostel commented 5 years ago

@sostel has been investigating Gaze & Dwell button.

@gilbdev Yes, this is already part of the eye tracking demo scenes, but is not well documented yet. If you try out the eye tracking demo scenes, you can say "Enable dwell" and you can simply look at (or move the simulated eye gaze cursor over) at one of the UI elements in the top bar of the scenes that let you switch between the eye tracking examples. You can also load the scene and reuse the buttons that are used there which have the DwellSelection.cs script attached.

julenka commented 5 years ago

There is also a set of experimental dwell buttons in mrtk under MRTK.Examples/Experimental/Dwell that do what you are asking for. Closing since the features exist as experimental. Would love to hear your feedback on the dwell buttons we have so far! See #5594

gilbdev commented 5 years ago

Thanks all! will try that dwell button :)