search

microsoft / MixedReality-UXTools-Unreal

UX tools and components for developing Mixed Reality applications in UE4.
https://microsoft.github.io/MixedReality-UXTools-Unreal/
MIT License
316 stars 86 forks source link

Additional Hand Gestures Requested #40

Closed greenwoodms06 closed 3 years ago

greenwoodms06 commented 3 years ago

The hand gestures currently available in UXTools (i.e., grab and select) are great. However, some additional basic built in gestures may be very valuable to the community. Examples may include:

Not sure if you are taking feature requests but thought it wouldn't hurt to ask. Thanks for all your efforts.

luis-valverde-ms commented 3 years ago

Thanks for the feedback @greenwoodms06 .

You can listen for tap gestures using UE's action mappings directly (in OpenXR). If you do so, bear in mind there is a bug in UXT 0.12.0 that prevents user code from receiving those events: #41 . There's a fix for that in #39 .

We have in our backlog enabling interaction with UXT controls via Gaze and Commit, but have no timeline for it at the moment.

We don't have side side swipes or ok/stop gestures in our sights at the moment. Have you seen them used anywhere (e.g. in MRTK-Unity)?

greenwoodms06 commented 3 years ago

Regarding the mapping, I did in fact run into that action mapping bug and modified 0.12 based on those commits last week. Once I did that I implemented my own double tap using the built in grip/select using timers and got the functionality I was hoping for while avoiding overriding its default capabilities. So mission accomplished here I think.

Yup, understand the backlog. I'm sure yall have a large list of to-do's. Lot's to do to catchup to the Unity side.

Regarding side swipes, my initial thoughts would they would be really great for things like dismissing/closing messages and menus. More broadly, ok/stop gestures falls in the realm of not what already exists but if available what would folks do with them if they did exist. I would think there would be a nice procedural or ML method for generating new gestures for UXT tools using things such as standard sign language symbols/gestures. Those would seem to be a great area to look at for ideas of things that would be useful for users. Anyways, just throwing out ideas.

Much obliged for your response. Feel free to close this issue if you don't need it anymore. Cheers!