microsoft / MixedRealityToolkit-Unity

This repository is for the legacy Mixed Reality Toolkit (MRTK) v2. For the latest version of the MRTK please visit https://github.com/MixedRealityToolkit/MixedRealityToolkit-Unity
https://aka.ms/mrtkdocs
MIT License
6k stars 2.12k forks source link

User-centric object placement controls #8962

Closed kndrewa closed 9 months ago

kndrewa commented 3 years ago

Describe the problem

Holograms come in many sizes, and bounding box affordances for positioning, resizing, and rotating do not work well for smaller and larger objects. Small object bounding boxes make it hard to grab the right corner resize or centerline rotate controls. Large object bounding boxes make it hard to see what's happening when resizing from a corner - the action is happening out of the FOV, so the mixed reality context of hologram and real world cannot be evaluated in real time, making it a clumsy interaction. Furthermore, user distance to hologram is a factor that makes interactions less predictable and successful depending on circumstance. Altogether, the bounding box control does not fit diversity of user needs, and forces the user to adapt to the control

Describe the solution you'd like

We propose a solution that ensures the holographic controls adapt to the user. This means the human is the most important ingredient in any interaction. D365 Guides solves these problems by always orienting the 3D controls to the user. The user does not have to move to get the right angle, since the controls move to face them. If the user backs up, the controls grow, ensuring it's always easy to grab the right control, even when further away from the hologram. The user can effortlessly move between direct touch and far laser, while targeting the same controls in a repeatable way. The controls are centered on the object, so no matter the hologram size, the interaction for resizing and rotating is uniform and successful.

Describe alternatives you've considered

There are edge cases with the Guides solution, such as a lack of precision increments or nudge features constrained to a specific axis. It'd be awesome if we see the community adding in these much requested features. But user-centric is much better than object centric for the diversity of size and distance and orientation of interactions that happen when placing holographic content.

Additional context

https://docs.microsoft.com/en-us/dynamics365/mixed-reality/guides/authoring-gestures-hl2 https://docs.microsoft.com/en-us/dynamics365/mixed-reality/guides/hololens-app-orientation#manipulate

IssueSyncBot commented 9 months ago

We appreciate your feedback and thank you for reporting this issue.

Microsoft Mixed Reality Toolkit version 2 (MRTK2) is currently in limited support. This means that Microsoft is only fixing high priority security issues. Unfortunately, this issue does not meet the necessary priority and will be closed. If you strongly feel that this issue deserves more attention, please open a new issue and explain why it is important.

Microsoft recommends that all new HoloLens 2 Unity applications use MRTK3 instead of MRTK2.

Please note that MRTK3 was released in August 2023. It features an all new architecture for developing rich mixed reality experiences and has a minimum requirement of Unity 2021.3 LTS. For more information about MRTK3, please visithttps://www.mixedrealitytoolkit.org.

Thank you for your continued support of the Mixed Reality Toolkit!