search

microsoft / MixedRealityToolkit-Unity

This repository is for the legacy Mixed Reality Toolkit (MRTK) v2. For the latest version of the MRTK please visit https://github.com/MixedRealityToolkit/MixedRealityToolkit-Unity
https://aka.ms/mrtkdocs
MIT License
6k stars 2.12k forks source link

Make hand mesh rendering more performant #5097

Closed julenka closed 9 months ago

julenka commented 5 years ago

Overview

The hand mesh rendered in MRTK can currently reduce the frame rate of the HandInteractionExample scene. This issue covers investigating ways to improve rendering performance of the hand mesh.

Options to consider

Some mesh improvements planned for Unity 2019.3 that might help make our hand mesh more performant: https://forum.unity.com/threads/feedback-wanted-mesh-scripting-api-improvements.684670/

Investigate updating the hand mesh using NativeVertexBuffer and NativeIndexBuffer pointers. Our current method looks to have a lot of overhead/allocations. https://bitbucket.org/Unity-Technologies/graphicsdemos/pull-requests/2/example-of-native-vertex-buffers-for/diff

If hand mesh is already a D3D resource we could pump it right into Unity using the above method rather than D3D Mesh-> Unity Mesh -> D3D Mesh and maybe avoid having to cross that native to manged code barrier and back.

provencher commented 4 years ago

Might it be possible to generate a "fake hand mesh"? That mesh would be a skinned mesh renderer that is pre-built, and for which we manually animate bones based on data from the HandJointService.

rolandsmeenk commented 4 years ago

Note that a Rigged Hand Visualizer was added recently #7993

IssueSyncBot commented 9 months ago

We appreciate your feedback and thank you for reporting this issue.

Microsoft Mixed Reality Toolkit version 2 (MRTK2) is currently in limited support. This means that Microsoft is only fixing high priority security issues. Unfortunately, this issue does not meet the necessary priority and will be closed. If you strongly feel that this issue deserves more attention, please open a new issue and explain why it is important.

Microsoft recommends that all new HoloLens 2 Unity applications use MRTK3 instead of MRTK2.

Please note that MRTK3 was released in August 2023. It features an all-new architecture for developing rich mixed reality experiences and has a minimum requirement of Unity 2021.3 LTS. For more information about MRTK3, please visit https://www.mixedrealitytoolkit.org.

Thank you for your continued support of the Mixed Reality Toolkit!