search

WEKIT-ECS / MIRAGE-XR

MirageXR is a reference implementation of an XR training system. MirageXR enables experts and learners to share experience via XR and wearables using ghost tracks, realtime feedback, and anchored instruction.
Other
28 stars 5 forks source link

Ghost: Record fingers movement #871

Closed wekitecs closed 1 year ago

wekitecs commented 2 years ago

Users expect that the ghost recording will also record their finger movements (Santawat).

MRTk supports finger tracking - as the ghost hands already indicate. Make sure that there is graceful degradation to mobiles, as they cannot record hand and finger movement.

fwild commented 2 years ago

This requires to extend the data frame so that it holds finger data not only hand pose data.

fwild commented 2 years ago

At this opportunity it might be an idea to convert to JSON (and abandon XML). This is a breaking change, so we should make sure there is graceful degradation if fingers are not supported. Or a check for versions is implemented here, so we can still run old files!

fwild commented 2 years ago

This has been raised repeatedly now in presentations I gave as questions from the audience!

fwild commented 2 years ago

Here is the documentation for the hand tracking: https://docs.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/mrtk2/features/input/hand-tracking?view=mrtkunity-2022-05

fwild commented 1 year ago

Implemented, therefore closing.