search

WEKIT-ECS / MIRAGE-XR

MirageXR is a reference implementation of an XR training system. MirageXR enables experts and learners to share experience via XR and wearables using ghost tracks, realtime feedback, and anchored instruction.
Other
28 stars 4 forks source link

Ghost/Character: merge #944

Open fwild opened 2 years ago

fwild commented 2 years ago

Ghost and character models could be merged, allowing for more flexibility regarding how to use the feature.

This requires a complete redesign of the connected editing user interface and the character/ghost behaviour.

Notably, it also requires that ghost tracks can also be used on full-size avatars, which in itself is a challenge: full-body avatars controlled by the sparse motion capture data available from ghost tracks (head position, gaze direction, hand position/orientation) will need a much smarter IK and interpolation system to translate this sparse directional info into less uncanny full-body movement.

Most notably, this would have to involve some sort of delayed shoulder movement and a smart animation system for walking, so that the body becomes less rigid (and stops looking like wolfenstein 3D).

fwild commented 2 years ago

From an earlier ticket: The ghost and the character models could be one - either adding manipulation functionality for the path (and hands paths) to the ghost, or converting ghost recording to a path and animation for the character model. This is an interesting idea - but still probably in the distant future.

fwild commented 2 years ago

This change would probably warrant to rename the new combined augmentation to "instructor" (covers both "trainer" and "teacher") or "instructor hologram".