5G-MAG / rt-xr-unity-player

XR Unity Player
https://5g-mag.github.io/Getting-Started/pages/xr-media-integration-in-5g/
Other
4 stars 1 forks source link

enable user to manipulate a 3D model anchored to the floor #41

Open nlsdvl opened 4 months ago

nlsdvl commented 4 months ago

Currently, the only way for users to control positioning of objects in AR is to use a 2D marker. While the player supports AR anchoring to a floor or plane, the positioning on that surface is not adjustable by users.

The goal is to enable users to adjust position of the anchored 3D scene or node anywhere they wich.

TBD : This could be considered default player behaviour for anchors, or else it could be implemented taking into account the tracked floor or planes when the gltf scene specifies their use through the MPEG_anchor extension.

cc @Etiennefaivredarcier looking forward to your feedback.

nlsdvl commented 2 months ago

@Etiennefaivredarcier has proposed developer tools to support implementing this:

The PRs are drafts meant to support demonstration of the player.

This is being integrated in a dedicated branch here for demonstration: https://github.com/5G-MAG/rt-xr-unity-player/tree/feature/anchored-object-manipulation

The implementation currently supports only one specific scene. With references to nodes in the scene hardcoded in the player.

See comments on the PR for details: https://github.com/5G-MAG/rt-xr-gITFast/pull/8#pullrequestreview-2271208394

nlsdvl commented 1 month ago

This development was demonstrated at IBC however there is no clear milestone to integrate the changes in a release.

nlsdvl commented 2 weeks ago

No clear milestone for this. The development tools could help with the implementation when a gltf document contains the proper extensions (MPEG_anchor + MPEG_interactivity). The code sample shows how to move the asset, but there is no support for rotation.