Placing objects in UE room at exact same location as seen in the video - mimic a Tesla FSD visualization, but in a room

[samphilips]

Preliminary Checks

• [X] This issue is not a duplicate. Before opening a new issue, please search existing issues.
• [X] This issue is not a question, bug report, or anything other than a feature request directly related to this project.

Proposal

Can we recreate a tesla FSD visualization in a room with people and objects around us ? For example, if a video stream is given, we are already able to view the body tracking information in a room, similarly, if we could add a spatial awareness in the room and place objects at the exact same location by object detection algorithms and localization of the objects in a spatial dimension basically creating a live simulated view of a room very similar to an FSD visualization of Tesla.

Use-Case

We are trying to create a simulated visualization of a room similar to tesla, image attached for our use case

Anything else?

The thought process I am having right now is as follows:

1. Get spatial awareness of the room by the spatial mapping
2. We can use multiple ZED camera to get the spatial orientation of people in the room
3. Body tracking algorithm to place the avatar in UE5
4. Object detection algorithm to detect the object and place it in the 3D space

[github-actions[bot]]

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment otherwise it will be automatically closed in 5 days