search

mbortolon97 / 6dgs

Code of the paper: 6DGS: 6D Pose Estimation from a Single Image and a 3D Gaussian Splatting Model
Other
105 stars 11 forks source link

Can this project be used for real-time 6dof spatial positioning? #5

Open GottenZZP opened 1 month ago

GottenZZP commented 1 month ago

Hello, thank you very much for open-sourcing such a great project. I would like to ask you, can this project be used for real-time 6dof spatial positioning? For example, if I already have a scene trained with 3D GS and have the corresponding point cloud files, can I continuously input photos of actions in the above scene and then obtain the corresponding 6dof positioning?

GottenZZP commented 1 month ago

I found that when I input a sequence of continuous images into your prediction algorithm, the predicted 6 degrees of freedom (6dof) pose is generally continuous, but the predicted viewpoint tends to oscillate back and forth. For example, if the content of the continuous images I input is a continuous forward movement, the predicted pose also shows a continuous forward movement overall. However, during the movement, the predicted pose constantly shakes irregularly back and forth in all directions. Is there any way to solve this issue? Thank you very much!