muskie82 / MonoGS

[CVPR'24 Highlight & Best Demo Award] Gaussian Splatting SLAM
https://rmurai.co.uk/projects/GaussianSplattingSLAM/
Other
1.26k stars 109 forks source link

combine with vins or orbslam3 #112

Open knightzzz9w opened 2 months ago

knightzzz9w commented 2 months ago

The paper mentioned that you add camera pose from orbslam3. I have tried a similar way, add vins pose estimation result in MonoGS, and then don't update the pose. The ATE error is smaller , but I can't get a better rendering result compared to baseline. And I have tried to update keyframe pose in the backend, but still get a lower psnr(in MH02 , baseline psnr 27, my result is 23). I wonder to know why there is a decrease in the PSNR, and how you add orbslam3's pose into the whole system?

Thanks!

minsoo5403 commented 2 months ago

I tried the same approach, but in MonoGS, fixing the pose to the GroundTruth Pose without rendering updates affects accuracy.

In the internal algorithm, the camera parameters are optimized together with the pose after rendering, so fixing them to the GT values leads to an inaccurate map update.