MisEty / RTG-SLAM

RTG-SLAM: Real-time 3D Reconstruction at Scale Using Gaussian Splatting (ACM SIGGRAPH 2024)
https://gapszju.github.io/RTG-SLAM/
GNU General Public License v3.0
174 stars 12 forks source link

Is there anyway to check out the reconstructed 3d scene online? #7

Closed jeezrick closed 1 week ago

jeezrick commented 2 weeks ago

Hi, I wonder if you know Is there anyway to Check out the 3d reconstruction's quality during the slam process.

You can toggle around and zoom in ...

I think I see it in your video in github page, would you mind share your method? thanks.

MisEty commented 1 week ago

Yes, similar to the SIBR_remoteGaussian_app in 3DGS, we have implemented an online visualization tool. However, due to the large amount of code in this project and the fact that we only prepared a Windows version, we have not yet finished organizing the code, so it will not be open-sourced recently. If you're interested, you can modify the SIBR_remoteGaussian_app as a reference, or use our rendering functions to save images for visualization during the SLAM process.

jeezrick commented 1 week ago

Thanks for the reply. I utilized a viewer to inspect the ply file post-mapping. However, the TUM-RGBD scene appears underwhelming; it is filled with floaters and semi-transparent Gaussians, which I assumed would be eliminated according to the methods you described in the paper. Should this outcome be anticipated?

00000

jeezrick commented 1 week ago

I also ran your dataset 'hotel'; it's pretty good, as seen on your GitHub page. So I wonder what the key factor is here: the hyperparameters of Gaussian mapping, the image FPS, or the depth quality? Can you shed some light?

MisEty commented 1 week ago

The depth quality is very important because we set the positions of Gaussians by the depth loss term. If Gaussians are put into wrong places, the SHs and shapes may be strange to fit the color images. The hyperparameters of Gaussian mapping also need to be changed according to the data. For example, if the image FPS is high, you can set larger gaussian_update_frame and if the scene is complex, you need to set larger gaussian_update_iter.