HengyiWang / Co-SLAM

[CVPR'23] Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAM
https://hengyiwang.github.io/projects/CoSLAM.html
Apache License 2.0
403 stars 36 forks source link

Floaters in the rendering visualizations #36

Open ming82871 opened 10 months ago

ming82871 commented 10 months ago

Hi! Thanks for your great work! We intend to evaluate some Tum sequences with your code. We found that there are some floaters in the rendering image and depth(We provide some visualizations about fr2_xyz and fr3_long_office sequence). Can you give me some suggestions or experience about this phenomenon? Do you think Hash collision is a potential cause? Thanks!

微信图片_20231107204430

6f2afddfdcad2c954b43710abbd3876

HengyiWang commented 10 months ago

Hi @ming82871, thanks for your interest in our work. There are several potential reasons for this issue. 1) For rendering these results, have you used depth-guided sampling? As our truncation region is quite small, you need to use either depth-guided sampling or importance sampling (or just a sufficiently large amount of sample points) to make sure there are sample points within the truncation region. 2) Co-SLAM keeps and trains on only a small fraction of pixels with a small number of iterations for efficiency, you may not be able to get a high PSNR for rendering due to the insufficient number of pixels used for training.

glaciomarine commented 10 months ago

Hello, excuse me, how to do visualization