Open saimouli opened 1 year ago
Hi @saimouli, thank you for your issue.
We have tried to execute the program and found out that the result might vary a lot on different machines, and the result is fair on 2080 Ti while of high quality on 3070 Ti. Would you provide the model of your GPU? Thanks.
FYI, here's the rendered output on 3070 Ti machine when the training phase of SLAM has completed.
I didn't expect that in monocular cases. It should be both ok when using RTX 3090 (in the paper). I test the monocular case on RTX 2080 Ti and the result seems similar to yours.
However, RGB-D seems well on RTX 2080 Ti.
You can see that the loss of monocular is at around 0.017 and the loss of RGB-D converges to 0.0035 on my RTX 2080Ti machine.
@jeff999955 told me that the loss of monocular converges to 0.006 on his RTX 3070. It seems that monocular requires more training resource, but I did not expect that GPU matters that much.
This should be normal in monocular case, because we don't know the scale between SLAM in the real world in monocular case. It is called ``Scale ambiguity" in monocular SLAM. Given two RGB images, you can estimate the rotation but you can't get the real translation between two images. You can define the translation of the first two images as 1 unit and use it for the rest of SLAM system, but you don't know if it is 1 cm or 1 m in the real world. This is because when solving the essential matrix, by epipolar constraint: $x_{1} = [u_1, v_1, 1]^{T}, x_2=[u_2, v2, 1]^{T}$ $x{2}^{T} E x_{1} = 0.$ No matter the scale of essential matrix, is still satisfies the epipolar constraint. You need depth to get the correct scale.
Tried the rgbd and mono demo on NVIDIA RTX A4500 and cannot be able to render the scene on instant ngp. Wonder why would GPU matter that much!
However, Instant ngp and nerf slam is able to run normally on this GPU though
I thought RTX A4500 should be good enough. Did you change your GPU but did not rebuild the project? The compilation is GPU dependent, so you need to rm build
and cmake
it again. If it is not the case, I will go check the code in my forked instant-ngp. It might be my forked version is not up to date.
Hi @saimouli. Did you solve the problem? Does the problem relate to rebuild the project?
I am still facing the same issue. I don't think rebuilding is the issue. I have built the entire project and cannot get proper output when I run ./run_fox script on your instant ngp branch
Hi,
I got similar bad results on 4090. I tried both local installation and Docker. I also tried on a 3090 machine. I got similar blur results in the demo video. The loss gets stuck at 0.15. Does the author have any idea how to set the parameters?
Thanks, Yongqing
Hi, I also encountered similar bad results when running on RTX A6000,
I have noticed the following warning during runtime. I am not sure if this type of problem is caused by it. Can the author also receive this warning? How can I eliminate the warning?
Thanks
The warning is normal in the beginning. I have updated the Docker.md, and you may need to modify the Dockerfile to make it compatible with your CUDA version and architecture.
Dense reconstruction results are not good is this expected for monocular case?