autonomousvision / gaussian-opacity-fields

Gaussian Opacity Fields: Efficient and Compact Surface Reconstruction in Unbounded Scenes
https://niujinshuchong.github.io/gaussian-opacity-fields/
Other
559 stars 26 forks source link

Slow training and no texture mesh #41

Open Jonas7777777 opened 1 month ago

Jonas7777777 commented 1 month ago

Hello, thanks for your excellent work!

Here I meet two problems mainly:

  1. When I run original Gaussian Splatting on MIP NeRF 360_v2/kitchen scene, it can achieve around 25 it/s as showing as following. image

But the traininng on GOF is slow, it takes totally more than two hours (3.5 it/s) for training of this scene as following image

  1. There is no teture on mesh, how can I configure and add the color on it? Image

System: Linux 22.04 RTX 4090

Thanks in advance if someone solves it. Jonas

niujinshuchong commented 1 month ago

Hi, I just added mesh texturing. Please pull the latest code and extract the mesh with --texture_mesh.

The training speed is not as fast as 3DGS since the current cuda code is not fully optimized. Will try to optimize it later.

Shhfdsdf commented 1 month ago

Hi, I just added mesh texturing. Please pull the latest code and extract the mesh with --texture_mesh.

The training speed is not as fast as 3DGS since the current cuda code is not fully optimized. Will try to optimize it later.

image Hi! thanks for your great project ! I use the latest code and make this mesh, it seems that the color of my mesh is the depth value. Can the color of the vertices be the real color or an approximation of the actual color?

Jonas7777777 commented 1 month ago

Hi, I just added mesh texturing. Please pull the latest code and extract the mesh with --texture_mesh.

The training speed is not as fast as 3DGS since the current cuda code is not fully optimized. Will try to optimize it later.

Thanks for your quick response and update of source code!

When I run extract_mesh.py as following: python extract_mesh.py -m ./exp_360/release/kitchen --iteration 30000 --texture_mesh

image

It seems the color of the vertices is not correct. Any explainations for this ? Thanks!

niujinshuchong commented 3 weeks ago

Hi, the textured mesh looks ok from my side. Could you try to test it on the lego scene in the nerf-synthetic dataset first? Screenshot from 2024-06-03 10-48-55 Screenshot from 2024-06-03 10-47-25

Maybe you need to re-compile the cuda code.