hugoycj / 2.5d-gaussian-splatting

an unofficial 2DGS implementation based on GauStudio
https://github.com/GAP-LAB-CUHK-SZ/gaustudio
Other
220 stars 4 forks source link

Render results on dtu dataset. #1

Closed Wuuu3511 closed 2 months ago

Wuuu3511 commented 2 months ago

Thank you for sharing the code.

I tested the code on dtu scan24. Using the script "python train.py -s -m output/trained_result"

It seems there are some issues with the rendering images. The scene appears as if observed through a piece of "blue transparent glass."

image

I'm unable to determine what might be causing this issue,but the rendering results of the mesh seem to be correct.

image

This is the data I generated using COLMAP(https://drive.google.com/file/d/1Kz_zeUbYWMPxnF1mhoLbVJkj7XBt2KpA/view?usp=sharing. I would greatly appreciate it if you could help me solve this problem.

hugoycj commented 2 months ago

Thanks for the feedback! The current code is from our private implementation, and we haven't had the bandwidth to thoroughly test it yet. There are likely some critical issues in the current code that need addressing.

I'll look into it as soon as I can to get those fixes implemented.

hugoycj commented 2 months ago

Snipaste_2024-04-16_15-56-13 The issue caused by the GauStudio's colmap initializer has been resolved. You can now pull and install the latest GauStudio version to fix the error. However, the quality of the extracted mesh is not satisfactory. Some parameters may need to be tuned, and the original distortion loss function and 2DGS rasterization should be implemented to improve the mesh quality.

We sincerely welcome any PR to further improve this implementation.

hugoycj commented 2 months ago
image

We have updated the parameters to get a more detailed mesh.

KKjiaming commented 2 months ago
image

We have updated the parameters to get a more detailed mesh.

hi, i want to kindly ask, have you test the Chamfer distance of dtu dataset, the extarct mesh might has a shift with gt.