GAP-LAB-CUHK-SZ / gaustudio

A Modular Framework for 3D Gaussian Splatting and Beyond
MIT License
898 stars 45 forks source link

Inquiry of Supporting Colmap-free 3d Gaussian Splatting #46

Open CDchenlin opened 3 weeks ago

CDchenlin commented 3 weeks ago

Hi Chongjie,

Thank you so much for your insightful work. May I kindly ask if there is any plan to support Colmap-free 3d Gaussian Splatting in your studio?

Sincerely, Chenlin

hugoycj commented 3 weeks ago

In my opinion, dust3r-based initialization could be a better choice. Colmap-free 3D Gaussian splatting only supports sequential data,and it takes a significantly longer time to reconstruct compared to using COLMAP first and then applying 3D Gaussian splatting. One advantage of colmap-free over dust3r-based initialization is that it can handle a larger number of images (e.g., more than 30). However, I believe that in the near future, this issue could be addressed by employing engineering-based methods like divide-and-conquer or better pair selection strategies.

CDchenlin commented 3 weeks ago

Hi Chongjie,

Thank you so much for your prompt response. I think building 3D scen from sequential data might be important in medical field. As we have a large number of video-based data, i.e. endoscopy. Therefore, colmap-free methods may facilitate this area.

Sincerely, Chenlin