pierotofy / OpenSplat

Production-grade 3D gaussian splatting with CPU/GPU support for Windows, Mac and Linux 🚀
https://antimatter15.com/splat/?url=https://splat.uav4geo.com/banana.splat
GNU Affero General Public License v3.0
863 stars 80 forks source link

SfM-Free Support #41

Open pfxuan opened 6 months ago

pfxuan commented 6 months ago

Current 3DGS training pipeline is heavily relying on the SfM initialization, which introduces a significant overhead when scaling to large scenes. Technically, 3DGS should be capable of producing relevantly good results with a randomly or strategically initialized point cloud:

While waiting for the release of COLMAP-Free 3DGS codebase, RAIN-GS appears to offer a similar or potentially simpler solution for decoupling the SfM step. This involves sparse-large-variance (SLV) initialization along with progressive gaussian low-pass filter control.

pierotofy commented 6 months ago

Interesting work for sure! The downside of colmap-free-2dgs is that the method relies on neural nets (DPT https://github.com/isl-org/DPT) for the monocular depth estimation step.