search

btsmart / splatt3r

Official repository for Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairs
Other
536 stars 20 forks source link

Awesome. Can you add a Gradio demo which has training as well for better quality? #10

Closed FurkanGozukara closed 2 months ago

FurkanGozukara commented 3 months ago

Awesome. Can you add a Gradio demo which has training as well for better quality?

Thank you so much

btsmart commented 3 months ago

Hello,

Are you suggesting adding a post-processing step which takes the generated Gaussian Splat, and then performs regular 3DGS training using the two input views as supervision? I would be very keen to see the results from this process, but I do not currently plan to implement per-scene training procedures in this repo.

There are works such as InstantSplat (https://instantsplat.github.io/) and Wild Gaussian Splatting (https://github.com/nerlfield/wild-gaussian-splatting) which initialize point clouds from DUSt3R predictions and optimize them using 3DGS and see very good results. I suspect our results would be very similar, perhaps with slightly faster convergence because our Gaussians would be better initialized.