cvg / depthsplat

DepthSplat: Connecting Gaussian Splatting and Depth
https://haofeixu.github.io/depthsplat/
MIT License
456 stars 15 forks source link

Using Depth Information from LiDAR or DepthPro Instead of DepthAnything #3

Open AbedSoleymani opened 1 week ago

AbedSoleymani commented 1 week ago

Is it possible to use depth information from other sources like LiDAR or more accurate models such as Apple’s DepthPro, instead of DepthAnything, in your model?

haofeixu commented 1 week ago

Hi, it's also possible to integrate Depth Pro's monocular features into our model, though end-to-end fine-tuning is necessary to achieve 3D consistent results with Gaussian splatting. For LiDAR, it might be less straightforward to use it in our model.