TQTQliu / MVSGaussian

[ECCV 2024] MVSGaussian: Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereo
https://mvsgaussian.github.io/
MIT License
347 stars 18 forks source link

A question about Hybrid Gaussian Rendering. #2

Closed thucz closed 3 months ago

thucz commented 3 months ago

The depths of input views are already known. But for a target view, how do you get the depth of the only sample point for the volume rendering?

TQTQliu commented 3 months ago

Thanks for your interest.

  1. The depths of the input views are unknown, we only input RGB source views.
  2. We warp the features of the input views to the target viewpoint, constructing a cost volume, and then regress to obtain the depth at the target viewpoint. With the estimated depth at the target view, we can sample points for rendering.
thucz commented 3 months ago

Thanks! I understand.