Attributes in render function are not defined

[maurock]

Hi, thanks again for open-sourcing this rasterizer. The README file mentions that the rasterizer should be called using: render(..., viewmatrix=w2cT, fov=(self.half_tanfovx, self.half_tanfovy), HW=(self.H, self.W), ...). However, the render() function is not implemented in this submodule, as it is likely implemented in the gaussian-splatting repository linked to this rasterizer. The GaussianRasterizationSettings class requires the following:

    image_height: int
    image_width: int 
    tanfovx : float
    tanfovy : float
    bg : torch.Tensor
    scale_modifier : float
    viewmatrix : torch.Tensor
    projmatrix : torch.Tensor
    sh_degree : int
    campos : torch.Tensor
    prefiltered : bool
    debug : bool
    perspec_matrix : torch.Tensor
    track_off : bool
    map_off : bool

I have two questions:

• What is the perspec_matrix required by the rasterizer, and how can we build it?

• Should the viewmatrix and projmatrix be differentiable, or do the gradients flow through the rasterizer and to the perspec_matrix? In other words, are the gradients wrt the camera poses only propagated through the perspec_matrix?

  Thank you very much!

[nnanhuang]

same question, have you figure it out?

[hjr37]

Thank you for your attention, ‘perspec_matrix’ in render()，is 'projection_matrix.T' in the original 3DGS.