Chrixtar / latentsplat

[ECCV 2024] Implementation of latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstruction
https://geometric-rl.mpi-inf.mpg.de/latentsplat/
MIT License
146 stars 3 forks source link

Questions about feature rendering in latent-gaussian-rasterization #15

Open guoyww opened 3 weeks ago

guoyww commented 3 weeks ago

Dear authors,

First thanks for this great work!

I am trying to render high dimensional features using latent-gaussian-rasterization. In my use case, I don't need rendered colors so I just leave them untouched. I notice that if I only compute loss on rendered features and do backpropagation, the gradient on gaussians' covariance and opacity will be zero.

Is this behavior correct? It seems better to also propagate gradient from feature to covariance & opacity.

Many thanks!