Change to prune Gaussians when there actually is any point need to remove.
The old version will do remove_points even when to_remove is all false, which will discard all gradients by calling remove_points function, which leads to a waste of optimizing iteration.
This happens (almost) every 1st iter in mapping. You can check it by running 'replica/splatam_s.py'. The number of gaussians didn't change after prune, but the gradient is gone.
Change to prune Gaussians when there actually is any point need to remove.
The old version will do remove_points even when to_remove is all false, which will discard all gradients by calling remove_points function, which leads to a waste of optimizing iteration.
This happens (almost) every 1st iter in mapping. You can check it by running 'replica/splatam_s.py'. The number of gaussians didn't change after prune, but the gradient is gone.