nexuslrf / SPIDR

Codes for: "SPIDR: SDF-based Neural Point Fields for Illumination and Deformation"
https://nexuslrf.github.io/SPIDR_webpage
Other
76 stars 4 forks source link

Insight in the regularization to improve the continuity and consistency of predicted SDF values. #10

Open liuxiaozhu01 opened 1 year ago

liuxiaozhu01 commented 1 year ago

Hi! Thanks for your brilliant work! I am wondering the insight in the regularization to improve the continuity and consistency of predicted SDF values(code here i guess), which correspoding the Eq. 11

nexuslrf commented 1 year ago

Hi, thanks for your interest! A figure from my old slides may help you better understand the design of this regularization.

image

the change in the predicted SDF $\Delta d$ is constrained in such a right triangle relationship.

liuxiaozhu01 commented 1 year ago

Thank you for your sharing! It looks like that this regularization might has a same effect as eikonal loss, which constrain the gradient modulus of the SDF is one $(| \nabla SDF | - 1)^2 = 0$, while eikonal loss is a stronger one?

nexuslrf commented 1 year ago

Yeah, your understanding is correct. This loss term can be treated as a loosened approximation of eikonal loss. We use this to replace the eikonal term to avoid second-order optimization wrt SDF gradient.

liuxiaozhu01 commented 1 year ago

I am wonder whether this term also benifit to the smoothness of sdf, because the discretized neural representation based on point clouds is unstructured, and it is extremely likely that the sdf will not be smooth.

nexuslrf commented 1 year ago

From my observation, it can improve the smoothness (also shown in Fig. 3 of the paper), but it cannot guarantee perfect smoothness due to the nature of unstructured points. Anyway, this work is just an earlier attempt. I feel an eikonal loss with high-order numerical gradients (e.g., Neuralangelo) could be more beneficial. I guess some similar thoughts could be applied to the SDF reconstruction with gaussian spatts. XD).

liuxiaozhu01 commented 1 year ago

Constructing neural surface from point indeed is a hard problem. Thanks for your great work taking a step forward to this problem!