naive questions about initial rough shape

lvjiahui / DRT

SIGGRAPH Asia 2020: Differentiable Refraction-Tracing for Mesh Reconstruction of Transparent Objects

71 stars 9 forks source link

naive questions about initial rough shape #7

Open ChauChorHim opened 2 years ago

ChauChorHim commented 2 years ago

Hi Jiahui,

Sorry I am just a beginner in the field of computer graphics and lacking relevant background knowledge.

In the paper, you mention that you use method from Kutulakos and Seitz (2020) to reconstruct the initial rough shape. I don't read this paper thoroughly but it seems their method produces a voxel-based model? How this result could be used in your mesh-based method? Also, it would be nice if you could offer relevant codes about reconstructing the shape using silhouette images.

Thank you!

lvjiahui commented 2 years ago

Hi ChauChorHim,

You can extract the 2D surface mesh from 3D volume by the famous marching cube method. See an example here .

Personally, I implement the Space Carving by modifying a TSDF code. It is a very good reference. The only difference is that I use silhouette images instead of depth images.

If you still have questions after figuring out the TSDF code, welcome to contact me!

QiNing-07 commented 2 years ago

Hi jiahui,

You use the silhouette images instead of depth images, and what do you use instead of RGB images? are they images with Gray-coded background as shown in the following figure?