isl-org / Open3D

Open3D: A Modern Library for 3D Data Processing
http://www.open3d.org
Other
11.37k stars 2.29k forks source link

TSDF improvement recommendations #1059

Closed Jason420Git closed 4 years ago

Jason420Git commented 5 years ago

Hi,

I am getting some issues with the meshes produced in areas where there is a depth discontinuity (even if small).

I am doing some scanning with a stereo 3D depth sensor. If I scan a face left to right, the right side of the model always tends to have a ridging artefact. I have also observed this at the adams apple. I believe it is due to discontinuity, depth is noisier there and creating this raised part.

If I process the same scan but integrate the frames in the reverse order, then this problem appears at the other side. I am wondering if this is observed as a meshing issue? As it is dependent on the order of integration of the frames.

nose_side_noise_1 nose_side_noise_2

I use the scalable volume. tsdf truncation is 0.001 and resolution 1 / 2048

theNded commented 4 years ago

Our ScalableTSDF is generally designed for large scale reconstruction. To finetune details, we may have to use photometric stereo and similar frameworks like https://github.com/NVlabs/intrinsic3d. Closed for now, will reopen if revisited.