IntelRealSense / librealsense

Intel® RealSense™ SDK
https://www.intelrealsense.com/
Apache License 2.0
7.42k stars 4.8k forks source link

Bad face reconstruction quality with D435 camera #13053

Closed matteocarbonara1234 closed 3 days ago

matteocarbonara1234 commented 1 week ago

Hi,

I am working on an algorithm which makes 3D face reconstruction starting from a set of images and in particular I am comparing the results obtained with both SR300 and D435 camera. From the tests I have made, the result obtained with the SR300 camera is more accurate and detailed, in particular near the nose. I have tried different depth settings, different distances from the camera and different resolutions of the depth map, but the results are always better with the SR300 camera.

My question is: is it normal in this specific context i.e. face reconstruction to obtain worse results with the D435, even if it is a newer camera? and if not, what parameters should I modify in order to improve the quality of the surface reconstruction?

Thanks for the help

MartyG-RealSense commented 1 week ago

Hi @matteocarbonara1234 SR300 and D435 are different camera technologies. SR300 is Coded Light (similar to a technology called Structured Light) and D435 is Stereo Depth (generating the depth image from a pair of left and right sensors). In this particular application the Coded Light technology of a SR300 typically produces better solid facial masks of the type shown above.

May I confirm please that you are not applying a post-processing Decimation Filter to the D435 data? That could result in a blurring of the image as the Decimation filter 'downsamples' the resolution.

matteocarbonara1234 commented 1 week ago

Hi @MartyG-RealSense, thank you for the response.

I confirm that I am not applying a post-processing Decimation Filter to the D435 camera.

MartyG-RealSense commented 1 week ago

You could next try increasing the Laser Power setting to its maximum value of '360'. Doing so should increase the amount of detail on the depth image and make the camera's invisible dot-pattern projection more visible to the camera. The camera uses the projection of the dots onto real-world surfaces to analyze those surfaces for depth information.

matteocarbonara1234 commented 1 week ago

I have just tried to increase the Laser Power setting to its maximum value, but unfortunately there is no improvement in the quality of the face reconstruction.

MartyG-RealSense commented 1 week ago

Other than increasing the level of light illumination on the face to try to bring out further depth detail from the face (perhaps with an external lamp), there is likely to be no other action that can make the D435 mask more comparable to the SR300 one.

MartyG-RealSense commented 4 days ago

Hi @matteocarbonara1234 Do you require further assistance with this case, please? Thanks!

matteocarbonara1234 commented 3 days ago

Hi @MartyG-RealSense, I do not require further assistance. Thanks for the help.

MartyG-RealSense commented 3 days ago

You are very welcome. As you do not require further assistance, I will close this case. Thanks again!