search

microsoft / Azure-Kinect-Sensor-SDK

A cross platform (Linux and Windows) user mode SDK to read data from your Azure Kinect device.
https://Azure.com/Kinect
MIT License
1.5k stars 620 forks source link

Concerns wrt IR image quality #1781

Open ArlenCHEN opened 2 years ago

ArlenCHEN commented 2 years ago

Hi team,

I was wondering if there is any way to adjust the IR image to have this imaging quality (see the attached pic) with a very close distance to the face. Screen Shot 2022-05-19 at 5 46 37 PM

(The pic is from this paper: Lombardi, Stephen, et al. "Deep appearance models for face rendering." ACM Transactions on Graphics (ToG) 37.4 (2018): 1-13.)

dasparli commented 2 years ago

The integration time of the sensor is not adjustable, as this has accuracy implications. Close objects will unavoidably saturate the sensor as a result. Even if it were possible to adjust the integration time the focus of the lens needs to be fixed in order to maintain consistent geometric intrinsics/extrinsics for 3D reconstruction purposes. This means that any objects imaged at extremely close range are likely to be out of focus. It may be possible to attenuate the active signal so that it is possible to avoid close-range saturation, but the user needs to be careful as n-d filters can have thermal dissipation issues or introduce crosstalk between the illumination and imaging components of the depth sensor. If a highly uniform active IR image is desired, it may be necessary to further diffuse the active illumination to remove high frequency spatial content e.g. 5 degree Gaussian diffuser