microsoft / Azure-Kinect-Sensor-SDK

A cross platform (Linux and Windows) user mode SDK to read data from your Azure Kinect device.
https://Azure.com/Kinect
MIT License
1.49k stars 618 forks source link

NFOV_BINNED broken depth image displaying on NUC8i7HVK - 1.1.0 SDK #477

Closed somacoder closed 5 years ago

somacoder commented 5 years ago

NFOV_BINNED displays a broken depth image when running on a NUC8i7HVK in the Kinect Viewer from the SDK 1.1.0 installer in usage: https://user-images.githubusercontent.com/25708712/60984625-dfacb800-a2f0-11e9-9d56-e7f928cdfba5.PNG

This only occurs on the NUC8i7HVK and not on my alternate desktop system. It also occurs across multiple different Kinect Hardware units.

This is with all standard connections attached (USB 3.0 and Power). System: NUC8i7HVK w/ 32 GB RAM OS: Windows 10 Version 1903 (OS Build 18362.239) SDK: 1.1.0

Firmware RGB camera: 1.6.98 Depth camera: 1.6.70 Audio: 1.6.14

somacoder commented 5 years ago

As a followup to this, after testing, this issue does not occur in Ubuntu 18.04 on the NUC8i7HVK.

rabbitdaxi commented 5 years ago

@somacoder thank you for reporting this issue, we definitely want to know more about this issue. May I ask two questions to help us narrow down a little bit more: 1) It seems this issue only happens on the NUC8i7HVK device on windows, and also this issue does not happen on other desktop windows system. Have you try to update the graphics driver of the NUC8i7HVK see whether it helped addressing this issue? Please share what your current graphics driver version is. 2) On the NUC8i7HVK, does this issue also happen to other 3 depth modes, or it only happens to the NFOV_BINNED?

somacoder commented 5 years ago

Thanks for the followup. I've since re-imaged to Linux and am programming there (my goal all along once Linux became stable). As such, this system specific issue is less a priority over the Linux bugs currently for me, specifically point cloud visualization bug in the viewer and the libusb multi-camera support bug in the recorder. However, given the NUC8i7HVK will almost certainly be a go to system for this device moving forward, it makes sense to address eventually.

  1. I did not update the graphics manually. The RX Vega M is strange in that I think the driver is exclusively distributed by Intel not AMD, so I didn't get around to manually installing that. This could have very well have solved the problem. I can't say what the driver was before I re-imaged.
  2. This only occurred with NFOV_BINNED.

I will make it a priority to install Windows again on a separate disk to test again when I get a little more spare time.

wes-b commented 5 years ago

Are there issues opened for the 2 bugs you mentioned above?

rabbitdaxi commented 5 years ago

@somacoder thank you for answer my questions. Yes, I think it is definitely worth to try repro this issue on this device and see whether you can update the graphic driver can help solve the issue. We have experienced one Intel Graphics driver issue before results in a color point cloud missing points https://github.com/microsoft/Azure-Kinect-Sensor-SDK/issues/294, and somehow the windows update on surface does not pull the latest intel graphics driver automatically and manually update fixed the issue. Therefore, please try similar thing on the NUC8i7HVK, likely causing by the graphics driver.

I will keep an eye on this issue and looking forward to hear your testing results

somacoder commented 5 years ago

Sounds good! Thanks all. And to @wes-b, yes, those are being handled and look to be resolved soon. I know you all are hard at work and I appreciate the proper triaging!

Edit: @wes-b Placing the links to those other issues in case others stumble upon my references to them and are curious: Multiple devices on Linux (libusb): https://github.com/Microsoft/Azure-Kinect-Sensor-SDK/issues/302 https://github.com/microsoft/Azure-Kinect-Sensor-SDK/issues/485 3D Viewer on Linux (OpenGL): https://github.com/microsoft/Azure-Kinect-Sensor-SDK/issues/419

rabbitdaxi commented 5 years ago

@somacoder given it may take some time for you to try repro again and testing the update the Intel GPU driver, we are going to close this issue for now, and if update the Intel GPU driver did not fix your issue, please reopen this issue with your repro and testing result at then. Thank you a lot for actively on this issue!

somacoder commented 5 years ago

Updating to the newest driver here did not fix the problem. https://downloadcenter.intel.com/download/28600/Radeon-RX-Vega-M-Graphics-Driver-for-Windows-10-64-bit-for-NUC8i7HNK-NUC8i7HVK?product=126143

somacoder commented 5 years ago

Success! If you download the Radeon software for the standard RX Vega through AMD's Adrenaline software, a driver update will be installed overwriting Intel's advertised driver for this unit, fixing this bug. Strange that Intel communicates having to use their driver available on their website. Doubly strange considering that AMD also doesn't advertise support for the Radeon™ RX Vega M anywhere on their site. https://www.amd.com/en/support/graphics/radeon-rx-vega-series/radeon-rx-vega-series/radeon-rx-vega-64

This is all possibly due to the custom shared substrate that both the i7 and Vega are soldered onto and developed for, prompting Intel to have to distribute their own drivers at least initially, and then just never updated them. Also, Intel just really likes their branding, and the RX Vega M install and management GUIs are clearly Radeon software with Intel skins on them (no doubt a part of the deal they struck with AMD). I don't think they were in any hurry to point people to AMD's graphics driver/gaming software.

rabbitdaxi commented 5 years ago

@somacoder thank you very much for the effort, we really appreciated your follow through here. It is definitely make sense this is some graphic driver bug, and it is also glad to know the newer version that you updated manually did fix the issue. This is very helpful for others if they are hitting same issue.