search

microsoft / MixedReality-WebRTC

MixedReality-WebRTC is a collection of components to help mixed reality app developers integrate audio and video real-time communication into their application and improve their collaborative experience
https://microsoft.github.io/MixedReality-WebRTC/
MIT License
909 stars 283 forks source link

can MixedReality-WebRTC support Azure Kinect DK's depth camera? #203

Open richard008 opened 4 years ago

richard008 commented 4 years ago

I try to use Azure Kinect DK as my pc's camera, and I have disabled the audio device of the Azure Kinect in the device manager of Windows, if I open the application ,Webrtc will turn on Kinect's RGB camera. But I want to use depth camera. Can webrtc use Kinect's depth camera?And how?

djee-ms commented 4 years ago

Hi @richard008, At the moment there is no built-in support for Azure Kinect DK. You will need to manage the camera yourself and feed its content to an external video track source. But bear in mind that the video codecs usually are designed for RGB content, so might compress the depth data in a way that is not optimal and/or adds artifacts (see e.g. this article for an analysis about VP8 and alpha channel).

richard008 commented 4 years ago

Hi @richard008, At the moment there is no built-in support for Azure Kinect DK. You will need to manage the camera yourself and feed its content to an external video track source. But bear in mind that the video codecs usually are designed for RGB content, so might compress the depth data in a way that is not optimal and/or adds artifacts (see e.g. this article for an analysis about VP8 and alpha channel).

Thanks for your reply, I will try the ExternalVideoTrackSource to feed the depth camera's content to webrtc.

mftaha commented 3 years ago

@richard008 did you manage to make this work? Thanks!!