search

SirLynix / obs-kinect

OBS Plugin to use a Kinect (all models supported) in OBS (and setup a virtual green screen based on depth and/or body detection).
GNU General Public License v2.0
424 stars 29 forks source link

Motion Tracking Support #45

Open sarvepalli18 opened 3 years ago

sarvepalli18 commented 3 years ago

When i add kinect as a source in OpenNIVirtualCam i can see the motion tracking when smart tracking feature is selected. I do not see the same with OBS though, this is very helpful feature especially when there are multiple people in the room or when the subject is moving. Would be a great addition to the already available excellent features in obs kinect :)

SirLynix commented 3 years ago

Hi.

What exactly is that motion tracking feature? I installed OpenNIVirtualCam to try it out and didn't see any change when enabling Smart Tracking.

SirLynix commented 3 years ago

Okay I managed to make it work, and took a look at the code, it's actually a face tracking, centering on someone face, it should be pretty easy to do 😄

sarvepalli18 commented 3 years ago

Yes it is face tracking. I have implemented face tracking using particles filters but not sure how to implement it using kinect APIs. I am a noob though, but very much interested in Computer Vision.

Also one more thought i had is that since kinect receives audio, it will be a nice feature to track audio, like whoever is the speaker in the room the camera focuses on the speaker.

SirLynix commented 3 years ago

Yes I've seen that KinectV2 (and maybe v1) have directional audio. Having that and face tracking would be a really nice feature indeed. I can't promise I'll do it before releasing 1.0 (I should have released it a while ago already), I still have to work on the Linux version to release it.