search

FerdiMarti / OwOTrackIOS

MIT License
8 stars 2 forks source link

OwOTrack in 3D space #4

Open judge2020 opened 1 year ago

judge2020 commented 1 year ago

with WWDC23 and iOS 17, Apple has introduced supporting APIs for 3D Body pose detection: https://developer.apple.com/documentation/vision/detecting_human_body_poses_in_3d_with_vision

Chances are the performance of Apple’s implementation is much better than Kinect, so I think it would be useful to investigate whether or not this API can be used in real-time with the camera to enable owotrack to do full-body tracking via the phone’s camera.

FerdiMarti commented 1 year ago

Thank you for the idea. Currently, OwOTrack just sends sensor data to SlimeVR, which handles the calculations and does the actual motion detection. So your suggestion would be sort of a different concept and require a different desktop client. I would say, it could be explored in a separate, future project.