Hand tracking for custom gestures

satoshi0212 / visionOS_30Days

visionOS 30 days challenge.

MIT License

2.03k stars 161 forks source link

Hand tracking for custom gestures #14

Open mechmillan opened 7 months ago

mechmillan commented 7 months ago

Hello, thanks for the great examples - this has been helpful.

Do you have plans to add / explore the new capabilities in ARKit around hand tracking? I'm curious if it's possible to run the simulator for hand-tracking without having the apple vision pro device itself - what is that experience like? I'm having trouble finding additional information about it online. Thanks!

satoshi0212 commented 7 months ago

Unfortunately, at this time, the hand tracking feature cannot be tested without an Apple Pro device. We may need to try it on an actual device in the lab, win a Developer Kit, or wait until the actual device is released next year.

This is a side note, but some developers have implemented it using Meta Quest. However, I think this is a bit hacky. https://x.com/mouri45/status/1730151268843500005?s=20

AlohaYos commented 7 months ago

Hi mechmillan, Take a look at this repository.

https://github.com/AlohaYos/ProjectJarvis/tree/main/HandTrackingDemo