Record and document prototype 0 - Githubissues

uwe-xr-ma-2023 / mr-handtracking-prototype

Mixed reality hand tracking prototype using Unity, Ultraleap and Pico 4 headset

0 stars 1 forks source link

Record and document prototype 0 #21

Closed jonjhiggins closed 1 year ago

jonjhiggins commented 1 year ago

A/C

Video: showing casted headset experience and experience from external view. Shows hand tracking post triggering sound. Example video showing internal/external experience: https://youtu.be/eu_sqkEGW2I
Text: document, why, what happened/challenges/learnings

Ajiun1010 commented 1 year ago

Video: Participants executes the thumbs up pose in Pico Headset; 1 thumb, 2 Thumbs

Why: Pose recognition to trigger sound

What Happened:

Intro sound executed sound at the beginning of the experience
Pop sound successfully executed on thumbs up pose

Challenges

Pose tolerance is too high
Sound recognition is more dependent on knuckles and metatarsals than thumbs.
Sound recognition on one hand at a time, no double or second pops.
Right hand recognition seems more accurate for pose recognition
The farther out the hands, the better the recognition.