This gadget would add three forms of hand tracking to Aardvark. The first would be the Vive hand tracking SDK tracking, adding support to the Vive Pro, Index, and Vive. The second is through the Leap Motion api, allowing support on any headset with the added leap motion hardware. The third is through the Valve Index’s finger tracking, combining the position information of the controller and the finger tracked data (as well as the built in “pinch motion”); forming a hand tracking emulation that does not use the buttons of the index controllers.
Ideally the gadget would feed the data from any of these into a common hand tracking functionality, so each gadget does not have to support them individually, and so new methods of hand tracking can be configured to feed in their data. This also provides a model for other developers to create universal hand tracking.
These hands rendered from the tracking would allow users to interact with UI with either pressing with an index finger or pinching to create an laser, and the hands would be dynamic objects that can have collision with other gadgets that choose to enable it.
Who would use this gadget?
Developers who intend to use Aardvark as a development platform for AR will have some reluctance for the lack of hand tracking. If given the option, many devs would be more receptive to Aardvark. Hands would be rendered over the users tracked hands, which would also fix occlusion issue. Occlusion zones rendering over the tracked hands is a more advanced method that could hook into #9. This solve one of the main issues with making Aardvark a functionally feature complete AR experience.
Assuming that you're on the team, what other skillsets would you need to make this project happen over a couple days of hacking?
I am not experienced with coding or 3D modelling, I’m just trying to provide the concept for consideration.
What will be the toughest part of building this gadget?
The toughest part of building this gadget would be incorporating all three methods and creating a common funnel hand system.
What would this gadget do?
This gadget would add three forms of hand tracking to Aardvark. The first would be the Vive hand tracking SDK tracking, adding support to the Vive Pro, Index, and Vive. The second is through the Leap Motion api, allowing support on any headset with the added leap motion hardware. The third is through the Valve Index’s finger tracking, combining the position information of the controller and the finger tracked data (as well as the built in “pinch motion”); forming a hand tracking emulation that does not use the buttons of the index controllers.
Ideally the gadget would feed the data from any of these into a common hand tracking functionality, so each gadget does not have to support them individually, and so new methods of hand tracking can be configured to feed in their data. This also provides a model for other developers to create universal hand tracking.
These hands rendered from the tracking would allow users to interact with UI with either pressing with an index finger or pinching to create an laser, and the hands would be dynamic objects that can have collision with other gadgets that choose to enable it.
Who would use this gadget?
Developers who intend to use Aardvark as a development platform for AR will have some reluctance for the lack of hand tracking. If given the option, many devs would be more receptive to Aardvark. Hands would be rendered over the users tracked hands, which would also fix occlusion issue. Occlusion zones rendering over the tracked hands is a more advanced method that could hook into #9. This solve one of the main issues with making Aardvark a functionally feature complete AR experience.
Assuming that you're on the team, what other skillsets would you need to make this project happen over a couple days of hacking?
I am not experienced with coding or 3D modelling, I’m just trying to provide the concept for consideration.
What will be the toughest part of building this gadget?
The toughest part of building this gadget would be incorporating all three methods and creating a common funnel hand system.