Yellow-Dog-Man / Resonite-Issues

Issue repository for Resonite.
https://resonite.com
121 stars 2 forks source link

Add support OpenXR Eye / Face Tracking #1220

Open kazu0617 opened 5 months ago

kazu0617 commented 5 months ago

Is your feature request related to a problem? Please describe.

The VIVE Full Face Tracker for the XR Series has been released, however, it lacks support for SRAnipal features. Additionally, both the Facial Tracker and VIVE Pro Eye have been discontinued, meaning that none of the hardware currently sold by VIVE supports SRAnipal.

Describe the solution you'd like

I would like to propose an update to the existing Eye and Facial Tracking mechanisms in Resonite to align with current industry standards. While the current system utilizes the SRAnipal framework, it is becoming increasingly outdated and incompatible with newer hardware and software. Updating this feature to be compliant with modern standards, such as those outlined in OpenXR, would not only enhance its functionality but also ensure better compatibility and user experience across various VR platforms. This upgrade is essential to maintain the relevance and efficiency of Eye and Facial Tracking features in the evolving VR landscape.

There’s related issue: https://github.com/Yellow-Dog-Man/Resonite-Issues/issues/49 https://github.com/Yellow-Dog-Man/Resonite-Issues/issues/975

Describe alternatives you've considered

Integrating Existing Third-Party Technologies like OSC:

Additional Context

VIVE also says in VIVE Developers: We won’t be releasing any news and support for VIVE Sense. We invite you to join [OpenXR PC VR ](https://developer.vive.com/resources/openxr/openxr-pcvr/). https://developer.vive.com/resources/vive-sense/eye-and-facial-tracking-sdk/download/

shiftyscales commented 5 months ago

Seeking feedback from @Geenz.

Casuallynoted commented 5 months ago

I also wanna throw my hat into this ring! I'd love to see OpenXR support in general for eye/face/hand tracking purposes. This would alleviate the community having to develop mods individually for each tracking solution, and hopefully would also make Resonite more future-proof in its implementation of input device support.

Geenz commented 3 months ago

We have ALXR support that needs review which should help get us over the hump on this one. Otherwise it's waiting on Sauce which will support OpenXR out of the box. It will still need specific device drivers built-in for different vendor extensions though.