immersive-web / proposals

Initial proposals for future Immersive Web work (see README)
95 stars 11 forks source link

XR Trackers support #77

Open De-Panther opened 2 years ago

De-Panther commented 2 years ago

Following a discussion in the WebXR Discord,

Support for tracking of other devices than the Left/Right controllers. Body trackers, Valve trackers, keyboards, etc...

Valve/SteamVR trackers were mentioned in the past - https://github.com/immersive-web/webxr-input-profiles/issues/47 Meta Quest has a keyboard that can be tracked (not sure if developers can already get it's pose). @cabanier mentioned this OpenXR Specification https://registry.khronos.org/OpenXR/specs/1.0/man/html/XrKeyboardTrackingDescriptionFB.html

It can be a gamepad profile that only expose the name of the device(for input profiles) and pose, no need for buttons and touch sensors.

cabanier commented 2 years ago

This sounds like a good idea. We should come up with a solution that works across "trackers". OpenXR has an extension just for keyboard but it would be great if there was a general solution. Maybe it's sufficient if the API returns a space and some metadata for a tracker.

msub2 commented 2 years ago

It looks like there's a provisional OpenXR extension made specifically to support Vive trackers. Could this potentially be used to support other trackers as well? It's unclear just from a quick glance if there would need to be any significant amount of "spoofing" for say, a Tundra tracker or slime tracker to read as a Vive tracker for this extension.

De-Panther commented 1 year ago

HTC new trackers - Vive Wave https://youtu.be/9nMBmQtE-DA

Maksims commented 1 year ago

Would love to know where the current discussion is regarding XR Trackers. We've tried to access them with just input sources, but sadly they are not exposed :(

kalegd commented 1 year ago

+1 on a general solution for different trackers. Wouldn't be surprised if Apple ends up making a new version of the apple pencil to be used with the Vision Pro in the future. But besides that there are already vive trackers and keyboards that would be nice to support