In home VR streaming

[DerGernTod]

Moonlight works really well for me, that's why I wonder if it'd be possible to support vr streaming. I think there's various things to be considered:

• more input data has to be sent: 2 motion controllers + headset motion is much more than two stick inputs (most likely within bounds for in home streaming though)
• high res has to be received (e.g. 2000x2000x2), but since 4k works fine, this shouldn't be an issue
• probably the biggest issue: vr inputs have to be simulated on the host.

Is it even possible to accomplish such a scenario? Maybe in collaboration with openxr?

I'm a dev myself and thinking about contributing in these regards, but I wouldn't know where to start, or if there's other obstacles I missed that make this whole endavour pointless (thinking about WMR for example, deeply integrated into windows)

[cgutman]

Are gyroscope and accelerometer inputs enough for the motion controls? If so, that's supported now with the latest protocol extensions shared by Sunshine and Moonlight. The protocol now supports up to 16 controllers, so you could just define that 3 controllers are used as a set to represent a single VR player.

Emulation on the host side is trickier, because you need a way to get them to the applications. We can do that with the emulated DualShock 4 controller that ViGEmBus gives us, but I'm not sure if there's a driver out there that can emulate VR motion controllers on Windows. Linux may be achievable though, since uinput is quite flexible for emulating arbitrary input devices.

[xqdd]

https://github.com/alvr-org/ALVR