search

KitwareMedical / SlicerVirtualReality

A Slicer extension that enables user to interact with a Slicer scene using virtual reality.
Apache License 2.0
119 stars 58 forks source link

Add OpenXRRemoting support #151

Closed jcfr closed 10 months ago

jcfr commented 10 months ago

This commit adds support for OpenXR Remoting by adding the OpenXRRemoting and vtkRenderingOpenXRRemoting external projects. It also updates the view node by adding "Remoting" and "PlayerIPAddress" properties. The corresponding UI updates include a checkbox for toggling remoting and a QLineEdit for entering the IP address.

The macro SlicerVirtualReality_HAS_OPENXRREMOTING_SUPPORT is added to vtkMRMLVirtualRealityConfigure.h.in to conditionally include code specific to OpenXR remoting.

The "Remoting" checkbox and "PlayerIPAddress" line edit are disabled if an active connection has been established.

To fix the issue of wglDXRegisterObjectNV failed in RegisterSharedTexture() in OpenXRRemoting, the OpenXRRemoting HelperWindow MultiSamples property is explicitly set to 0.

To ensure that no background is displayed, the background alpha/color/gradient is explicitly set when remoting is used.

The last "Remoting" and "PlayerIPAddress" properties associated with a successful hardware connection are saved to and restored from the settings.

Update OpenXRRemoting from 2.9.1 to 2.9.3: This enables building the SlicerVirtualReality extension against the latest version (2.9.3) of Microsoft.Holographic.Remoting.OpenXr. This aligns SlicerVirtualReality with the corresponding version of the "Holographic Remoting Player" available on the Microsoft Store.

The update relies on VTK changes integrated into the upstream VTK project via vtk/vtk!10814. Additionally, Slicer/VTK fork branches, namely Slicer/VTK#53 for SlicerPreview and Slicer/VTK#54 for SlicerStable, have been synchronized with these changes.

For SlicerPreview, changes have been integrated in Slicer through Slicer/Slicer#7534. In the case of SlicerStable, the updated VTK fork has been manually checked out on the relevant build machines to incorporate the necessary adjustments.

lassoan commented 10 months ago

This will be awesome! Please also describe in the documentarion how to set up remote rendering using HoloLens (what to install, how to configure, how to start).