search

microsoft / MixedRealityToolkit-Unity

This repository is for the legacy Mixed Reality Toolkit (MRTK) v2. For the latest version of the MRTK please visit https://github.com/MixedRealityToolkit/MixedRealityToolkit-Unity
https://aka.ms/mrtkdocs
MIT License
6k stars 2.12k forks source link

HandRay not work with OpenXR In HoloLens2, #9996

Closed zhangq08 closed 3 years ago

zhangq08 commented 3 years ago

HandRay not work, two fingers operate not work like grab \hand drag \move, the editor play mode is normal

This is the log below:

Logging to C:/Data/Users/HuaYuHolo@outlook.com/AppData/Local/Packages/Microsoft.MixedReality.Toolkit_ph1m9x8skttmg/TempState/UnityPlayer.log Loading native plugins Loading openxr_loader.dll Loading Microsoft.MixedReality.SceneUnderstanding.dll Module information: Built with Compiler Ver '192528614' Built from '2020.3/china_unity/release' branch Version is '2020.3.12f1c1 (5887f62ce680)' Release build Application type 'D3D' OS 'Windows 10 (10.0.20348)' PlayerConnection initialized from C:/data/Programs/WindowsApps/Microsoft.MixedReality.Toolkit_2.7.1.0_arm64__ph1m9x8skttmg/Data (debug = 0) PlayerConnection initialized network socket : 0.0.0.0 55196 Multi-casting "[IP] 192.168.0.194 [Port] 55196 [Flags] 2 [Guid] 825511742 [EditorId] 0 [Version] 1048832 [Id] UWPPlayerARM(HOLOLENS-6BC6C6) [Debug] 0 [PackageName] Microsoft.MixedReality.Toolkit_ph1m9x8skttmg [ProjectName] " to [225.0.0.222:54997]... Started listening to [0.0.0.0:55196] PlayerConnection already initialized - listening to [0.0.0.0:55196] [Subsystems] Discovering subsystems at path C:/data/Programs/WindowsApps/Microsoft.MixedReality.Toolkit_2.7.1.0_arm64__ph1m9x8skttmg/Data/UnitySubsystems [Subsystems] No descriptors matched for examples in UnitySubsystems/MicrosoftOpenXRPlugin/UnitySubsystemsManifest.json. [Subsystems] 1 'inputs' descriptors matched in UnitySubsystems/MicrosoftOpenXRPlugin/UnitySubsystemsManifest.json [Subsystems] No descriptors matched for displays in UnitySubsystems/MicrosoftOpenXRPlugin/UnitySubsystemsManifest.json. [Subsystems] 1 'meshings' descriptors matched in UnitySubsystems/MicrosoftOpenXRPlugin/UnitySubsystemsManifest.json [Subsystems] No descriptors matched for examples in UnitySubsystems/UnityOpenXR/UnitySubsystemsManifest.json. [Subsystems] 1 'inputs' descriptors matched in UnitySubsystems/UnityOpenXR/UnitySubsystemsManifest.json [Subsystems] 1 'displays' descriptors matched in UnitySubsystems/UnityOpenXR/UnitySubsystemsManifest.json [Subsystems] No descriptors matched for meshings in UnitySubsystems/UnityOpenXR/UnitySubsystemsManifest.json. GfxDevice: creating device client; threaded=1 Direct3D: Version: Direct3D 11.0 [level 11.1] Renderer: Qualcomm(R) Adreno(TM) 630 GPU (ID=0x45373230) Vendor:
VRAM: 1932 MB Initialize engine version: 2020.3.12f1c1 (5887f62ce680) XRGeneral Settings awakening... UnityEngine.DebugLogHandler:LogFormat(LogType, Object, String, Object[]) UnityEngine.Logger:Log(LogType, Object) UnityEngine.Debug:Log(Object) UnityEngine.XR.Management.XRGeneralSettings:Awake()

D3D11 device created for Microsoft Media Foundation video decoding. [Subsystems] Loading plugin UnityOpenXR for subsystem OpenXR Display... [Subsystems] OpenXR XR Plugin successfully registered Provider for OpenXR Display [Subsystems] OpenXR XR Plugin successfully registered Provider for OpenXR Input [Subsystems] OpenXR XR Plugin successfully registered Provider for OpenXR Display [XR] [5468] [12:05:12.671][Info ] Available Layers: (0) [Subsystems] Loading plugin UnityOpenXR for subsystem OpenXR Input... [Subsystems] Loading plugin MicrosoftOpenXRPlugin for subsystem OpenXR Input Extension... [Subsystems] OpenXR Extension successfully registered Provider for OpenXR Mesh Extension [Subsystems] OpenXR XR Plugin successfully registered Provider for OpenXR Input [Subsystems] OpenXR XR Plugin successfully registered Provider for OpenXR Display

[Subsystems] OpenXR Extension successfully registered Provider for OpenXR Input Extension [Subsystems] OpenXR Extension successfully registered Provider for OpenXR Mesh Extension [Subsystems] OpenXR XR Plugin successfully registered Provider for OpenXR Input [Subsystems] OpenXR XR Plugin successfully registered Provider for OpenXR Display

[Subsystems] Loading plugin MicrosoftOpenXRPlugin for subsystem OpenXR Mesh Extension...

OpenXR reprojection settings are not supported; missing OpenXR extension XR_MSFT_composition_layer_reprojection_preview UnityEngine.DebugLogHandler:LogFormat(LogType, Object, String, Object[]) UnityEngine.Logger:Log(LogType, Object) UnityEngine.Debug:LogWarning(Object) Microsoft.MixedReality.OpenXR.OpenXRViewConfigurationSettings:OnSubsystemCreate(ISubsystemPlugin) System.Action1:Invoke(T) System.Collections.Generic.List1:ForEach(Action1) Microsoft.MixedReality.OpenXR.OpenXRFeaturePlugin1:OnSubsystemCreate() UnityEngine.XR.OpenXR.Features.OpenXRFeature:ReceiveLoaderEvent(OpenXRLoaderBase, LoaderEvent) UnityEngine.XR.OpenXR.OpenXRLoaderBase:InitializeInternal() UnityEngine.XR.OpenXR.OpenXRLoaderBase:Initialize() UnityEngine.XR.Management.XRManagerSettings:InitializeLoaderSync() UnityEngine.XR.Management.XRGeneralSettings:InitXRSDK() UnityEngine.XR.Management.XRGeneralSettings:AttemptInitializeXRSDKOnLoad()

New input system (experimental) initialized [XR] replaced_xrCreateSession [XR] Insert_holographic_window_attachment [XR] [5468] [12:05:13.506][Info ] OpenXRSession::HandleSessionStateChangedEvent: state XR_SESSION_STATE_UNKNOWN->XR_SESSION_STATE_IDLE session=2 time=5178158209739 [XR] [5468] [12:05:13.507][Info ] OpenXRSession::HandleSessionStateChangedEvent: state XR_SESSION_STATE_IDLE->XR_SESSION_STATE_READY session=2 time=5178158244583 [XR] [Mixed Reality OpenXR] LocatableCameraProvider registered.

The referenced script (Microsoft.MixedReality.Toolkit.XRSDK.Oculus.Input.OculusXRSDKDeviceManagerProfile) on this Behaviour is missing!

The referenced script on this Behaviour (Game Object '') is missing!

A scripted object (probably Microsoft.MixedReality.Toolkit.XRSDK.Oculus.Input.OculusXRSDKDeviceManagerProfile?) has a different serialization layout when loading. (Read 72 bytes but expected 116 bytes) Did you #ifdef UNITY_EDITOR a section of your serialized properties in any of your scripts?

XRTextureManager::RequestCreateTexture XRTextureManager::SetupRenderTextureFromXRRequest (id: 1 col: 000002218054CE38 d: 0000000000000000) RenderTexture::Create (id: 1) IVRDeviceCallback_CreateEyeTextureResources 000002218054CE38 [XR] [5468] [12:05:14.221][Info ] OpenXRSession::HandleSessionStateChangedEvent: state XR_SESSION_STATE_READY->XR_SESSION_STATE_SYNCHRONIZED session=2 time=5179024942864 [XR] [5468] [12:05:14.221][Info ] OpenXRSession::HandleSessionStateChangedEvent: state XR_SESSION_STATE_SYNCHRONIZED->XR_SESSION_STATE_VISIBLE session=2 time=5179024956770 [XR] [5468] [12:05:14.221][Info ] OpenXRSession::HandleSessionStateChangedEvent: state XR_SESSION_STATE_VISIBLE->XR_SESSION_STATE_FOCUSED session=2 time=5179024963697 [XR] [5468] [12:05:14.222][Info ]

==== Start Unity OpenXR Diagnostic Report ====

[XR] [5468] [12:05:14.222][Info ] ==== Report Reason: System Startup Completed ====

[XR] [5468] [12:05:14.222][Info ] ==== OpenXR Support Details ==== [XR] [5468] [12:05:14.222][Info ] OpenXR Runtime: [XR] [5468] [12:05:14.222][Info ] Microsoft, which is a Unity supported partner [XR] [5468] [12:05:14.222][Info ] Unity OpenXR Features: [XR] [5468] [12:05:14.222][Info ] HandTrackingFeaturePlugin WSA, HoloLensFeaturePlugin WSA, MotionControllerFeaturePlugin WSA: Microsoft, which is a Unity supported partner [XR] [5468] [12:05:14.222][Info ] Unity Support: [XR] [5468] [12:05:14.222][Info ] Unity supports the runtime and Unity OpenXR Features above. When requesting assistance, please copy the OpenXR section from ==== Start Unity OpenXR Diagnostic Report ==== to ==== End Unity OpenXR Diagnostic Report ==== to the bug or forum post. [XR] [5468] [12:05:14.222][Info ] [XR] [5468] [12:05:14.222][Info ] ==== OpenXR Init Info ==== [XR] [5468] [12:05:14.222][Info ] [XR] [5468] [12:05:14.222][Info ] Stage 1 Missing Entry Points: (1) [XR] [5468] [12:05:14.222][Info ] xrInitializeLoaderKHR [XR] [5468] [12:05:14.222][Info ] [XR] [5468] [12:05:14.222][Info ] Stage 2 Missing Entry Points: (2) [XR] [5468] [12:05:14.222][Info ] xrGetVisibilityMaskKHR [XR] [5468] [12:05:14.223][Info ] xrGetD3D12GraphicsRequirementsKHR [XR] [5468] [12:05:14.223][Info ] [XR] [5468] [12:05:14.223][Info ] ==== OpenXR Provider Info ==== [XR] [5468] [12:05:14.223][Info ] Spec Version: 1.0.12 [XR] [5468] [12:05:14.223][Info ] Provider Version: 1.2.2 [XR] [5468] [12:05:14.223][Info ] App: MixedRealityToolkit 2.7.0 #1078714784 [XR] [5468] [12:05:14.223][Info ] Engine: 2020.3.12f1c1 #1165903725 [XR] [5468] [12:05:14.223][Info ] [XR] [5468] [12:05:14.223][Info ] ==== OpenXR Runtime Info ==== [XR] [5468] [12:05:14.223][Info ] [XR] [5468] [12:05:14.223][Info ] Features requested to be enabled: 3 [XR] [5468] [12:05:14.223][Info ] Name=Hand Tracking Extension=XR_EXT_hand_tracking XR_MSFT_hand_tracking_mesh Version=0.9.5 [XR] [5468] [12:05:14.223][Info ] Name=HoloLens Features Extension= XR_MSFT_holographic_window_attachment XR_MSFT_unbounded_reference_space XR_MSFT_spatial_anchor XR_MSFT_secondary_view_configuration XR_MSFT_first_person_observer XR_MSFT_spatial_graph_bridge XR_MSFT_perception_anchor_interop XR_MSFT_scene_understanding_preview3 XR_MSFT_composition_layer_reprojection_preview Version=0.9.5 [XR] [5468] [12:05:14.223][Info ] Name=Motion Controller Model Extension=XR_MSFT_controller_model Version=0.9.5 [XR] [5468] [12:05:14.223][Info ] [XR] [5468] [12:05:14.223][Info ] Features with extensions that failed to be enabled: 3 [XR] [5468] [12:05:14.223][Info ] Name=HoloLens Features Extension=XR_MSFT_scene_understanding_preview3 Version=0.9.5 [XR] [5468] [12:05:14.223][Info ] Name=HoloLens Features Extension=XR_MSFT_composition_layer_reprojection_preview Version=0.9.5 [XR] [5468] [12:05:14.223][Info ] Name=Motion Controller Model Extension=XR_MSFT_controller_model Version=0.9.5 [XR] [5468] [12:05:14.224][Info ] [XR] [5468] [12:05:14.224][Info ] Available Extensions: (22) [XR] [5468] [12:05:14.224][Info ] Name=XR_KHR_win32_convert_performance_counter_time SpecVersion=1 [XR] [5468] [12:05:14.224][Info ] Name=XR_KHR_D3D11_enable SpecVersion=5 [XR] [5468] [12:05:14.224][Info ] Name=XR_KHR_D3D12_enable SpecVersion=7 [XR] [5468] [12:05:14.224][Info ] Name=XR_KHR_composition_layer_depth SpecVersion=5 [XR] [5468] [12:05:14.224][Info ] Name=XR_KHR_composition_layer_color_scale_bias SpecVersion=5 [XR] [5468] [12:05:14.224][Info ] Name=XR_MSFT_unbounded_reference_space SpecVersion=1 [XR] [5468] [12:05:14.224][Info ] Name=XR_MSFT_spatial_anchor SpecVersion=1 [XR] [5468] [12:05:14.224][Info ] Name=XR_MSFT_perception_anchor_interop SpecVersion=1 [XR] [5468] [12:05:14.224][Info ] Name=XR_EXT_win32_appcontainer_compatible SpecVersion=1 [XR] [5468] [12:05:14.224][Info ] Name=XR_EXT_conformance_automation SpecVersion=3 [XR] [5468] [12:05:14.224][Info ] Name=XR_MSFT_composition_layer_reprojection SpecVersion=1 [XR] [5468] [12:05:14.224][Info ] Name=XR_MSFT_spatial_graph_bridge SpecVersion=1 [XR] [5468] [12:05:14.224][Info ] Name=XR_EXT_eye_gaze_interaction SpecVersion=1 [XR] [5468] [12:05:14.224][Info ] Name=XR_MSFT_hand_interaction SpecVersion=1 [XR] [5468] [12:05:14.224][Info ] Name=XR_EXT_hand_tracking SpecVersion=4 [XR] [5468] [12:05:14.224][Info ] Name=XR_MSFT_hand_tracking_mesh SpecVersion=3 [XR] [5468] [12:05:14.224][Info ] Name=XR_MSFT_holographic_window_attachment SpecVersion=1 [XR] [5468] [12:05:14.224][Info ] Name=XR_MSFT_secondary_view_configuration SpecVersion=1 [XR] [5468] [12:05:14.225][Info ] Name=XR_MSFT_first_person_observer SpecVersion=1 [XR] [5468] [12:05:14.225][Info ] Name=XR_MSFT_scene_understanding SpecVersion=1 [XR] [5468] [12:05:14.225][Info ] Name=XR_MSFT_scene_understanding_serialization SpecVersion=1 [XR] [5468] [12:05:14.225][Info ] Name=XR_EXT_debug_utils SpecVersion=3 [XR] [5468] [12:05:14.225][Info ] [XR] [5468] [12:05:14.225][Info ] Available Layers: (0) [XR] [5468] [12:05:14.225][Info ] [XR] [5468] [12:05:14.225][Info ] Runtime Name: Windows Mixed Reality Runtime [XR] [5468] [12:05:14.225][Info ] Runtime Version: 106.2105.21002 [XR] [5468] [12:05:14.225][Info ] [XR] [5468] [12:05:14.225][Info ] Form factor: XR_FORM_FACTOR_HEAD_MOUNTED_DISPLAY [XR] [5468] [12:05:14.225][Info ] [XR] [5468] [12:05:14.225][Info ] Spec extensions enabled: (12) [XR] [5468] [12:05:14.225][Info ] Name=XR_EXT_hand_tracking Version=4 [XR] [5468] [12:05:14.225][Info ] Name=XR_KHR_D3D11_enable Version=5 [XR] [5468] [12:05:14.225][Info ] Name=XR_KHR_composition_layer_depth Version=5 [XR] [5468] [12:05:14.225][Info ] Name=XR_KHR_win32_convert_performance_counter_time Version=1 [XR] [5468] [12:05:14.225][Info ] Name=XR_MSFT_first_person_observer Version=1 [XR] [5468] [12:05:14.225][Info ] Name=XR_MSFT_hand_tracking_mesh Version=3 [XR] [5468] [12:05:14.225][Info ] Name=XR_MSFT_holographic_window_attachment Version=1 [XR] [5468] [12:05:14.225][Info ] Name=XR_MSFT_perception_anchor_interop Version=1 [XR] [5468] [12:05:14.225][Info ] Name=XR_MSFT_secondary_view_configuration Version=1 [XR] [5468] [12:05:14.225][Info ] Name=XR_MSFT_spatial_anchor Version=1 [XR] [5468] [12:05:14.225][Info ] Name=XR_MSFT_spatial_graph_bridge Version=1 [XR] [5468] [12:05:14.226][Info ] Name=XR_MSFT_unbounded_reference_space Version=1 [XR] [5468] [12:05:14.226][Info ] [XR] [5468] [12:05:14.226][Info ] Available Reference Spaces: (3) [XR] [5468] [12:05:14.226][Info ] Name: XR_REFERENCE_SPACE_TYPE_VIEW [XR] [5468] [12:05:14.226][Info ] Name: XR_REFERENCE_SPACE_TYPE_LOCAL [XR] [5468] [12:05:14.226][Info ] Name: XR_REFERENCE_SPACE_TYPE_UNBOUNDED_MSFT [XR] [5468] [12:05:14.226][Info ] [XR] [5468] [12:05:14.226][Info ] Instance Id : 0x1 [XR] [5468] [12:05:14.226][Info ] System Id : 0x1 [XR] [5468] [12:05:14.226][Info ] Session Id : 0x2 [XR] [5468] [12:05:14.226][Info ] [XR] [5468] [12:05:14.226][Info ] Available View Configuration Types: (2) [XR] [5468] [12:05:14.226][Info ] View Configuration Type: XR_VIEW_CONFIGURATION_TYPE_PRIMARY_STEREO (Selected) View configuration FovMutable=True [XR] [5468] [12:05:14.226][Info ] View [0]: Recommended Width=1440 Height=936 SampleCount=1 [XR] [5468] [12:05:14.226][Info ] View [0]: Maximum Width=2880 Height=1872 SampleCount=4 [XR] [5468] [12:05:14.226][Info ] View [1]: Recommended Width=1440 Height=936 SampleCount=1 [XR] [5468] [12:05:14.226][Info ] View [1]: Maximum Width=2880 Height=1872 SampleCount=4 [XR] [5468] [12:05:14.226][Info ] View Configuration Type: XR_VIEW_CONFIGURATION_TYPE_SECONDARY_MONO_FIRST_PERSON_OBSERVER_MSFT View configuration FovMutable=True [XR] [5468] [12:05:14.226][Info ] View [0]: Recommended Width=2272 Height=1276 SampleCount=1 [XR] [5468] [12:05:14.226][Info ] View [0]: Maximum Width=4544 Height=2556 SampleCount=4 [XR] [5468] [12:05:14.226][Info ] [XR] [5468] [12:05:14.226][Info ] Available Environment Blend Mode: (1) [XR] [5468] [12:05:14.226][Info ] Environment Blend Mode (XR_ENVIRONMENT_BLEND_MODE_ADDITIVE) : (Selected) [XR] [5468] [12:05:14.226][Info ] [XR] [5468] [12:05:14.227][Info ] System Properties: Name=Windows Mixed Reality VendorId=1118 [XR] [5468] [12:05:14.227][Info ] System Graphics Properties: MaxWidth=16384 MaxHeight=16384 MaxLayers=16 [XR] [5468] [12:05:14.227][Info ] System Tracking Properties: OrientationTracking=True PositionTracking=True [XR] [5468] [12:05:14.227][Info ] [XR] [5468] [12:05:14.227][Info ] ==== OpenXR Swapchain Details ==== [XR] [5468] [12:05:14.227][Info ] [XR] [5468] [12:05:14.227][Info ] Render Mode: Single Pass Instanced [XR] [5468] [12:05:14.227][Info ] Depth Submission Mode: Depth16Bit [XR] [5468] [12:05:14.227][Info ] [XR] [5468] [12:05:14.227][Info ] Swapchain Formats: [c:91] 87 28 29 [d:55] 45 40 20 [XR] [5468] [12:05:14.227][Info ] Creating swapchain for view 0 with dimensions Width=1440 Height=936 SampleCount=1 [XR] [5468] [12:05:14.227][Info ] [XR] [5468] [12:05:14.227][Info ] ==== Last 20 non-XR_SUCCESS returns ==== [XR] [5468] [12:05:14.227][Info ] [SUCCESS] xrGetReferenceSpaceBoundsRect: XR_SPACE_BOUNDS_UNAVAILABLE (2x) [XR] [5468] [12:05:14.227][Info ] [SUCCESS] xrPollEvent: XR_EVENT_UNAVAILABLE (2x) [XR] [5468] [12:05:14.227][Info ] [XR] [5468] [12:05:14.227][Info ] ==== Last 20 Events ==== [XR] [5468] [12:05:14.227][Info ] OpenXRSession::HandleSessionStateChangedEvent: XR_SESSION_STATE_UNKNOWN->XR_SESSION_STATE_IDLE [XR] [5468] [12:05:14.227][Info ] OpenXRSession::HandleSessionStateChangedEvent: XR_SESSION_STATE_IDLE->XR_SESSION_STATE_READY [XR] [5468] [12:05:14.228][Info ] OpenXRSession::HandleSessionStateChangedEvent: XR_SESSION_STATE_READY->XR_SESSION_STATE_SYNCHRONIZED [XR] [5468] [12:05:14.228][Info ] OpenXRSession::HandleSessionStateChangedEvent: XR_SESSION_STATE_SYNCHRONIZED->XR_SESSION_STATE_VISIBLE [XR] [5468] [12:05:14.228][Info ] OpenXRSession::HandleSessionStateChangedEvent: XR_SESSION_STATE_VISIBLE->XR_SESSION_STATE_FOCUSED [XR] [5468] [12:05:14.228][Info ]

==== End Unity OpenXR Diagnostic Report ====

XRTextureManager::RequestCreateTexture XRTextureManager::SetupRenderTextureFromXRRequest (id: 2 col: 000002218054B138 d: 0000000000000000) RenderTexture::Create (id: 2) IVRDeviceCallback_CreateEyeTextureResources 000002218054B138 XRTextureManager::RequestCreateTexture XRTextureManager::SetupRenderTextureFromXRRequest (id: 3 col: 000002218054B738 d: 0000000000000000) RenderTexture::Create (id: 3) IVRDeviceCallback_CreateEyeTextureResources 000002218054B738 [XR] [XR Input Provider]: Handle Event received with eventType[1363496514], DeviceId[0], Buffer Size[1]. UnloadTime: 3.012292 ms Unable to register IMixedRealityInputDeviceManager data provider (Windows Mixed Reality Device Manager) because the value of concreteType is null. This may be caused by code being stripped during linking. The link.xml file in the MixedRealityToolkit.Generated folder is used to control code preservation. More information can be found at https://docs.unity3d.com/Manual/ManagedCodeStripping.html. UnityEngine.DebugLogHandler:LogFormat(LogType, Object, String, Object[]) UnityEngine.Logger:Log(LogType, Object) UnityEngine.Debug:LogWarning(Object) Microsoft.MixedReality.Toolkit.BaseDataProviderAccessCoreSystem:RegisterDataProviderInternal(Boolean, Type, String, SupportedPlatforms, Object[]) Microsoft.MixedReality.Toolkit.BaseDataProviderAccessCoreSystem:RegisterDataProvider(Type, String, SupportedPlatforms, Object[]) Microsoft.MixedReality.Toolkit.Input.MixedRealityInputSystem:CreateDataProviders() Microsoft.MixedReality.Toolkit.Input.MixedRealityInputSystem:Initialize() Microsoft.MixedReality.Toolkit.<>c:b__68_0(IMixedRealityService) System.Action1:Invoke(T) Microsoft.MixedReality.Toolkit.MixedRealityToolkit:ExecuteOnAllServicesInOrder(Action1) Microsoft.MixedReality.Toolkit.MixedRealityToolkit:InitializeServiceLocator() Microsoft.MixedReality.Toolkit.MixedRealityToolkit:RegisterInstance(MixedRealityToolkit, Boolean) Microsoft.MixedReality.Toolkit.MixedRealityToolkit:Awake()

Unable to register IMixedRealityInputDeviceManager data provider (Windows Mixed Reality Eye Gaze Provider) because the value of concreteType is null. This may be caused by code being stripped during linking. The link.xml file in the MixedRealityToolkit.Generated folder is used to control code preservation. More information can be found at https://docs.unity3d.com/Manual/ManagedCodeStripping.html. UnityEngine.DebugLogHandler:LogFormat(LogType, Object, String, Object[]) UnityEngine.Logger:Log(LogType, Object) UnityEngine.Debug:LogWarning(Object) Microsoft.MixedReality.Toolkit.BaseDataProviderAccessCoreSystem:RegisterDataProviderInternal(Boolean, Type, String, SupportedPlatforms, Object[]) Microsoft.MixedReality.Toolkit.BaseDataProviderAccessCoreSystem:RegisterDataProvider(Type, String, SupportedPlatforms, Object[]) Microsoft.MixedReality.Toolkit.Input.MixedRealityInputSystem:CreateDataProviders() Microsoft.MixedReality.Toolkit.Input.MixedRealityInputSystem:Initialize() Microsoft.MixedReality.Toolkit.<>c:b__68_0(IMixedRealityService) System.Action1:Invoke(T) Microsoft.MixedReality.Toolkit.MixedRealityToolkit:ExecuteOnAllServicesInOrder(Action1) Microsoft.MixedReality.Toolkit.MixedRealityToolkit:InitializeServiceLocator() Microsoft.MixedReality.Toolkit.MixedRealityToolkit:RegisterInstance(MixedRealityToolkit, Boolean) Microsoft.MixedReality.Toolkit.MixedRealityToolkit:Awake()

Unable to register IMixedRealitySpatialAwarenessObserver data provider (Windows Mixed Reality Spatial Mesh Observer) because the value of concreteType is null. This may be caused by code being stripped during linking. The link.xml file in the MixedRealityToolkit.Generated folder is used to control code preservation. More information can be found at https://docs.unity3d.com/Manual/ManagedCodeStripping.html. UnityEngine.DebugLogHandler:LogFormat(LogType, Object, String, Object[]) UnityEngine.Logger:Log(LogType, Object) UnityEngine.Debug:LogWarning(Object) Microsoft.MixedReality.Toolkit.BaseDataProviderAccessCoreSystem:RegisterDataProviderInternal(Boolean, Type, String, SupportedPlatforms, Object[]) Microsoft.MixedReality.Toolkit.BaseDataProviderAccessCoreSystem:RegisterDataProvider(Type, String, SupportedPlatforms, Object[]) Microsoft.MixedReality.Toolkit.SpatialAwareness.MixedRealitySpatialAwarenessSystem:InitializeInternal() Microsoft.MixedReality.Toolkit.SpatialAwareness.MixedRealitySpatialAwarenessSystem:Initialize() Microsoft.MixedReality.Toolkit.<>c:b__68_0(IMixedRealityService) System.Action1:Invoke(T) Microsoft.MixedReality.Toolkit.MixedRealityToolkit:ExecuteOnAllServicesInOrder(Action1) Microsoft.MixedReality.Toolkit.MixedRealityToolkit:InitializeServiceLocator() Microsoft.MixedReality.Toolkit.MixedRealityToolkit:RegisterInstance(MixedRealityToolkit, Boolean) Microsoft.MixedReality.Toolkit.MixedRealityToolkit:Awake()

XRTextureManager::RequestCreateTexture XRTextureManager::RequestCreateTexture XRTextureManager::SetupRenderTextureFromXRRequest (id: 4 col: 0000000000000000 d: 000002218054B438) RenderTexture::Create (id: 4) IVRDeviceCallback_CreateEyeTextureResources 000002218054B438 XRTextureManager::SetupRenderTextureFromXRRequest (id: 5 col: 000002218054B138 d: 0000000000000000) RenderTexture::Create (id: 5) IVRDeviceCallback_CreateEyeTextureResources 000002218054B138 XRTextureManager::RequestCreateTexture XRTextureManager::RequestCreateTexture XRTextureManager::SetupRenderTextureFromXRRequest (id: 6 col: 0000000000000000 d: 000002218054DCB8) RenderTexture::Create (id: 6) IVRDeviceCallback_CreateEyeTextureResources 000002218054DCB8 XRTextureManager::SetupRenderTextureFromXRRequest (id: 7 col: 000002218054B738 d: 0000000000000000) RenderTexture::Create (id: 7) IVRDeviceCallback_CreateEyeTextureResources 000002218054B738 XRTextureManager::RequestCreateTexture XRTextureManager::RequestCreateTexture XRTextureManager::SetupRenderTextureFromXRRequest (id: 8 col: 0000000000000000 d: 000002218054EAB8) RenderTexture::Create (id: 8) IVRDeviceCallback_CreateEyeTextureResources 000002218054EAB8 XRTextureManager::SetupRenderTextureFromXRRequest (id: 9 col: 000002218054CE38 d: 0000000000000000) RenderTexture::Create (id: 9) IVRDeviceCallback_CreateEyeTextureResources 000002218054CE38 [XR] [XR Input Provider]: Handle Event received with eventType[1363496514], DeviceId[1], Buffer Size[1]. [AsyncCoroutineRunner] There is no AsyncCoroutineRunner in the scene. Adding a GameObject with AsyncCoroutineRunner attached at the root of the scene. UnityEngine.DebugLogHandler:LogFormat(LogType, Object, String, Object[]) UnityEngine.Logger:Log(LogType, Object) UnityEngine.Debug:Log(Object) Microsoft.MixedReality.Toolkit.Utilities.AsyncCoroutineRunner:get_Instance() Microsoft.MixedReality.Toolkit.Utilities.<>c__DisplayClass13_0:b0() System.Action:Invoke() Microsoft.MixedReality.Toolkit.Utilities.AwaiterExtensions:RunOnUnityScheduler(Action) Microsoft.MixedReality.Toolkit.Utilities.AwaiterExtensions:GetAwaiterReturnVoid(Object) Microsoft.MixedReality.Toolkit.Teleport.d44:MoveNext() System.Runtime.CompilerServices.AsyncVoidMethodBuilder:Start(TStateMachine&) Microsoft.MixedReality.Toolkit.Teleport.TeleportPointer:Start()

[XR] [5468] [12:05:42.774][Info ] OpenXRSession::HandleSessionStateChangedEvent: state XR_SESSION_STATE_FOCUSED->XR_SESSION_STATE_VISIBLE session=2 time=5207576049166 [XR] [XR Input Provider]: Handle Event received with eventType[1381188948], DeviceId[1], Buffer Size[0]. [XR] [5468] [12:05:44.164][Info ] OpenXRSession::HandleSessionStateChangedEvent: state XR_SESSION_STATE_VISIBLE->XR_SESSION_STATE_SYNCHRONIZED session=2 time=5208968458906 [XR] [5468] [12:05:44.164][Info ] OpenXRSession::HandleSessionStateChangedEvent: state XR_SESSION_STATE_SYNCHRONIZED->XR_SESSION_STATE_STOPPING session=2 time=5208968726354

XRTextureManager::RequestDestroyTexture XRTextureManager::RequestDestroyTexture XRTextureManager::RequestDestroyTexture XRTextureManager::RequestDestroyTexture XRTextureManager::RequestDestroyTexture XRTextureManager::RequestDestroyTexture XRTextureManager::RequestDestroyTexture XRTextureManager::RequestDestroyTexture XRTextureManager::RequestDestroyTexture [XR] [5468] [12:05:44.217][Info ] OpenXRSession::HandleSessionStateChangedEvent: state XR_SESSION_STATE_STOPPING->XR_SESSION_STATE_IDLE session=2 time=5209024075156 Trimming D3D resources.

rderbier-tibco commented 3 years ago

I experienced this bug. Same config. Way to reproduce. Follow MRTK instructions to get started with Unity and OpenXR : new Unity project, switch platform, install MRTK 2.7 foundations + examples + Open XR plugin. Follow OpenXR configuration wizard. Install Hand Interaction example. Open the example Scene. Verify the profile. Build and Deploy. Sceen is displayed, Gaze pointer OK, Hand tracking OK. No Hand ray, no close hand interaction, no far hand interaction. Poke pointer seems to work as you can press the sample keyboard keys.

MaxWang-MS commented 3 years ago

@lovelieren @rderbier-tibco Could you please follow the instructions here and let me know if the issue persists? Please make sure you are using the latest Mixed Reality OpenXR plugin, as mentioned in the linked docs. If the issue does not go away please let me know what is the version of MR OpenXR plugin and also include a screenshot like the following: image

MaxWang-MS commented 3 years ago

The latest MR OpenXR plugin version is 1.0.0. Please make sure you hit the refresh button in the discover feature page of the feature tool when installing the package.

zhangq08 commented 3 years ago

@lovelieren @rderbier-tibco Could you please follow the instructions here and let me know if the issue persists? Please make sure you are using the latest Mixed Reality OpenXR plugin, as mentioned in the linked docs. If the issue does not go away please let me know what is the version of MR OpenXR plugin and also include a screenshot like the following: image

this is my config, i checked the package and update MROpenXR from v0.95 to 1.0 ,but still not work.

微信截图_20210619121925 微信截图_20210619122001 微信截图_20210619122008

if i diabale the initial xr on startup ,the hand ray is normal ,but nothing loaded. 微信截图_20210619122142

keveleigh commented 3 years ago

image

I think this is the missing piece. You'll want to add the Microsoft Hand Interaction Profile here.

rderbier-tibco commented 3 years ago

Thanks Kurtis, I confirm that adding the Interaction profile to the OpenXR setting solved the issue on my side. I'm able to use the Hand Interaction example from MRTK in Unity 2020.3.11f1 with OpenXR plugin 1.0.0 now. Maybe a doc update needed.

zhangq08 commented 3 years ago

image

I think this is the missing piece. You'll want to add the Microsoft Hand Interaction Profile here.

yes!!! it worked. thank you.