microsoft / MixedReality-HolographicRemoting-Samples

Code samples for using Microsoft's Holographic Remoting library.
Other
141 stars 47 forks source link

OpenXR Tools for Windows Mixed Reality When to update #80

Closed ccrop closed 8 months ago

ccrop commented 1 year ago

Hi:

  1. OpenXR Tools for Windows Mixed Reality When to update? from 2.8.1 to 2.9.0

    2.9.0 update OnCustomDataChannelDataReceived.How to receive from PC Unity.

  2. How to from mediaCapture->CapturePhotoToStreamAsync get LocationData or Other methods? Please give me some suggestions when I get the location frame in take photos.

    eg:unity C# / void OnCapturedPhotoToMemory(PhotoCapture.PhotoCaptureResult result, PhotoCaptureFrame photoCaptureFrame) { if (photoCaptureFrame.hasLocationData) { photoCaptureFrame.TryGetCameraToWorldMatrix(out Matrix4x4 cameraToWorldMatrix); Quaternion rotation = Quaternion.LookRotation(-cameraToWorldMatrix.GetColumn(2), cameraToWorldMatrix.GetColumn(1)); photoCaptureFrame.TryGetProjectionMatrix(Camera.main.nearClipPlane, Camera.main.farClipPlane, out Matrix4x4 projectionMatrix); m_cameraToWorldMatrix = cameraToWorldMatrix; m_projectionMatrix = projectionMatrix; }
    photoCaptureObject.StopPhotoModeAsync(OnStoppedPhotoMode); }
    / eg:C++ From video stream (HoloLens2ForCV) /* void VideoFrameProcessor::OnFrameArrived(const MediaFrameReader& sender, const MediaFrameArrivedEventArgs& args) { if (MediaFrameReference frame = sender.TryAcquireLatestFrame()) {
    std::lock_guard lock(m_frameMutex); m_latestFrame = frame;

    auto PVtoWorld = m_latestFrame.CoordinateSystem().TryGetTransformTo(m_worldCoordSystem);

    } } */

Remote side (your Windows PC): Unity 2021.3.11 nVidia RTX 3080 MRTK2 new OpenXR Tools for Windows Mixed Reality 2.8.1

*Player side (HoloLens 2) HoloLens 2

chairobl commented 8 months ago

Hi @ccrop since this issue hasn't had any activity in a while I'll be closing it. If your issue persists please consider opening new tickets in the following repositories: